-- Logs begin at Fri 2022-08-26 08:10:04 UTC, end at Fri 2022-08-26 09:12:02 UTC. -- Aug 26 08:37:48.299912 dv-cinder-852364-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 26 08:37:48.309016 dv-cinder-852364-5-smb devstack@keystone.service[87879]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 26 08:37:48.310568 dv-cinder-852364-5-smb devstack@keystone.service[87879]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 08:37:48 2022] *** Aug 26 08:37:48.310568 dv-cinder-852364-5-smb devstack@keystone.service[87879]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 08:37:48.310568 dv-cinder-852364-5-smb devstack@keystone.service[87879]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 08:37:48.310568 dv-cinder-852364-5-smb devstack@keystone.service[87879]: nodename: dv-cinder-852364-5-smb Aug 26 08:37:48.310568 dv-cinder-852364-5-smb devstack@keystone.service[87879]: machine: x86_64 Aug 26 08:37:48.310568 dv-cinder-852364-5-smb devstack@keystone.service[87879]: clock source: unix Aug 26 08:37:48.310568 dv-cinder-852364-5-smb devstack@keystone.service[87879]: pcre jit disabled Aug 26 08:37:48.310568 dv-cinder-852364-5-smb devstack@keystone.service[87879]: detected number of CPU cores: 4 Aug 26 08:37:48.310568 dv-cinder-852364-5-smb devstack@keystone.service[87879]: current working directory: / Aug 26 08:37:48.310568 dv-cinder-852364-5-smb devstack@keystone.service[87879]: detected binary path: /usr/bin/uwsgi-core Aug 26 08:37:48.310568 dv-cinder-852364-5-smb devstack@keystone.service[87879]: your processes number limit is 47680 Aug 26 08:37:48.311961 dv-cinder-852364-5-smb devstack@keystone.service[87879]: your memory page size is 4096 bytes Aug 26 08:37:48.311961 dv-cinder-852364-5-smb devstack@keystone.service[87879]: detected max file descriptor number: 2048 Aug 26 08:37:48.311961 dv-cinder-852364-5-smb devstack@keystone.service[87879]: lock engine: pthread robust mutexes Aug 26 08:37:48.311961 dv-cinder-852364-5-smb devstack@keystone.service[87879]: thunder lock: enabled Aug 26 08:37:48.311961 dv-cinder-852364-5-smb devstack@keystone.service[87879]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 26 08:37:48.311961 dv-cinder-852364-5-smb devstack@keystone.service[87879]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 08:37:48.350818 dv-cinder-852364-5-smb devstack@keystone.service[87879]: Python main interpreter initialized at 0x5633de58a9c0 Aug 26 08:37:48.350818 dv-cinder-852364-5-smb devstack@keystone.service[87879]: python threads support enabled Aug 26 08:37:48.350818 dv-cinder-852364-5-smb devstack@keystone.service[87879]: your server socket listen backlog is limited to 100 connections Aug 26 08:37:48.350818 dv-cinder-852364-5-smb devstack@keystone.service[87879]: your mercy for graceful operations on workers is 90 seconds Aug 26 08:37:48.351159 dv-cinder-852364-5-smb devstack@keystone.service[87879]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 08:37:48.351242 dv-cinder-852364-5-smb devstack@keystone.service[87879]: *** Operational MODE: preforking *** Aug 26 08:37:48.351505 dv-cinder-852364-5-smb devstack@keystone.service[87879]: *** uWSGI is running in multiple interpreter mode *** Aug 26 08:37:48.351505 dv-cinder-852364-5-smb devstack@keystone.service[87879]: spawned uWSGI master process (pid: 87879) Aug 26 08:37:48.351697 dv-cinder-852364-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 26 08:37:48.353635 dv-cinder-852364-5-smb devstack@keystone.service[87879]: spawned uWSGI worker 1 (pid: 87892, cores: 1) Aug 26 08:37:48.353635 dv-cinder-852364-5-smb devstack@keystone.service[87879]: spawned uWSGI worker 2 (pid: 87893, cores: 1) Aug 26 08:37:48.353635 dv-cinder-852364-5-smb devstack@keystone.service[87879]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 08:37:52.611736 dv-cinder-852364-5-smb devstack@keystone.service[87892]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 08:37:52.611736 dv-cinder-852364-5-smb devstack@keystone.service[87892]: from cryptography.utils import int_from_bytes Aug 26 08:37:52.612482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 08:37:52.612482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: from cryptography.utils import int_from_bytes Aug 26 08:37:52.612482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 08:37:52.612482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: from cryptography.utils import int_from_bytes Aug 26 08:37:52.613075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 08:37:52.613075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: from cryptography.utils import int_from_bytes Aug 26 08:37:52.661614 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 08:37:52.661811 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 08:37:52.661897 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 08:37:52.661986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] command line args: [] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 08:37:52.662059 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 08:37:52.662185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] command line args: [] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 08:37:52.662275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 08:37:52.662412 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ================================================================================ {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 08:37:52.662494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 08:37:52.662618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ================================================================================ {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 08:37:52.662698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] admin_token = **** {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.662873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] admin_token = **** {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.662955 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] config_dir = [] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.663069 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.663153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] config_dir = [] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.663251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] config_source = [] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.663328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.663431 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] debug = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.663518 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] config_source = [] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.663628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] debug = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.663764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.663974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.664106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.664212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.664314 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.664417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.664523 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.664628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.664730 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.664833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.664929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] list_limit = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.665064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] list_limit = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.665178 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] log_config_append = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.665284 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] log_config_append = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.665381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.665482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.665583 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] log_dir = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.665680 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] log_dir = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.665779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] log_file = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.665893 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] log_file = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.665974 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.666098 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.666175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.666303 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.666385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.666470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.666542 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.666669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.666753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.666826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.666899 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.666977 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.667096 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.667217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.667292 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.667421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.667505 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.667583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.667705 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.667787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.667865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.667987 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.668071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.668187 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.668262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.668412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.668499 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.668657 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.668749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.668933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.669251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.669434 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] publish_errors = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.669523 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.669619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] publish_errors = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.669696 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.669853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.669940 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.670065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.670146 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.670247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.670325 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.670490 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.670580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.670721 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] standard_threads = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.670800 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.671494 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.671588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] standard_threads = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.671727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.671813 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.671892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.671969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.672047 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] use_journal = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.672173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.672249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] use_json = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.672326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] use_journal = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.672404 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] use_stderr = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.672477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] use_json = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.672547 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] use_syslog = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.672625 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] use_stderr = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.672753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.672833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] use_syslog = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.673018 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.673113 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:37:52.673266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.673354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.673504 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.673588 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.673742 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.673820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.673989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.674078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.674219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.674297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.674460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.674536 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.674689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.674774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.674929 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.675013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.675169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.675248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.675411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.675499 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.675638 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.675721 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.675878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.675955 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.676108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.676195 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.676345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.676423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.676585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.676669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.676816 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.676907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.677072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.677165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.677328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.677407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.677568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.677726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.677801 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.677877 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.678035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.678121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.678286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.678365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.678533 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.678610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.678779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.678858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.679007 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.679087 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.679235 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.679313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.679463 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.679540 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.679693 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.679772 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.679924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.680002 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.680167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.680244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.680394 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.680473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.680621 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.680698 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.680848 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.680924 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.681118 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.681201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.681349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.681434 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.681588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.681671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.681814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.681894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.682048 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.682126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.682279 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.682364 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.682507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.682586 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.682733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.682810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.682958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.683040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.683189 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.683269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.683403 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.683480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.683641 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.683719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.683867 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.683947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.684099 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.684177 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.684326 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.684403 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.684555 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.684634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.684785 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.684867 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.685043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.685159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.685271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.685351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.685506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.685585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.685738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.685817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.685970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.686041 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.686201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.686304 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.686452 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.686533 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.686681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.686750 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.686913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.686987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.687147 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.687226 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.687381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.687456 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.687610 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.687698 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.687844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.687934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.688082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.688175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.688311 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.688390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.688543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.688627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.688771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.688862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.689038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.689121 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.689281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.689359 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.689521 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.689611 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.689760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.689839 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.689993 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.690086 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.690236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.690346 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.690450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.690527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.690686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.690770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.690924 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.691010 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.691157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.691244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.691390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.691468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.691622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.691707 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.691857 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.691934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.692087 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.692165 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.692319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.692409 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.692549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.692630 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.692778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.692856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.693029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.693149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.693293 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.693382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.693509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.693594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.693754 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.693840 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.693986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.694064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.694218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.694297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.694451 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.694606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.694683 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.694792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.694906 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.694987 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.695116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.695205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.695343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.695424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.695571 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.695649 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.695797 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.695880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.696027 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.696108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.696251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.696329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.696478 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.696556 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.696709 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.696784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.696940 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.697043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.697210 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.697289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.697442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.697522 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.697700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.697779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.697933 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.698011 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.698164 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] auth.external = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.698260 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.698392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.698473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] auth.external = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.698623 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.698701 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.698900 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.698978 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.699129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] auth.password = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.699212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.699356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] auth.token = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.699435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] auth.password = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.699582 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] auth.token = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.699661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.699811 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.699891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.700043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.700126 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.700271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.700350 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.700506 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.700586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.700747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.700825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.700981 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.701110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.701233 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.701315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] credential.caching = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.701470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] credential.caching = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.701552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.701712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.701797 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.701957 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.702039 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.702726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.702807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.702968 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.703046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.703196 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.703277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.703435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.703512 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.703681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.703766 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.703915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.703996 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.704156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.704235 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.704413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.704493 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.704661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.704741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.704921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.705031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.705194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.705275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.705436 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.705518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.705666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] federation.caching = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.705744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.705901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.705980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] federation.caching = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.706138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.706219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.706378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.706463 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.706606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.706686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.706839 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.706920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.707071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.707150 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.707311 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.707402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.707543 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.707622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.707790 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.707868 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.708021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.708108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.708264 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.708345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.708495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity.caching = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.708574 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.708730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity.caching = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.708883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.708961 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.709113 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.709218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.709298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.709452 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.709540 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.709687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.709766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.709913 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.709991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.710148 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.710235 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.710384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.710471 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.710628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.710707 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.710859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.710947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.711085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.711165 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.711312 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.711391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.711540 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.711626 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.711781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.711860 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.712024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.712103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.712268 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.712353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.712509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.712588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.712752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.712831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.713274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.713369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.713508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.713589 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.713737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.713818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.713965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.714053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.714190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.714269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.714416 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.714495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.714651 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.714738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.714888 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.714971 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.715122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.715200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.715347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.715434 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.715589 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.715668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.715829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.715908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.716061 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.716149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.716291 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.716370 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.716533 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.716612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.716759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.716848 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.717031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.717115 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.717246 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.717352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.717589 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.717670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.717895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.718477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.718636 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.718716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.718872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.718960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.719109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.719189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.719346 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.719426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.719589 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.719669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.719819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.719898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.720046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.720126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.720276 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.720356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.720521 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.720600 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.720754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.720834 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.721009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.721092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.721243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.721323 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.721472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.721553 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.721701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.721783 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.721941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.722021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.722170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.722249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.722413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.722494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.722656 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.722736 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.722900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.722979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.723130 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.723210 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.723358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.723438 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.723590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.723668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.723821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.723901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.724054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.724133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.724475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.724549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.724631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.724706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.724784 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.724858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.724965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.725078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.725231 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.725313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.725476 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.725555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.725702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.725781 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.725941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.726020 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.726170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.726248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.726404 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.726485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.726635 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.726723 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.726865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.726947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.727096 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.727175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.727339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.727419 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.727572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.727653 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.727806 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.727885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.728038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.728118 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.728279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.728357 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.728509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.728588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.728740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.728821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.728972 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.729068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.729234 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.729313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.729472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.729553 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.729700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.729779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.729931 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.730008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.730164 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] resource.caching = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.730244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.730402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] resource.caching = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.730489 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.730643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.730721 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.730878 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.730959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.731110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.731188 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.731351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.731430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.731583 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.731664 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.731818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.731896 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.732046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.732125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.732273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.732349 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.732500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] role.caching = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.732580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.732733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] role.caching = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.732820 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] role.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.732955 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.733055 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] role.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.733219 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.733298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.733484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.733575 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.733728 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.733809 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.733970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.734049 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.734209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.734296 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.734450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.734531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.734691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.734769 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.734930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.735022 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.735158 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.735238 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.735391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.735519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.735630 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.735719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.735872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.735954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.736113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.736193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.736354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.736497 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.736732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.736810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.737099 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.737238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.737330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.737483 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.737563 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.737765 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.737856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.737980 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.738067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.738190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.738272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.738437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.738517 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.738672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.738755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.738902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.738977 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.739129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.739209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.739357 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.739438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.739589 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.739669 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.739838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.739916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.740081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.740163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.740313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.740393 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.740546 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.740625 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.740772 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.740853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.741015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.741097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] token.caching = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.741254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] token.caching = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.741336 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.741491 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.741572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.741721 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.741800 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.741958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.742037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.742201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.742281 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.742432 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.742512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.742668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.742746 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.742904 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.742984 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.743144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.743223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.743374 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.743453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.743608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.743689 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.743838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.743917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.744068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.744146 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.744314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.744441 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.744548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.744637 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.744786 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.744868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.745068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.745168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.745325 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.connection = **** {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.745414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.745563 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.745644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.connection = **** {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.745805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.745886 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.746038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.746135 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.746271 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.746352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.746500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.746581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.746730 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.746818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.746961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.747043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.747189 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.747267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.747421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.747509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.747648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.747727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.747887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.747967 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.748116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.748204 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.748347 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.748426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.748575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.748654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.748813 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.748901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.749084 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.749168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.749324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.749404 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.749553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.749644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.749721 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 08:37:52.749793 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:37:52.749943 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 08:37:52.779392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.779583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.779674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.779816 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.779900 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.780041 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.788768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.789196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.816580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.816808 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.817203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.817438 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.871201 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.871342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.922103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.922338 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.922833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:52.923072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.080642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.080888 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.081017 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.081104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.081206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.081323 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.081409 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.081544 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.081628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.081764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.081848 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.081981 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.105459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.105567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.105695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.105796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.105926 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.106011 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.106156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.106240 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.106378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.106464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.106596 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.106680 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.106812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.106904 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.118640 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.118876 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.131426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.131653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.131851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.131951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.132030 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.132104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.132177 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.132275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.132367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.132497 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.132579 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.132711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.132790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.132930 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 08:37:53.149459 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.149675 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 08:37:53.149891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.150026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.150110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 08:37:53.150232 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 08:37:53.150437 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.150522 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.150640 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 08:37:53.150764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.150925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.151194 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.151276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.151538 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.151708 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.151973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.161634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.161919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.162051 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.162196 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.162335 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.162483 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.162612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.162903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.169553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.169958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.173044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.173341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.173457 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.173634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.173746 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.173924 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.174036 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.174213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.174327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.174481 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.174617 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.174760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.174883 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.175041 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.175365 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.175454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.175537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.175708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.175813 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.175986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.176097 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.176376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.198776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.199071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.200270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.200545 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.200626 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.200841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.205374 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.205645 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.205727 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.205931 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.206023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.206216 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.212359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.212628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.212709 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.213195 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.217076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.217326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.217408 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.217620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.218189 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.218420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.218502 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.218704 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.218783 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.218980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.219067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.219253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.219332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.219524 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.219602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.219796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.237365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.237661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.237769 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.238054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.241594 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.241995 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.244857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.245187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.245269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.245551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.249460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.249830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.252624 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.253004 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.256051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.256261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.256373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.256573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.256654 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.256869 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.256958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.257186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.257269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.257472 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.257553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.257780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.273421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.273707 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.273790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.273988 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.274067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.274258 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.274339 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.274523 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.281757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.282003 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.283325 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.283556 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.283644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.283837 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.286307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.286518 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.286615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.286806 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.286891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.287108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.287192 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.287396 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.287535 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.287686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.299454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.299707 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.299850 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.299985 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.300118 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.300249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.300389 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.300519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.300649 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.300811 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.300943 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.301106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.301246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.301375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.316660 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.316853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.319742 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.319931 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.322678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.322870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.324142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.324326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.325670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.325861 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.325992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.326149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.326280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.326438 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.332778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.333020 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.334287 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.334492 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.337223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.337446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.337584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.337742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.338121 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.338289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.338419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.338585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.346862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.347141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.347296 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.347425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.347573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.347703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.354400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.354655 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 08:37:53.354786 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.354932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.355065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.355196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.355326 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.355468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.355602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.355748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.355878 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.356009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.356137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.356265 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.356402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.356540 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.356682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.356812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.356951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.357111 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.357246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.357377 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.357508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.357649 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.357783 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.357912 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.358042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.358192 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 08:37:53.394199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5633de58a9c0 pid: 87892 (default app) Aug 26 08:37:53.397629 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87969b13-22f3-4273-9cfd-64f287a6f5ec None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:37:53.397923 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87969b13-22f3-4273-9cfd-64f287a6f5ec None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:37:53.398197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87969b13-22f3-4273-9cfd-64f287a6f5ec None None] PATH_INFO: `/v3` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:37:53.399713 dv-cinder-852364-5-smb devstack@keystone.service[87893]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5633de58a9c0 pid: 87893 (default app) Aug 26 08:37:53.402340 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 791 bytes} [Fri Aug 26 08:37:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:37:59.933850 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f2346-9a50-40dc-a275-35500c0658ad None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:37:59.934387 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f2346-9a50-40dc-a275-35500c0658ad None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:37:59.934387 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f2346-9a50-40dc-a275-35500c0658ad None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:37:59.939180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1/2] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:37:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:37:59.944689 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f9ea7-c6d2-4180-84d0-136eb23bebbe None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:37:59.945099 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f9ea7-c6d2-4180-84d0-136eb23bebbe None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:37:59.945289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f9ea7-c6d2-4180-84d0-136eb23bebbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:00.017286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: INFO dbcounter [None req-cb0f9ea7-c6d2-4180-84d0-136eb23bebbe None None] Registered counter for database keystone Aug 26 08:38:00.035974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG oslo_db.sqlalchemy.engines [None req-cb0f9ea7-c6d2-4180-84d0-136eb23bebbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:38:00.042269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writer thread running {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:38:00.222657 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG passlib.handlers.bcrypt [None req-cb0f9ea7-c6d2-4180-84d0-136eb23bebbe None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87892) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 08:38:00.223004 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG passlib.handlers.bcrypt [None req-cb0f9ea7-c6d2-4180-84d0-136eb23bebbe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87892) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 08:38:00.276875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-cb0f9ea7-c6d2-4180-84d0-136eb23bebbe None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:00.278545 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-cb0f9ea7-c6d2-4180-84d0-136eb23bebbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:00.410596 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 2/3] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:37:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 26 08:38:00.855082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f2346-9a50-40dc-a275-35500c0658ad None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:00.923402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: INFO dbcounter [None req-267f2346-9a50-40dc-a275-35500c0658ad None None] Registered counter for database keystone Aug 26 08:38:00.946141 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG oslo_db.sqlalchemy.engines [None req-267f2346-9a50-40dc-a275-35500c0658ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:38:00.952214 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writer thread running {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:38:01.069568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f2346-9a50-40dc-a275-35500c0658ad None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:01.073803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb0a47-b5ad-4cf3-8843-1f550a299abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:01.074427 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb0a47-b5ad-4cf3-8843-1f550a299abe admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:01.074712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb0a47-b5ad-4cf3-8843-1f550a299abe admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:01.074987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb0a47-b5ad-4cf3-8843-1f550a299abe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:01.082995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb0a47-b5ad-4cf3-8843-1f550a299abe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:01.134505 dv-cinder-852364-5-smb devstack@keystone.service[87893]: WARNING keystone.common.rbac_enforcer.enforcer [None req-58eb0a47-b5ad-4cf3-8843-1f550a299abe admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 08:38:01.134793 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb0a47-b5ad-4cf3-8843-1f550a299abe admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:01.144093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 2/4] 10.222.0.76 () {58 vars in 1324 bytes} [Fri Aug 26 08:38:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 08:38:01.150042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f9ea7-c6d2-4180-84d0-136eb23bebbe None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:01.164313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f9ea7-c6d2-4180-84d0-136eb23bebbe None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:01.168677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f7f79-8d42-4876-8450-e75f66a183ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:01.169820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f7f79-8d42-4876-8450-e75f66a183ae admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:01.170111 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f7f79-8d42-4876-8450-e75f66a183ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:01.170384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f7f79-8d42-4876-8450-e75f66a183ae admin admin] PATH_INFO: `/v3/projects/643957365e294b92aa340cb2a3f5aab3` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:01.172446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f7f79-8d42-4876-8450-e75f66a183ae admin admin] RBAC: Authorizing `identity:get_project(project_id=643957365e294b92aa340cb2a3f5aab3)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:01.225184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: WARNING keystone.common.rbac_enforcer.enforcer [None req-993f7f79-8d42-4876-8450-e75f66a183ae admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 08:38:01.225537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f7f79-8d42-4876-8450-e75f66a183ae admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:01.229977 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 3/5] 10.222.0.76 () {56 vars in 1207 bytes} [Fri Aug 26 08:38:01 2022] GET /identity/v3/projects/643957365e294b92aa340cb2a3f5aab3 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:03.120405 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32aff3-7562-4c99-8c6a-44a24c41d233 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:03.120932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32aff3-7562-4c99-8c6a-44a24c41d233 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:03.120932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32aff3-7562-4c99-8c6a-44a24c41d233 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:03.125586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 3/6] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:38:03.131302 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b0f2-5c8b-4660-b1b8-7a389802fbf5 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:03.131764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b0f2-5c8b-4660-b1b8-7a389802fbf5 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:03.131973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b0f2-5c8b-4660-b1b8-7a389802fbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:03.152027 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-df31b0f2-5c8b-4660-b1b8-7a389802fbf5 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:03.153572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-df31b0f2-5c8b-4660-b1b8-7a389802fbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:03.161323 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 4/7] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 26 08:38:03.430129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32aff3-7562-4c99-8c6a-44a24c41d233 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:03.442449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32aff3-7562-4c99-8c6a-44a24c41d233 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:03.446648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72df70-7da8-45d4-9e5f-c95298199a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:03.447253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72df70-7da8-45d4-9e5f-c95298199a01 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:03.447539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72df70-7da8-45d4-9e5f-c95298199a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:03.447817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72df70-7da8-45d4-9e5f-c95298199a01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:03.455917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72df70-7da8-45d4-9e5f-c95298199a01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:03.457723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72df70-7da8-45d4-9e5f-c95298199a01 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:03.474973 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 4/8] 10.222.0.76 () {58 vars in 1324 bytes} [Fri Aug 26 08:38:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 08:38:03.480534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b0f2-5c8b-4660-b1b8-7a389802fbf5 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:03.489651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b0f2-5c8b-4660-b1b8-7a389802fbf5 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:03.493969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a61887-a0cd-4629-8828-664d5b0aa009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:03.494590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a61887-a0cd-4629-8828-664d5b0aa009 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:03.494878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a61887-a0cd-4629-8828-664d5b0aa009 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:03.495157 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a61887-a0cd-4629-8828-664d5b0aa009 admin admin] PATH_INFO: `/v3/users/d9cceada370c47109408165adf5fe287` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:03.496492 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a61887-a0cd-4629-8828-664d5b0aa009 admin admin] RBAC: Authorizing `identity:get_user(user_id=d9cceada370c47109408165adf5fe287)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:03.498362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a61887-a0cd-4629-8828-664d5b0aa009 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:03.499872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 5/9] 10.222.0.76 () {56 vars in 1198 bytes} [Fri Aug 26 08:38:03 2022] GET /identity/v3/users/d9cceada370c47109408165adf5fe287 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:05.437232 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abb1f3-406e-4841-81a0-8291091ae9d1 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:05.437818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abb1f3-406e-4841-81a0-8291091ae9d1 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:05.437818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abb1f3-406e-4841-81a0-8291091ae9d1 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:05.439139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 5/10] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:05.444540 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d54e3-0479-4c9c-8b01-887a8f90332f None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:05.444976 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d54e3-0479-4c9c-8b01-887a8f90332f None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:05.445136 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d54e3-0479-4c9c-8b01-887a8f90332f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:05.463496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-fc1d54e3-0479-4c9c-8b01-887a8f90332f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:05.464701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-fc1d54e3-0479-4c9c-8b01-887a8f90332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:05.466668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dfe92-6131-42cf-95f1-efb0b674fc6b None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:05.467024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dfe92-6131-42cf-95f1-efb0b674fc6b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:05.467307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dfe92-6131-42cf-95f1-efb0b674fc6b None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:05.469191 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 6/11] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:38:05.474099 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f053cf-220e-4483-885a-c085aee0ac02 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:05.474382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f053cf-220e-4483-885a-c085aee0ac02 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:05.474938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f053cf-220e-4483-885a-c085aee0ac02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:05.516222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG passlib.handlers.bcrypt [None req-16f053cf-220e-4483-885a-c085aee0ac02 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87893) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 08:38:05.516652 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG passlib.handlers.bcrypt [None req-16f053cf-220e-4483-885a-c085aee0ac02 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87893) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 08:38:05.554223 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 6/12] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:05.561902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-16f053cf-220e-4483-885a-c085aee0ac02 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:05.563484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-16f053cf-220e-4483-885a-c085aee0ac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:05.660523 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 7/13] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:05.823750 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d54e3-0479-4c9c-8b01-887a8f90332f None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:05.848126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:05.925936 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f053cf-220e-4483-885a-c085aee0ac02 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:05.927369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d54e3-0479-4c9c-8b01-887a8f90332f None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:05.961402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d2b47-8c84-4440-ab22-a8be697febe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:05.962030 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d2b47-8c84-4440-ab22-a8be697febe9 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:05.962310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d2b47-8c84-4440-ab22-a8be697febe9 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:05.962588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d2b47-8c84-4440-ab22-a8be697febe9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:05.973919 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d2b47-8c84-4440-ab22-a8be697febe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-5f1d2b47-8c84-4440-ab22-a8be697febe9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:05.982841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:05.983905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:05.985952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:05.985952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:05.985952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:05.985952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:05.985952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:05.985952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:05.985952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:05.985952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:05.985952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:05.985952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:05.985952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:05.985952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:05.985952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 7/14] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:05.989710 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d2b47-8c84-4440-ab22-a8be697febe9 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:06.028723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f053cf-220e-4483-885a-c085aee0ac02 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:06.031968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:06.066126 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7038b7-79be-482e-b65b-d314cf9dccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:06.066988 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7038b7-79be-482e-b65b-d314cf9dccac None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:06.067271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7038b7-79be-482e-b65b-d314cf9dccac None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:06.067545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7038b7-79be-482e-b65b-d314cf9dccac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:06.070264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:06.089301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d2b47-8c84-4440-ab22-a8be697febe9 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:06.123462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adaa73-519b-4a3c-ba36-60efdb3459d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:06.124102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adaa73-519b-4a3c-ba36-60efdb3459d5 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:06.124388 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adaa73-519b-4a3c-ba36-60efdb3459d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:06.124664 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adaa73-519b-4a3c-ba36-60efdb3459d5 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:06.125364 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adaa73-519b-4a3c-ba36-60efdb3459d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:06.125675 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adaa73-519b-4a3c-ba36-60efdb3459d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:06.127068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adaa73-519b-4a3c-ba36-60efdb3459d5 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:06.134160 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7038b7-79be-482e-b65b-d314cf9dccac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:06.135671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7038b7-79be-482e-b65b-d314cf9dccac None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:06.138823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 8/15] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:06.144310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adaa73-519b-4a3c-ba36-60efdb3459d5 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:06.232746 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 8/16] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 08:38:06.237976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7038b7-79be-482e-b65b-d314cf9dccac None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:06.240594 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:06.243786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adaa73-519b-4a3c-ba36-60efdb3459d5 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:06.276710 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295c4d0-d9a6-4b88-b15b-5e0f136012cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:06.277388 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295c4d0-d9a6-4b88-b15b-5e0f136012cc None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:06.277672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295c4d0-d9a6-4b88-b15b-5e0f136012cc None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:06.277950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295c4d0-d9a6-4b88-b15b-5e0f136012cc None admin] PATH_INFO: `/v3/users/d9cceada370c47109408165adf5fe287` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:06.279073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295c4d0-d9a6-4b88-b15b-5e0f136012cc None admin] RBAC: Authorizing `identity:get_user(user_id=d9cceada370c47109408165adf5fe287)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:06.281078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295c4d0-d9a6-4b88-b15b-5e0f136012cc None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:06.282611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 9/17] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:06 2022] GET /identity/v3/users/d9cceada370c47109408165adf5fe287 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:06.288007 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295c4d0-d9a6-4b88-b15b-5e0f136012cc None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:06.302151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:06.334982 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7038b7-79be-482e-b65b-d314cf9dccac None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:06.369277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa071a2-13a9-4d6f-ac4f-4802fe40585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:06.370053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa071a2-13a9-4d6f-ac4f-4802fe40585c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:06.370337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa071a2-13a9-4d6f-ac4f-4802fe40585c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:06.370617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa071a2-13a9-4d6f-ac4f-4802fe40585c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:06.388883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa071a2-13a9-4d6f-ac4f-4802fe40585c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:06.390726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295c4d0-d9a6-4b88-b15b-5e0f136012cc None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:06.390848 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa071a2-13a9-4d6f-ac4f-4802fe40585c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-6fa071a2-13a9-4d6f-ac4f-4802fe40585c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:38:06.409313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:06.410338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:38:06.411270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:38:06.411270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:38:06.411270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:06.411270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 9/18] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:38:06.416126 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa071a2-13a9-4d6f-ac4f-4802fe40585c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:06.426346 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071229b-47ff-4207-86bb-fe1a8ed9b382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:06.426978 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071229b-47ff-4207-86bb-fe1a8ed9b382 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:06.427262 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071229b-47ff-4207-86bb-fe1a8ed9b382 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:06.427537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071229b-47ff-4207-86bb-fe1a8ed9b382 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:06.428652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071229b-47ff-4207-86bb-fe1a8ed9b382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:06.430129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071229b-47ff-4207-86bb-fe1a8ed9b382 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:06.436275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 10/19] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:06.437258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071229b-47ff-4207-86bb-fe1a8ed9b382 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:06.472245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:06.515869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa071a2-13a9-4d6f-ac4f-4802fe40585c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:06.516042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:06.536531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071229b-47ff-4207-86bb-fe1a8ed9b382 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:06.549330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f78070-0c05-4356-b496-06b578ea8e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:06.549937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f78070-0c05-4356-b496-06b578ea8e13 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:06.550215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f78070-0c05-4356-b496-06b578ea8e13 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:06.550488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f78070-0c05-4356-b496-06b578ea8e13 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:06.551122 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f78070-0c05-4356-b496-06b578ea8e13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:06.551423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f78070-0c05-4356-b496-06b578ea8e13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:06.552802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f78070-0c05-4356-b496-06b578ea8e13 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:06.569601 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986b6c4-04a4-4a7b-a125-ea1134f61e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:06.570206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986b6c4-04a4-4a7b-a125-ea1134f61e75 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:06.570496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986b6c4-04a4-4a7b-a125-ea1134f61e75 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:06.570778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986b6c4-04a4-4a7b-a125-ea1134f61e75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:06.571183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 10/20] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:06.571583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986b6c4-04a4-4a7b-a125-ea1134f61e75 None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.domain.id=default, user.id=d9cceada370c47109408165adf5fe287) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:06.571900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986b6c4-04a4-4a7b-a125-ea1134f61e75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:06.573456 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986b6c4-04a4-4a7b-a125-ea1134f61e75 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:06.581452 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 11/21] 10.222.0.76 () {56 vars in 1322 bytes} [Fri Aug 26 08:38:06 2022] GET /identity/v3/role_assignments?user.id=d9cceada370c47109408165adf5fe287&scope.domain.id=default&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:08.543583 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edd7a8-8dcc-4e81-a3ec-5c133032820f None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:08.544603 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edd7a8-8dcc-4e81-a3ec-5c133032820f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:08.545109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edd7a8-8dcc-4e81-a3ec-5c133032820f None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:08.546689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 11/22] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:08.551891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e4343-32d7-4807-ba2d-ada5beb12e04 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:08.552669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e4343-32d7-4807-ba2d-ada5beb12e04 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:08.553163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e4343-32d7-4807-ba2d-ada5beb12e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:08.575397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-674e4343-32d7-4807-ba2d-ada5beb12e04 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:08.577620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-674e4343-32d7-4807-ba2d-ada5beb12e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:08.665728 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 12/23] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:09.030793 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeffe09-b614-43f3-8da2-e3b063cb661d None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:09.031498 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeffe09-b614-43f3-8da2-e3b063cb661d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:09.032071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeffe09-b614-43f3-8da2-e3b063cb661d None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:09.033612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 12/24] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:09.038991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0d66b-9892-4434-a4a2-7d5a941a5569 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:09.039501 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0d66b-9892-4434-a4a2-7d5a941a5569 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:09.039965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0d66b-9892-4434-a4a2-7d5a941a5569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:09.065910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-36c0d66b-9892-4434-a4a2-7d5a941a5569 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:09.067396 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-36c0d66b-9892-4434-a4a2-7d5a941a5569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:09.153383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 13/25] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:09.204406 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeffe09-b614-43f3-8da2-e3b063cb661d None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:09.241586 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c674f4-aeed-4f8b-b448-8e6385937f13 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:09.242205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c674f4-aeed-4f8b-b448-8e6385937f13 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:09.242716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c674f4-aeed-4f8b-b448-8e6385937f13 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:09.244489 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 14/26] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:09.251918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27a718-c9a0-413b-8b4d-1e553284585f None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:09.252455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27a718-c9a0-413b-8b4d-1e553284585f None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:09.252949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27a718-c9a0-413b-8b4d-1e553284585f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:09.267719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:09.290133 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-4c27a718-c9a0-413b-8b4d-1e553284585f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:09.291271 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-4c27a718-c9a0-413b-8b4d-1e553284585f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:09.381452 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeffe09-b614-43f3-8da2-e3b063cb661d None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:09.416790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:09.446846 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b031384-16a0-461d-8114-55aabafa0c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:09.447490 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b031384-16a0-461d-8114-55aabafa0c9a None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:09.447775 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b031384-16a0-461d-8114-55aabafa0c9a None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:09.448052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b031384-16a0-461d-8114-55aabafa0c9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:09.454604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 15/27] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 26 08:38:09.455640 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff905e-ac90-4ec5-80e2-fd40e150facd None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:09.455932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff905e-ac90-4ec5-80e2-fd40e150facd None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:09.456213 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff905e-ac90-4ec5-80e2-fd40e150facd None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:09.457642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 16/28] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:09.463418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c53aa-ae12-4dce-a352-b3f335355e54 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:09.463769 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c53aa-ae12-4dce-a352-b3f335355e54 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:09.464055 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c53aa-ae12-4dce-a352-b3f335355e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:09.465477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b031384-16a0-461d-8114-55aabafa0c9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-6b031384-16a0-461d-8114-55aabafa0c9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:09.472561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:09.473622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:09.474586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:09.474586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:09.474586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:09.474586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:09.474586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:09.474586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:09.474586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:09.474586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:09.474586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:09.474586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:09.474586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:09.474586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:09.476739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 13/29] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:38:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:09.482553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b031384-16a0-461d-8114-55aabafa0c9a None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:09.504826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ee4c53aa-ae12-4dce-a352-b3f335355e54 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:09.506053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ee4c53aa-ae12-4dce-a352-b3f335355e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:09.631491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b031384-16a0-461d-8114-55aabafa0c9a None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:09.674743 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8e0c4-1909-4d68-a816-a4524c83902c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:09.675641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8e0c4-1909-4d68-a816-a4524c83902c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:09.676062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8e0c4-1909-4d68-a816-a4524c83902c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:09.676475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8e0c4-1909-4d68-a816-a4524c83902c None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:09.677449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8e0c4-1909-4d68-a816-a4524c83902c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:09.677902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8e0c4-1909-4d68-a816-a4524c83902c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:09.679510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8e0c4-1909-4d68-a816-a4524c83902c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:09.693965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 14/30] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:09.694966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8e0c4-1909-4d68-a816-a4524c83902c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:09.703894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 17/31] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:09.704743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c53aa-ae12-4dce-a352-b3f335355e54 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:09.758666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:09.822046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:09.862905 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8e0c4-1909-4d68-a816-a4524c83902c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:09.879313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c53aa-ae12-4dce-a352-b3f335355e54 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:09.931043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55070686-6df5-4967-ab0f-7800271b4e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:09.931686 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55070686-6df5-4967-ab0f-7800271b4e61 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:09.931979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55070686-6df5-4967-ab0f-7800271b4e61 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:09.932255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55070686-6df5-4967-ab0f-7800271b4e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:09.943664 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3102c8-1aea-4173-ba11-6bfb2d62bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:09.944305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3102c8-1aea-4173-ba11-6bfb2d62bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:09.944585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3102c8-1aea-4173-ba11-6bfb2d62bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:09.944857 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3102c8-1aea-4173-ba11-6bfb2d62bdd5 None admin] PATH_INFO: `/v3/users/d9cceada370c47109408165adf5fe287` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:09.946615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3102c8-1aea-4173-ba11-6bfb2d62bdd5 None admin] RBAC: Authorizing `identity:get_user(user_id=d9cceada370c47109408165adf5fe287)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:09.948125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3102c8-1aea-4173-ba11-6bfb2d62bdd5 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:09.949739 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 18/32] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:09 2022] GET /identity/v3/users/d9cceada370c47109408165adf5fe287 => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:09.950488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3102c8-1aea-4173-ba11-6bfb2d62bdd5 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:09.955890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55070686-6df5-4967-ab0f-7800271b4e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:09.957403 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55070686-6df5-4967-ab0f-7800271b4e61 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-55070686-6df5-4967-ab0f-7800271b4e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:38:09.981043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:09.982132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:38:09.983120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:38:09.983120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:38:09.983120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:09.985277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 15/33] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:09.986324 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55070686-6df5-4967-ab0f-7800271b4e61 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:10.110925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3102c8-1aea-4173-ba11-6bfb2d62bdd5 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:10.121641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:10.135668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55070686-6df5-4967-ab0f-7800271b4e61 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:10.144106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:10.150785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf0346-d41c-4272-a50e-22a7bc4f5276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:10.151785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf0346-d41c-4272-a50e-22a7bc4f5276 None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:10.152171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf0346-d41c-4272-a50e-22a7bc4f5276 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:10.152547 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf0346-d41c-4272-a50e-22a7bc4f5276 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:10.153494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf0346-d41c-4272-a50e-22a7bc4f5276 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:10.154953 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf0346-d41c-4272-a50e-22a7bc4f5276 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:10.176864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b6b87-8467-4de1-b251-7cc765b729a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:10.177878 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b6b87-8467-4de1-b251-7cc765b729a6 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:10.178337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b6b87-8467-4de1-b251-7cc765b729a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:10.178753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b6b87-8467-4de1-b251-7cc765b729a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:10.180295 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b6b87-8467-4de1-b251-7cc765b729a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:10.181961 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b6b87-8467-4de1-b251-7cc765b729a6 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:10.183712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 16/34] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:10.184665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b6b87-8467-4de1-b251-7cc765b729a6 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:10.281946 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 19/35] 10.222.0.76 () {60 vars in 1131 bytes} [Fri Aug 26 08:38:09 2022] POST /identity/v3/roles => generated 219 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:38:10.283128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf0346-d41c-4272-a50e-22a7bc4f5276 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:10.302469 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b6b87-8467-4de1-b251-7cc765b729a6 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:10.342274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dcb94-8d07-4b1f-9193-df8b35446ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:10.343587 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dcb94-8d07-4b1f-9193-df8b35446ae6 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:10.343942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dcb94-8d07-4b1f-9193-df8b35446ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:10.344291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dcb94-8d07-4b1f-9193-df8b35446ae6 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:10.345062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dcb94-8d07-4b1f-9193-df8b35446ae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:10.345446 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dcb94-8d07-4b1f-9193-df8b35446ae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:10.346949 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dcb94-8d07-4b1f-9193-df8b35446ae6 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:10.361453 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 17/36] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:10.362463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dcb94-8d07-4b1f-9193-df8b35446ae6 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:10.383846 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:10.402583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf0346-d41c-4272-a50e-22a7bc4f5276 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:10.441433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e510a3c-f451-41ba-a64f-98744870b7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:10.442403 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e510a3c-f451-41ba-a64f-98744870b7bd None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:10.442948 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e510a3c-f451-41ba-a64f-98744870b7bd None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:10.443537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e510a3c-f451-41ba-a64f-98744870b7bd None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:10.444213 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e510a3c-f451-41ba-a64f-98744870b7bd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:10.445762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e510a3c-f451-41ba-a64f-98744870b7bd None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:10.463669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 20/37] 10.222.0.76 () {60 vars in 1131 bytes} [Fri Aug 26 08:38:10 2022] POST /identity/v3/roles => generated 225 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:38:10.464846 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598029f1-e799-499d-a340-3c5fbb54dcaf None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:10.465179 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598029f1-e799-499d-a340-3c5fbb54dcaf None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:10.465450 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598029f1-e799-499d-a340-3c5fbb54dcaf None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:10.466849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 21/38] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:10.467481 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598029f1-e799-499d-a340-3c5fbb54dcaf None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:10.477948 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dcb94-8d07-4b1f-9193-df8b35446ae6 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:10.523200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cf205-5732-4429-b078-b960f562179a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:10.524612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cf205-5732-4429-b078-b960f562179a None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:10.524904 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cf205-5732-4429-b078-b960f562179a None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:10.525220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cf205-5732-4429-b078-b960f562179a None admin] PATH_INFO: `/v3/domains/default/users/d9cceada370c47109408165adf5fe287/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:10.527741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cf205-5732-4429-b078-b960f562179a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d9cceada370c47109408165adf5fe287, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:10.529332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cf205-5732-4429-b078-b960f562179a None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:10.531306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:10.611412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598029f1-e799-499d-a340-3c5fbb54dcaf None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:10.656121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bbd81-d539-474b-9e69-241d860f5206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:10.656661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bbd81-d539-474b-9e69-241d860f5206 None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:10.656945 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bbd81-d539-474b-9e69-241d860f5206 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:10.657305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bbd81-d539-474b-9e69-241d860f5206 None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:10.657955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bbd81-d539-474b-9e69-241d860f5206 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:10.659418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bbd81-d539-474b-9e69-241d860f5206 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:10.682176 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 18/39] 10.222.0.76 () {58 vars in 1361 bytes} [Fri Aug 26 08:38:10 2022] PUT /identity/v3/domains/default/users/d9cceada370c47109408165adf5fe287/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:38:10.683910 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc6a89-fe65-42bd-9841-24b81903ceb2 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:10.684207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc6a89-fe65-42bd-9841-24b81903ceb2 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:10.684491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc6a89-fe65-42bd-9841-24b81903ceb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:10.693759 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 22/40] 10.222.0.76 () {60 vars in 1141 bytes} [Fri Aug 26 08:38:10 2022] POST /identity/v3/projects => generated 301 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:38:10.695167 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0403be-08cb-4d7c-938b-ea0923dea99b None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:10.695461 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0403be-08cb-4d7c-938b-ea0923dea99b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:10.695746 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0403be-08cb-4d7c-938b-ea0923dea99b None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:10.697493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 23/41] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:10.706697 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f55a6-567f-4bcd-ac3d-5fc04563bb0e None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:10.707350 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f55a6-567f-4bcd-ac3d-5fc04563bb0e None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:10.707432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f55a6-567f-4bcd-ac3d-5fc04563bb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:10.708458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-01fc6a89-fe65-42bd-9841-24b81903ceb2 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:10.710464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-01fc6a89-fe65-42bd-9841-24b81903ceb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:10.735410 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-dc1f55a6-567f-4bcd-ac3d-5fc04563bb0e None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:10.739046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-dc1f55a6-567f-4bcd-ac3d-5fc04563bb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:10.805165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 19/42] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:10.930360 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 24/43] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:11.084198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc6a89-fe65-42bd-9841-24b81903ceb2 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:11.095576 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:11.188406 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc6a89-fe65-42bd-9841-24b81903ceb2 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:11.197891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f55a6-567f-4bcd-ac3d-5fc04563bb0e None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:11.230038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b41e74-d6d1-43a3-8c7b-014014de3dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:11.230931 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b41e74-d6d1-43a3-8c7b-014014de3dbe None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:11.231223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b41e74-d6d1-43a3-8c7b-014014de3dbe None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:11.231504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b41e74-d6d1-43a3-8c7b-014014de3dbe None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:11.232264 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b41e74-d6d1-43a3-8c7b-014014de3dbe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:11.232930 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:11.236050 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b41e74-d6d1-43a3-8c7b-014014de3dbe None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:11.257023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 20/44] 10.222.0.76 () {60 vars in 1131 bytes} [Fri Aug 26 08:38:11 2022] POST /identity/v3/roles => generated 223 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:38:11.308238 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f55a6-567f-4bcd-ac3d-5fc04563bb0e None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:11.347857 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab850bdc-086d-47ff-99a3-954f24feb215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:11.348518 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab850bdc-086d-47ff-99a3-954f24feb215 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:11.348806 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab850bdc-086d-47ff-99a3-954f24feb215 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:11.349125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab850bdc-086d-47ff-99a3-954f24feb215 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:11.350282 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab850bdc-086d-47ff-99a3-954f24feb215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:11.351750 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab850bdc-086d-47ff-99a3-954f24feb215 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:11.353624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 25/45] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:11.359158 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b41e74-d6d1-43a3-8c7b-014014de3dbe None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:11.435401 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:11.470403 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b41e74-d6d1-43a3-8c7b-014014de3dbe None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:11.503588 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396c25e-cf8a-4cf7-a1df-c4375bdfb6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:11.504195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396c25e-cf8a-4cf7-a1df-c4375bdfb6d7 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:11.504478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396c25e-cf8a-4cf7-a1df-c4375bdfb6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:11.504751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396c25e-cf8a-4cf7-a1df-c4375bdfb6d7 None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:11.505451 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396c25e-cf8a-4cf7-a1df-c4375bdfb6d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:11.506908 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396c25e-cf8a-4cf7-a1df-c4375bdfb6d7 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:11.534048 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 21/46] 10.222.0.76 () {60 vars in 1141 bytes} [Fri Aug 26 08:38:11 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:38:12.640494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c940f4b-bcbb-42d4-ba79-d21ed15dfae7 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:12.641032 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c940f4b-bcbb-42d4-ba79-d21ed15dfae7 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:12.641121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c940f4b-bcbb-42d4-ba79-d21ed15dfae7 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:12.642569 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 26/47] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:12.647551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c1162-ab53-4e48-a253-bfbebf309d71 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:12.647924 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c1162-ab53-4e48-a253-bfbebf309d71 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:12.648127 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c1162-ab53-4e48-a253-bfbebf309d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:12.666367 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-888c1162-ab53-4e48-a253-bfbebf309d71 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:12.667572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-888c1162-ab53-4e48-a253-bfbebf309d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:12.734493 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 22/48] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:13.003674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c940f4b-bcbb-42d4-ba79-d21ed15dfae7 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:13.106540 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c940f4b-bcbb-42d4-ba79-d21ed15dfae7 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:13.108067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:13.142201 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ebd86-11e5-4b22-a8ac-1c9f2f119d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:13.142836 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ebd86-11e5-4b22-a8ac-1c9f2f119d12 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:13.143120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ebd86-11e5-4b22-a8ac-1c9f2f119d12 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:13.143398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ebd86-11e5-4b22-a8ac-1c9f2f119d12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:13.153271 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ebd86-11e5-4b22-a8ac-1c9f2f119d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-613ebd86-11e5-4b22-a8ac-1c9f2f119d12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:13.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:13.158964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:13.159730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:13.159730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:13.159730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:13.159730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:13.159730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:13.159730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:13.159730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:13.159730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:13.159730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:13.159730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:13.159730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:13.159730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:13.159730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 27/49] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:38:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:13.165058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c1162-ab53-4e48-a253-bfbebf309d71 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:13.214113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:13.263132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c1162-ab53-4e48-a253-bfbebf309d71 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:13.295492 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f8aa9-5270-4ddf-a6b9-9d2568925fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:13.296646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f8aa9-5270-4ddf-a6b9-9d2568925fbe None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:13.296925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f8aa9-5270-4ddf-a6b9-9d2568925fbe None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:13.297226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f8aa9-5270-4ddf-a6b9-9d2568925fbe None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:13.297888 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f8aa9-5270-4ddf-a6b9-9d2568925fbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:13.298191 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f8aa9-5270-4ddf-a6b9-9d2568925fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:13.299568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f8aa9-5270-4ddf-a6b9-9d2568925fbe None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:13.307530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 23/50] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:13.313050 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ebd86-11e5-4b22-a8ac-1c9f2f119d12 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:13.412506 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ebd86-11e5-4b22-a8ac-1c9f2f119d12 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:13.437148 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497c30a-8b08-4274-9961-3af0aa395db6 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:13.437446 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497c30a-8b08-4274-9961-3af0aa395db6 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:13.437731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497c30a-8b08-4274-9961-3af0aa395db6 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:13.439066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 24/51] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:38:13.444027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324b6fd-769a-4c16-84ad-588bd61a228d None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:13.444323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324b6fd-769a-4c16-84ad-588bd61a228d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:13.444606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324b6fd-769a-4c16-84ad-588bd61a228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:13.446775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0ffdd-d154-418a-8871-07631274c10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:13.447402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0ffdd-d154-418a-8871-07631274c10e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:13.447693 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0ffdd-d154-418a-8871-07631274c10e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:13.447975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0ffdd-d154-418a-8871-07631274c10e None admin] PATH_INFO: `/v3/users/d9cceada370c47109408165adf5fe287` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:13.449120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0ffdd-d154-418a-8871-07631274c10e None admin] RBAC: Authorizing `identity:get_user(user_id=d9cceada370c47109408165adf5fe287)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:13.450567 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0ffdd-d154-418a-8871-07631274c10e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:13.453189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 28/52] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:13 2022] GET /identity/v3/users/d9cceada370c47109408165adf5fe287 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:13.458394 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0ffdd-d154-418a-8871-07631274c10e None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:13.462464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-a324b6fd-769a-4c16-84ad-588bd61a228d None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:13.463911 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a324b6fd-769a-4c16-84ad-588bd61a228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:13.489791 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:13.530762 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 25/53] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:13.569690 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0ffdd-d154-418a-8871-07631274c10e None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:13.605511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883d40e-2378-48eb-b1a9-41485efed52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:13.606143 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883d40e-2378-48eb-b1a9-41485efed52f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:13.606431 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883d40e-2378-48eb-b1a9-41485efed52f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:13.606711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883d40e-2378-48eb-b1a9-41485efed52f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:13.607849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883d40e-2378-48eb-b1a9-41485efed52f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:13.609971 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883d40e-2378-48eb-b1a9-41485efed52f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:13.611541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 29/54] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:13.617381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324b6fd-769a-4c16-84ad-588bd61a228d None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:13.659847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:13.714578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324b6fd-769a-4c16-84ad-588bd61a228d None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:13.798908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883d40e-2378-48eb-b1a9-41485efed52f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:13.852709 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2a7d7-3742-4fa3-b56c-e65d65510ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:13.853342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2a7d7-3742-4fa3-b56c-e65d65510ecb None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:13.853626 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2a7d7-3742-4fa3-b56c-e65d65510ecb None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:13.853900 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2a7d7-3742-4fa3-b56c-e65d65510ecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:13.854627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2a7d7-3742-4fa3-b56c-e65d65510ecb None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.domain.id=default, user.id=d9cceada370c47109408165adf5fe287) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:13.854935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2a7d7-3742-4fa3-b56c-e65d65510ecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:13.856379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2a7d7-3742-4fa3-b56c-e65d65510ecb None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:13.864134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 26/55] 10.222.0.76 () {56 vars in 1322 bytes} [Fri Aug 26 08:38:13 2022] GET /identity/v3/role_assignments?user.id=d9cceada370c47109408165adf5fe287&scope.domain.id=default&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 530 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:13.901287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:13.906078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883d40e-2378-48eb-b1a9-41485efed52f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:13.941849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47672d81-9a51-4e22-944c-9f571fc392e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:13.942497 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47672d81-9a51-4e22-944c-9f571fc392e5 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:13.942784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47672d81-9a51-4e22-944c-9f571fc392e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:13.943062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47672d81-9a51-4e22-944c-9f571fc392e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:13.944190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47672d81-9a51-4e22-944c-9f571fc392e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:13.945703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47672d81-9a51-4e22-944c-9f571fc392e5 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:13.947312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 30/56] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:13.953702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2a7d7-3742-4fa3-b56c-e65d65510ecb None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:14.059392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2a7d7-3742-4fa3-b56c-e65d65510ecb None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:14.067180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:14.094805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab42ba-d9f3-4b37-8f35-488a39112169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:14.095420 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab42ba-d9f3-4b37-8f35-488a39112169 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:14.095708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab42ba-d9f3-4b37-8f35-488a39112169 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:14.095986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab42ba-d9f3-4b37-8f35-488a39112169 None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:14.096636 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab42ba-d9f3-4b37-8f35-488a39112169 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:14.098123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab42ba-d9f3-4b37-8f35-488a39112169 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:14.123130 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 27/57] 10.222.0.76 () {60 vars in 1140 bytes} [Fri Aug 26 08:38:13 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:38:16.002639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5a0d2-df35-41ba-b352-ede7cf8f9742 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:16.003168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5a0d2-df35-41ba-b352-ede7cf8f9742 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:16.003168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5a0d2-df35-41ba-b352-ede7cf8f9742 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:16.004514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 31/58] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:16.009738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2086583-1568-4e4b-8322-446b06693e86 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:16.010118 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2086583-1568-4e4b-8322-446b06693e86 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:16.010304 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2086583-1568-4e4b-8322-446b06693e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:16.027847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-a2086583-1568-4e4b-8322-446b06693e86 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:16.029072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a2086583-1568-4e4b-8322-446b06693e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:16.093445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 28/59] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:16.364184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5a0d2-df35-41ba-b352-ede7cf8f9742 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:16.465126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5a0d2-df35-41ba-b352-ede7cf8f9742 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:16.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae8557-5668-46b1-9527-94e46065ae44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:16.497776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae8557-5668-46b1-9527-94e46065ae44 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:16.498065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae8557-5668-46b1-9527-94e46065ae44 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:16.498345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae8557-5668-46b1-9527-94e46065ae44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:16.499981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae8557-5668-46b1-9527-94e46065ae44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:16.501441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae8557-5668-46b1-9527-94e46065ae44 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:16.502969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 32/60] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:16.508350 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2086583-1568-4e4b-8322-446b06693e86 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:16.594696 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:16.607083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2086583-1568-4e4b-8322-446b06693e86 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:16.640346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e55fb-f848-4b4b-b3f4-44bca18b14f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:16.640887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e55fb-f848-4b4b-b3f4-44bca18b14f8 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:16.641197 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e55fb-f848-4b4b-b3f4-44bca18b14f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:16.641476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e55fb-f848-4b4b-b3f4-44bca18b14f8 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:16.642113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e55fb-f848-4b4b-b3f4-44bca18b14f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:16.643548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e55fb-f848-4b4b-b3f4-44bca18b14f8 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:16.668121 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 29/61] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:38:16 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:38:19.588901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eea24-3d8f-47dc-8384-b8c36fbd8e23 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:19.589802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eea24-3d8f-47dc-8384-b8c36fbd8e23 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:19.590278 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eea24-3d8f-47dc-8384-b8c36fbd8e23 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:19.591917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 33/62] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:19.597892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9b19d-c0d8-4e09-ac0d-f9b652757c60 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:19.598749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9b19d-c0d8-4e09-ac0d-f9b652757c60 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:19.599250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9b19d-c0d8-4e09-ac0d-f9b652757c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:19.630384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-91b9b19d-c0d8-4e09-ac0d-f9b652757c60 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:19.631922 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-91b9b19d-c0d8-4e09-ac0d-f9b652757c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:19.728649 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 30/63] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:19.777427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205584c-8ead-47ab-a5be-183d29ce4821 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:19.778137 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205584c-8ead-47ab-a5be-183d29ce4821 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:19.778622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205584c-8ead-47ab-a5be-183d29ce4821 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:19.780774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 34/64] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:19.786229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f79e6-2fb9-4b2a-94ec-5ebf86d7d9b2 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:19.786749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f79e6-2fb9-4b2a-94ec-5ebf86d7d9b2 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:19.787250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f79e6-2fb9-4b2a-94ec-5ebf86d7d9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:19.814197 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-e66f79e6-2fb9-4b2a-94ec-5ebf86d7d9b2 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:19.815705 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e66f79e6-2fb9-4b2a-94ec-5ebf86d7d9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:19.913026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 31/65] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:20.064371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fcfbc-031e-4ccb-8757-cd1493de4f1e None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:20.065038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fcfbc-031e-4ccb-8757-cd1493de4f1e None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:20.065517 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fcfbc-031e-4ccb-8757-cd1493de4f1e None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:20.067068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 35/66] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:20.072182 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed33790-d47e-4e68-8db0-8f8a26f40d7e None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:20.072477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed33790-d47e-4e68-8db0-8f8a26f40d7e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:20.072758 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed33790-d47e-4e68-8db0-8f8a26f40d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:20.081156 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:20.096562 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-1ed33790-d47e-4e68-8db0-8f8a26f40d7e None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:20.097802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1ed33790-d47e-4e68-8db0-8f8a26f40d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:20.134766 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fcfbc-031e-4ccb-8757-cd1493de4f1e None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:20.173888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:20.194537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 32/67] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:20.214253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38b275-574a-453b-b880-2fed281a5f37 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:20.214867 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38b275-574a-453b-b880-2fed281a5f37 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:20.215345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38b275-574a-453b-b880-2fed281a5f37 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:20.216871 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 33/68] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:38:20.222468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a5a61-22b2-4819-8b7a-122b579679be None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:20.222991 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a5a61-22b2-4819-8b7a-122b579679be None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:20.223464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a5a61-22b2-4819-8b7a-122b579679be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:20.262198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fcfbc-031e-4ccb-8757-cd1493de4f1e None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:20.264859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-c98a5a61-22b2-4819-8b7a-122b579679be None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:20.266089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c98a5a61-22b2-4819-8b7a-122b579679be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:20.300180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628ff83-2538-4aa3-abb0-8d0b5e4da4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:20.300820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ff83-2538-4aa3-abb0-8d0b5e4da4d5 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:20.301137 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ff83-2538-4aa3-abb0-8d0b5e4da4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:20.301562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ff83-2538-4aa3-abb0-8d0b5e4da4d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:20.312170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628ff83-2538-4aa3-abb0-8d0b5e4da4d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-8628ff83-2538-4aa3-abb0-8d0b5e4da4d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:20.316916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:20.317776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:20.318907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:20.318907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:20.318907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:20.318907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:20.318907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:20.318907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:20.318907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:20.318907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:20.318907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:20.318907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:20.318907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:20.318907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:20.318907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 36/69] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:38:20.319569 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79341e2-03ed-4f5f-b3dc-102c19ef3aa3 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:20.319569 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79341e2-03ed-4f5f-b3dc-102c19ef3aa3 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:20.319692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79341e2-03ed-4f5f-b3dc-102c19ef3aa3 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:20.320928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 37/70] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:20.326734 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79341e2-03ed-4f5f-b3dc-102c19ef3aa3 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:20.353095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 34/71] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:20.354240 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f13011-eac4-4a1a-a148-16fa1ed9b601 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:20.354534 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f13011-eac4-4a1a-a148-16fa1ed9b601 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:20.354820 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f13011-eac4-4a1a-a148-16fa1ed9b601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:20.379417 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-d0f13011-eac4-4a1a-a148-16fa1ed9b601 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:20.380929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d0f13011-eac4-4a1a-a148-16fa1ed9b601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:20.442464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:20.452754 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79341e2-03ed-4f5f-b3dc-102c19ef3aa3 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:20.461648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:20.475010 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 35/72] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:20.477889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f13011-eac4-4a1a-a148-16fa1ed9b601 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:20.513656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852d894-44a3-4e49-a439-72650d15ff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:20.514875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852d894-44a3-4e49-a439-72650d15ff61 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:20.515157 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852d894-44a3-4e49-a439-72650d15ff61 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:20.515429 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852d894-44a3-4e49-a439-72650d15ff61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:20.532320 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852d894-44a3-4e49-a439-72650d15ff61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-1852d894-44a3-4e49-a439-72650d15ff61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:20.538742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:20.539604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:20.540384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:20.540384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:20.540384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:20.540384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:20.540384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:20.540384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:20.540384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:20.540384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:20.540384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:20.540384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:20.540384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:20.540384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:20.544898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 38/73] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:20.546251 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852d894-44a3-4e49-a439-72650d15ff61 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:20.602424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f13011-eac4-4a1a-a148-16fa1ed9b601 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:20.646269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b9c2c-e22d-49f3-93be-bb0d6424735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:20.646889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b9c2c-e22d-49f3-93be-bb0d6424735e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:20.647172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b9c2c-e22d-49f3-93be-bb0d6424735e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:20.647440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b9c2c-e22d-49f3-93be-bb0d6424735e None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:20.648109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b9c2c-e22d-49f3-93be-bb0d6424735e None admin] RBAC: Adding query filter params (name=member) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:20.648414 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b9c2c-e22d-49f3-93be-bb0d6424735e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:20.649821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b9c2c-e22d-49f3-93be-bb0d6424735e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:20.658678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 36/74] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:20.659353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b9c2c-e22d-49f3-93be-bb0d6424735e None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:20.671798 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852d894-44a3-4e49-a439-72650d15ff61 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:20.708750 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607a0fc-a35a-4460-a6c3-2409dfefcb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:20.709328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607a0fc-a35a-4460-a6c3-2409dfefcb89 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:20.709618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607a0fc-a35a-4460-a6c3-2409dfefcb89 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:20.709887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607a0fc-a35a-4460-a6c3-2409dfefcb89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:20.720463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:20.721212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607a0fc-a35a-4460-a6c3-2409dfefcb89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-7607a0fc-a35a-4460-a6c3-2409dfefcb89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:20.726258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:20.727149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:20.727925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:20.727925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:20.727925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:20.727925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:20.727925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:20.727925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:20.727925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:20.727925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:20.727925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:20.727925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:20.727925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:20.727925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:20.727925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 39/75] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:38:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:20.728567 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607a0fc-a35a-4460-a6c3-2409dfefcb89 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:20.746892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:20.771727 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b9c2c-e22d-49f3-93be-bb0d6424735e None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:20.805848 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7b189-2ebf-4116-a0a5-fbc7582dd0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:20.806646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7b189-2ebf-4116-a0a5-fbc7582dd0f8 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:20.806933 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7b189-2ebf-4116-a0a5-fbc7582dd0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:20.807209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7b189-2ebf-4116-a0a5-fbc7582dd0f8 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:20.807872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7b189-2ebf-4116-a0a5-fbc7582dd0f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:20.808180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7b189-2ebf-4116-a0a5-fbc7582dd0f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:20.809601 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7b189-2ebf-4116-a0a5-fbc7582dd0f8 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:20.819313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 37/76] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:20.820413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7b189-2ebf-4116-a0a5-fbc7582dd0f8 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:20.831276 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607a0fc-a35a-4460-a6c3-2409dfefcb89 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:20.864377 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0dcac-c84a-40c1-aa2e-1c2400fa2698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:20.865025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0dcac-c84a-40c1-aa2e-1c2400fa2698 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:20.865327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0dcac-c84a-40c1-aa2e-1c2400fa2698 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:20.865608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0dcac-c84a-40c1-aa2e-1c2400fa2698 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:20.866730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0dcac-c84a-40c1-aa2e-1c2400fa2698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:20.868170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0dcac-c84a-40c1-aa2e-1c2400fa2698 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:20.869749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 40/77] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:20.870509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0dcac-c84a-40c1-aa2e-1c2400fa2698 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:20.917762 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7b189-2ebf-4116-a0a5-fbc7582dd0f8 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:20.934251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:20.951026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:20.952466 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d85abc-fd20-4c6b-af06-d39ed85b579b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:20.953318 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d85abc-fd20-4c6b-af06-d39ed85b579b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:20.953644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d85abc-fd20-4c6b-af06-d39ed85b579b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:20.953939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d85abc-fd20-4c6b-af06-d39ed85b579b None admin] PATH_INFO: `/v3/users/75c78ba256b046a890982a91574c5ec6` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:20.968808 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d85abc-fd20-4c6b-af06-d39ed85b579b None admin] RBAC: Authorizing `identity:get_user(user_id=75c78ba256b046a890982a91574c5ec6)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:20.970560 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0dcac-c84a-40c1-aa2e-1c2400fa2698 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:20.970672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d85abc-fd20-4c6b-af06-d39ed85b579b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:20.972246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 38/78] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:20 2022] GET /identity/v3/users/75c78ba256b046a890982a91574c5ec6 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:20.973497 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d85abc-fd20-4c6b-af06-d39ed85b579b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:21.005711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae1ba9-4457-4c36-ad95-c6fa9a15b76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:21.006323 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae1ba9-4457-4c36-ad95-c6fa9a15b76e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:21.006610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae1ba9-4457-4c36-ad95-c6fa9a15b76e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:21.006891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae1ba9-4457-4c36-ad95-c6fa9a15b76e None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:21.007561 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae1ba9-4457-4c36-ad95-c6fa9a15b76e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:21.007873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae1ba9-4457-4c36-ad95-c6fa9a15b76e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:21.009293 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae1ba9-4457-4c36-ad95-c6fa9a15b76e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:21.017743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 41/79] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:38:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:21.018540 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae1ba9-4457-4c36-ad95-c6fa9a15b76e None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:21.074026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d85abc-fd20-4c6b-af06-d39ed85b579b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:21.108976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3566536-79ed-40ef-8b8e-87e06cdf8203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:21.109644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3566536-79ed-40ef-8b8e-87e06cdf8203 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:21.109929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3566536-79ed-40ef-8b8e-87e06cdf8203 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:21.110204 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3566536-79ed-40ef-8b8e-87e06cdf8203 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:21.117999 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae1ba9-4457-4c36-ad95-c6fa9a15b76e None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:21.120115 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3566536-79ed-40ef-8b8e-87e06cdf8203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-d3566536-79ed-40ef-8b8e-87e06cdf8203 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:21.125596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:21.126458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:21.129891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:21.129891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:21.129891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:21.129891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:21.129891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:21.129891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:21.129891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:21.129891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:21.129891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:21.129891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:21.129891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:21.129891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:21.129891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 39/80] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:21.129891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3566536-79ed-40ef-8b8e-87e06cdf8203 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:21.152335 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f03c4-cde9-4e80-9ebc-2e0c24fa8e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:21.152971 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f03c4-cde9-4e80-9ebc-2e0c24fa8e2f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:21.153296 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f03c4-cde9-4e80-9ebc-2e0c24fa8e2f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:21.153585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f03c4-cde9-4e80-9ebc-2e0c24fa8e2f None admin] PATH_INFO: `/v3/users/d9cceada370c47109408165adf5fe287` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:21.154724 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f03c4-cde9-4e80-9ebc-2e0c24fa8e2f None admin] RBAC: Authorizing `identity:get_user(user_id=d9cceada370c47109408165adf5fe287)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:21.156170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f03c4-cde9-4e80-9ebc-2e0c24fa8e2f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:21.157781 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 42/81] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:21 2022] GET /identity/v3/users/d9cceada370c47109408165adf5fe287 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:21.158548 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f03c4-cde9-4e80-9ebc-2e0c24fa8e2f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:21.167899 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:21.173417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:21.233821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3566536-79ed-40ef-8b8e-87e06cdf8203 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:21.257691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f03c4-cde9-4e80-9ebc-2e0c24fa8e2f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:21.267271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cac158-f941-4d85-ab7a-8f74525970a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:21.267883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cac158-f941-4d85-ab7a-8f74525970a9 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:21.268170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cac158-f941-4d85-ab7a-8f74525970a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:21.268448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cac158-f941-4d85-ab7a-8f74525970a9 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:21.269125 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cac158-f941-4d85-ab7a-8f74525970a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:21.270577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cac158-f941-4d85-ab7a-8f74525970a9 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:21.291030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 40/82] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:38:21 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:38:21.291896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc8c50-2ab4-49ce-b46a-50c06cf9b71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:21.292042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cac158-f941-4d85-ab7a-8f74525970a9 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:21.292898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc8c50-2ab4-49ce-b46a-50c06cf9b71a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:21.293407 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc8c50-2ab4-49ce-b46a-50c06cf9b71a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:21.293851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc8c50-2ab4-49ce-b46a-50c06cf9b71a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:21.373609 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc8c50-2ab4-49ce-b46a-50c06cf9b71a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:21.375202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc8c50-2ab4-49ce-b46a-50c06cf9b71a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:21.392067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:21.402390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:21.415052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cac158-f941-4d85-ab7a-8f74525970a9 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:21.459522 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c3152-b99e-47dd-bb9f-93a5ae4bedc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:21.459945 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c3152-b99e-47dd-bb9f-93a5ae4bedc5 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:21.460236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c3152-b99e-47dd-bb9f-93a5ae4bedc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:21.460519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c3152-b99e-47dd-bb9f-93a5ae4bedc5 None admin] PATH_INFO: `/v3/users/75c78ba256b046a890982a91574c5ec6` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:21.462599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c3152-b99e-47dd-bb9f-93a5ae4bedc5 None admin] RBAC: Authorizing `identity:get_user(user_id=75c78ba256b046a890982a91574c5ec6)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:21.464326 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c3152-b99e-47dd-bb9f-93a5ae4bedc5 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:21.465959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 41/83] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:21 2022] GET /identity/v3/users/75c78ba256b046a890982a91574c5ec6 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:21.470365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c3152-b99e-47dd-bb9f-93a5ae4bedc5 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:21.499961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 43/84] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:21.500749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc8c50-2ab4-49ce-b46a-50c06cf9b71a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:21.600421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c3152-b99e-47dd-bb9f-93a5ae4bedc5 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:21.644674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc8c50-2ab4-49ce-b46a-50c06cf9b71a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:21.651877 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3181c-e419-4b55-bc38-8331429f9bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:21.652508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3181c-e419-4b55-bc38-8331429f9bd6 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:21.652799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3181c-e419-4b55-bc38-8331429f9bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:21.653123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3181c-e419-4b55-bc38-8331429f9bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:21.653808 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3181c-e419-4b55-bc38-8331429f9bd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:21.654120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3181c-e419-4b55-bc38-8331429f9bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:21.656628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3181c-e419-4b55-bc38-8331429f9bd6 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:21.662620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:21.671338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 42/85] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:21.672200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3181c-e419-4b55-bc38-8331429f9bd6 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:21.700325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294ea47-3ba6-4372-9fa6-fd22a1c5914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:21.700983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294ea47-3ba6-4372-9fa6-fd22a1c5914a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:21.701338 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294ea47-3ba6-4372-9fa6-fd22a1c5914a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:21.701655 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294ea47-3ba6-4372-9fa6-fd22a1c5914a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:21.705236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:21.796945 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3181c-e419-4b55-bc38-8331429f9bd6 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:21.799205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294ea47-3ba6-4372-9fa6-fd22a1c5914a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:21.801599 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294ea47-3ba6-4372-9fa6-fd22a1c5914a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:21.834500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73cef2-a679-4a8b-8aeb-aa267c0b9288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:21.835472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73cef2-a679-4a8b-8aeb-aa267c0b9288 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:21.835954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73cef2-a679-4a8b-8aeb-aa267c0b9288 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:21.836442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73cef2-a679-4a8b-8aeb-aa267c0b9288 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:21.926177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73cef2-a679-4a8b-8aeb-aa267c0b9288 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:21.927684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73cef2-a679-4a8b-8aeb-aa267c0b9288 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:21.928445 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 44/86] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:21.929594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294ea47-3ba6-4372-9fa6-fd22a1c5914a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:21.947707 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:22.021415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:22.035822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294ea47-3ba6-4372-9fa6-fd22a1c5914a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:22.040137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 43/87] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:22.041420 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73cef2-a679-4a8b-8aeb-aa267c0b9288 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:22.071209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d4c0e-ccec-41a6-b28c-3797dc98d9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:22.071775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d4c0e-ccec-41a6-b28c-3797dc98d9b4 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:22.072062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d4c0e-ccec-41a6-b28c-3797dc98d9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:22.072345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d4c0e-ccec-41a6-b28c-3797dc98d9b4 None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:22.073514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d4c0e-ccec-41a6-b28c-3797dc98d9b4 None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:22.074961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d4c0e-ccec-41a6-b28c-3797dc98d9b4 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:22.081909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 45/88] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:21 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:22.081909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d4c0e-ccec-41a6-b28c-3797dc98d9b4 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:22.156101 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73cef2-a679-4a8b-8aeb-aa267c0b9288 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:22.159703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:22.184443 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:22.185761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d4c0e-ccec-41a6-b28c-3797dc98d9b4 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:22.198016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9b84c-2f05-40b2-977a-2d7f3412ed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:22.199050 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9b84c-2f05-40b2-977a-2d7f3412ed9c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:22.199351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9b84c-2f05-40b2-977a-2d7f3412ed9c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:22.199635 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9b84c-2f05-40b2-977a-2d7f3412ed9c None admin] PATH_INFO: `/v3/users/75c78ba256b046a890982a91574c5ec6` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:22.201062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9b84c-2f05-40b2-977a-2d7f3412ed9c None admin] RBAC: Authorizing `identity:get_user(user_id=75c78ba256b046a890982a91574c5ec6)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:22.203359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9b84c-2f05-40b2-977a-2d7f3412ed9c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:22.206028 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 44/89] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:22 2022] GET /identity/v3/users/75c78ba256b046a890982a91574c5ec6 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:22.206813 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9b84c-2f05-40b2-977a-2d7f3412ed9c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:22.227358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996b9d8-b53d-4dcc-9a8b-ead4b621135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:22.228120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996b9d8-b53d-4dcc-9a8b-ead4b621135f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:22.228501 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996b9d8-b53d-4dcc-9a8b-ead4b621135f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:22.228882 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996b9d8-b53d-4dcc-9a8b-ead4b621135f None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:22.230356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996b9d8-b53d-4dcc-9a8b-ead4b621135f None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:22.232056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996b9d8-b53d-4dcc-9a8b-ead4b621135f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:22.239459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 46/90] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:22 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:22.239459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996b9d8-b53d-4dcc-9a8b-ead4b621135f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:22.325306 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9b84c-2f05-40b2-977a-2d7f3412ed9c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:22.362442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19f006-2f01-4c8c-8cec-81b7b51161e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:22.363207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19f006-2f01-4c8c-8cec-81b7b51161e8 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:22.363501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19f006-2f01-4c8c-8cec-81b7b51161e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:22.363781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19f006-2f01-4c8c-8cec-81b7b51161e8 None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:22.365642 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19f006-2f01-4c8c-8cec-81b7b51161e8 None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:22.367287 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19f006-2f01-4c8c-8cec-81b7b51161e8 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:22.369621 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 45/91] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:22 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:22.370698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19f006-2f01-4c8c-8cec-81b7b51161e8 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:22.374962 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996b9d8-b53d-4dcc-9a8b-ead4b621135f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:22.419701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e514e3-e48d-4f02-9183-ada453964ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:22.420471 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e514e3-e48d-4f02-9183-ada453964ed4 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:22.421549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e514e3-e48d-4f02-9183-ada453964ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:22.421835 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e514e3-e48d-4f02-9183-ada453964ed4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:22.422676 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e514e3-e48d-4f02-9183-ada453964ed4 None admin] RBAC: Adding query filter params (role.id=6a5e7cb9300845e4b60b696aa66f4219, scope.project.id=599592d0cae949b8a93e951a0a615729, user.id=75c78ba256b046a890982a91574c5ec6) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:22.422992 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e514e3-e48d-4f02-9183-ada453964ed4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:22.424444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e514e3-e48d-4f02-9183-ada453964ed4 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:22.430605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 47/92] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:22 2022] GET /identity/v3/role_assignments?user.id=75c78ba256b046a890982a91574c5ec6&scope.project.id=599592d0cae949b8a93e951a0a615729&role.id=6a5e7cb9300845e4b60b696aa66f4219 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:22.431522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e514e3-e48d-4f02-9183-ada453964ed4 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:22.438805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:22.451388 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:22.489332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19f006-2f01-4c8c-8cec-81b7b51161e8 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:22.530686 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722f198-1a38-43e3-9632-62e76239567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:22.531612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722f198-1a38-43e3-9632-62e76239567f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:22.532123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722f198-1a38-43e3-9632-62e76239567f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:22.532579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722f198-1a38-43e3-9632-62e76239567f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:22.575888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e514e3-e48d-4f02-9183-ada453964ed4 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:22.614153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722f198-1a38-43e3-9632-62e76239567f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:22.615900 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722f198-1a38-43e3-9632-62e76239567f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:22.645805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf256b0-db59-4d1b-9c6a-5806c23138c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:22.645805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf256b0-db59-4d1b-9c6a-5806c23138c6 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:22.646134 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf256b0-db59-4d1b-9c6a-5806c23138c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:22.646419 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf256b0-db59-4d1b-9c6a-5806c23138c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:22.647430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf256b0-db59-4d1b-9c6a-5806c23138c6 None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=599592d0cae949b8a93e951a0a615729, user.id=d9cceada370c47109408165adf5fe287) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:22.647749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf256b0-db59-4d1b-9c6a-5806c23138c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:22.649408 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf256b0-db59-4d1b-9c6a-5806c23138c6 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:22.662933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 48/93] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:22 2022] GET /identity/v3/role_assignments?user.id=d9cceada370c47109408165adf5fe287&scope.project.id=599592d0cae949b8a93e951a0a615729&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:22.663778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf256b0-db59-4d1b-9c6a-5806c23138c6 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:22.705365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:22.818612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:22.819590 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 46/94] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:22.825834 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722f198-1a38-43e3-9632-62e76239567f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:22.853574 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf256b0-db59-4d1b-9c6a-5806c23138c6 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:22.918296 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa4de0-309a-4d26-810f-eeb696f0e1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:22.918924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa4de0-309a-4d26-810f-eeb696f0e1a0 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:22.919211 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa4de0-309a-4d26-810f-eeb696f0e1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:22.919489 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa4de0-309a-4d26-810f-eeb696f0e1a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:22.920239 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa4de0-309a-4d26-810f-eeb696f0e1a0 None admin] RBAC: Adding query filter params (role.id=222316862a15450198a3b454c14558c4, scope.project.id=599592d0cae949b8a93e951a0a615729, user.id=75c78ba256b046a890982a91574c5ec6) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:22.920584 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa4de0-309a-4d26-810f-eeb696f0e1a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:22.922102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa4de0-309a-4d26-810f-eeb696f0e1a0 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:22.933901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 49/95] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:22 2022] GET /identity/v3/role_assignments?user.id=75c78ba256b046a890982a91574c5ec6&scope.project.id=599592d0cae949b8a93e951a0a615729&role.id=222316862a15450198a3b454c14558c4 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:23.032817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722f198-1a38-43e3-9632-62e76239567f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:23.083137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0666bfc-fa1f-4d47-8b6a-052e03e5ecad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:23.084144 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0666bfc-fa1f-4d47-8b6a-052e03e5ecad None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:23.084672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0666bfc-fa1f-4d47-8b6a-052e03e5ecad None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:23.085180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0666bfc-fa1f-4d47-8b6a-052e03e5ecad None admin] PATH_INFO: `/v3/projects/0db2e465141047bfb6d5e829fef8599c` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:23.086585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0666bfc-fa1f-4d47-8b6a-052e03e5ecad None admin] RBAC: Authorizing `identity:get_project(project_id=0db2e465141047bfb6d5e829fef8599c)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:23.088566 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0666bfc-fa1f-4d47-8b6a-052e03e5ecad None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:23.090956 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 47/96] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:22 2022] GET /identity/v3/projects/0db2e465141047bfb6d5e829fef8599c => generated 312 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:23.097272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa4de0-309a-4d26-810f-eeb696f0e1a0 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:23.263439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa4de0-309a-4d26-810f-eeb696f0e1a0 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:23.304613 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3205d-6eee-4b58-b5fd-c89ad0ba910e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:23.305284 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3205d-6eee-4b58-b5fd-c89ad0ba910e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:23.305568 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3205d-6eee-4b58-b5fd-c89ad0ba910e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:23.305843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3205d-6eee-4b58-b5fd-c89ad0ba910e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:23.306579 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3205d-6eee-4b58-b5fd-c89ad0ba910e None admin] RBAC: Adding query filter params (role.id=6a5e7cb9300845e4b60b696aa66f4219, scope.project.id=0db2e465141047bfb6d5e829fef8599c, user.id=75c78ba256b046a890982a91574c5ec6) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:23.306888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3205d-6eee-4b58-b5fd-c89ad0ba910e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:23.308326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3205d-6eee-4b58-b5fd-c89ad0ba910e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:23.314730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 50/97] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:23 2022] GET /identity/v3/role_assignments?user.id=75c78ba256b046a890982a91574c5ec6&scope.project.id=0db2e465141047bfb6d5e829fef8599c&role.id=6a5e7cb9300845e4b60b696aa66f4219 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:23.678510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9fdd9-4e64-4bf4-a813-93ec33ef1ce2 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:23.679170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9fdd9-4e64-4bf4-a813-93ec33ef1ce2 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:23.679662 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9fdd9-4e64-4bf4-a813-93ec33ef1ce2 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:23.681253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 48/98] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:23.687564 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58d141-86ba-4b51-999b-69934a161db9 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:23.687888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58d141-86ba-4b51-999b-69934a161db9 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:23.688138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58d141-86ba-4b51-999b-69934a161db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:23.696396 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:23.714255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-8c58d141-86ba-4b51-999b-69934a161db9 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:23.715473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-8c58d141-86ba-4b51-999b-69934a161db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:23.799327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 51/99] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:23.930044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f83027-9120-4c46-a4f5-98e4564de68a None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:23.931013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f83027-9120-4c46-a4f5-98e4564de68a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:23.931502 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f83027-9120-4c46-a4f5-98e4564de68a None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:23.933092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 49/100] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:23.938548 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ea3a-c50c-4b8c-b546-642e7b99074c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:23.939433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ea3a-c50c-4b8c-b546-642e7b99074c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:23.939918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ea3a-c50c-4b8c-b546-642e7b99074c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:23.961041 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-b244ea3a-c50c-4b8c-b546-642e7b99074c None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:23.962558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b244ea3a-c50c-4b8c-b546-642e7b99074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:24.042062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 52/101] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:24.328509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f83027-9120-4c46-a4f5-98e4564de68a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:24.357559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:24.433816 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f83027-9120-4c46-a4f5-98e4564de68a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:24.478965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837e55c-bd34-4852-bae5-45cade97468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:24.479601 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837e55c-bd34-4852-bae5-45cade97468c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:24.479888 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837e55c-bd34-4852-bae5-45cade97468c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:24.480165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837e55c-bd34-4852-bae5-45cade97468c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:24.494980 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837e55c-bd34-4852-bae5-45cade97468c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-9837e55c-bd34-4852-bae5-45cade97468c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:24.499770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:24.500631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:24.501421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:24.501421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:24.501421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:24.501421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:24.501421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:24.501421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:24.501421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:24.501421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:24.501421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:24.501421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:24.501421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:24.501421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:24.501421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 50/102] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:24.508328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ea3a-c50c-4b8c-b546-642e7b99074c None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:24.593457 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837e55c-bd34-4852-bae5-45cade97468c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:24.614015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:24.690378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ea3a-c50c-4b8c-b546-642e7b99074c None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:24.742136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:24.764119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837e55c-bd34-4852-bae5-45cade97468c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:24.789225 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f616bf1-f8c3-4edc-9943-479ff8f9c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:24.790232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f616bf1-f8c3-4edc-9943-479ff8f9c0d3 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:24.790717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f616bf1-f8c3-4edc-9943-479ff8f9c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:24.791217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f616bf1-f8c3-4edc-9943-479ff8f9c0d3 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:24.792086 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f616bf1-f8c3-4edc-9943-479ff8f9c0d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:24.792589 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f616bf1-f8c3-4edc-9943-479ff8f9c0d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:24.794191 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f616bf1-f8c3-4edc-9943-479ff8f9c0d3 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:24.806346 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 53/103] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:24.811899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f616bf1-f8c3-4edc-9943-479ff8f9c0d3 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:24.821993 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dae28-d500-4384-8223-65667efde10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:24.822831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dae28-d500-4384-8223-65667efde10e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:24.823262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dae28-d500-4384-8223-65667efde10e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:24.823685 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dae28-d500-4384-8223-65667efde10e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:24.825006 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2dae28-d500-4384-8223-65667efde10e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:24.826697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2dae28-d500-4384-8223-65667efde10e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:24.828459 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 51/104] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:24.834073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dae28-d500-4384-8223-65667efde10e None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:25.025967 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f616bf1-f8c3-4edc-9943-479ff8f9c0d3 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:25.039333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dae28-d500-4384-8223-65667efde10e None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:25.081356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:25.096448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb6157-ce0b-4151-b2df-86f928809dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:25.097371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb6157-ce0b-4151-b2df-86f928809dda None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:25.097861 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb6157-ce0b-4151-b2df-86f928809dda None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:25.098313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb6157-ce0b-4151-b2df-86f928809dda None admin] PATH_INFO: `/v3/users/dd65b889e9044ca188743cc21298a1ed` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:25.111346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9807d5-1aa9-4925-b368-0c7bccae7264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:25.112221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9807d5-1aa9-4925-b368-0c7bccae7264 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:25.112653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9807d5-1aa9-4925-b368-0c7bccae7264 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:25.113097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9807d5-1aa9-4925-b368-0c7bccae7264 None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:25.113926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9807d5-1aa9-4925-b368-0c7bccae7264 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:25.115547 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9807d5-1aa9-4925-b368-0c7bccae7264 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:25.128385 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb6157-ce0b-4151-b2df-86f928809dda None admin] RBAC: Authorizing `identity:get_user(user_id=dd65b889e9044ca188743cc21298a1ed)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:25.130157 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb6157-ce0b-4151-b2df-86f928809dda None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:25.132458 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 54/105] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:24 2022] GET /identity/v3/users/dd65b889e9044ca188743cc21298a1ed => generated 289 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:25.138377 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb6157-ce0b-4151-b2df-86f928809dda None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:25.167915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 52/106] 10.222.0.76 () {60 vars in 1141 bytes} [Fri Aug 26 08:38:24 2022] POST /identity/v3/projects => generated 302 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:38:25.293351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851ccc7-3307-4ce7-aaa8-4b0a18984193 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:25.293857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851ccc7-3307-4ce7-aaa8-4b0a18984193 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:25.294287 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851ccc7-3307-4ce7-aaa8-4b0a18984193 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:25.297072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 53/107] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:25.303157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163f272-160e-4edd-b82f-ba23c203bcec None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:25.303729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163f272-160e-4edd-b82f-ba23c203bcec None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:25.304214 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163f272-160e-4edd-b82f-ba23c203bcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:25.317107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb6157-ce0b-4151-b2df-86f928809dda None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:25.328418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:25.336240 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-6163f272-160e-4edd-b82f-ba23c203bcec None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:25.337942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6163f272-160e-4edd-b82f-ba23c203bcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:25.400492 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0cb60-6567-45c0-b077-2e5f7567d425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:25.401142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0cb60-6567-45c0-b077-2e5f7567d425 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:25.401432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0cb60-6567-45c0-b077-2e5f7567d425 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:25.401709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0cb60-6567-45c0-b077-2e5f7567d425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:25.415023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 54/108] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:25.417165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab88e8-63a2-453c-a132-6b4cf8b2a5be None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:25.417660 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab88e8-63a2-453c-a132-6b4cf8b2a5be None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:25.418322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab88e8-63a2-453c-a132-6b4cf8b2a5be None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:25.420093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 55/109] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:25.426071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dccb6-6dc4-4759-839b-f8b49b9b9831 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:25.426601 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dccb6-6dc4-4759-839b-f8b49b9b9831 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:25.427077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dccb6-6dc4-4759-839b-f8b49b9b9831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:25.465690 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-e37dccb6-6dc4-4759-839b-f8b49b9b9831 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:25.466918 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e37dccb6-6dc4-4759-839b-f8b49b9b9831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:25.497408 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:25.502689 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0cb60-6567-45c0-b077-2e5f7567d425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:25.504298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0cb60-6567-45c0-b077-2e5f7567d425 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:25.599329 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 56/110] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:25.674163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 55/111] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:25.680047 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dccb6-6dc4-4759-839b-f8b49b9b9831 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:25.743109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0cb60-6567-45c0-b077-2e5f7567d425 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:25.829429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:25.896867 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dccb6-6dc4-4759-839b-f8b49b9b9831 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:25.918371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:25.952799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0cb60-6567-45c0-b077-2e5f7567d425 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:25.960248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82c4f2-1d41-4939-802e-3c721ef0b8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:25.960901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82c4f2-1d41-4939-802e-3c721ef0b8d3 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:25.961215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82c4f2-1d41-4939-802e-3c721ef0b8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:25.961499 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82c4f2-1d41-4939-802e-3c721ef0b8d3 None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:25.962745 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82c4f2-1d41-4939-802e-3c721ef0b8d3 None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:25.964575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82c4f2-1d41-4939-802e-3c721ef0b8d3 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:25.966748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 57/112] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:25 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:25.972419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b957fae-5dfe-42c8-8afa-eac2958cfc9e None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:25.972419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b957fae-5dfe-42c8-8afa-eac2958cfc9e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:25.972419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b957fae-5dfe-42c8-8afa-eac2958cfc9e None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:25.972419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 58/113] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:25.972419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b957fae-5dfe-42c8-8afa-eac2958cfc9e None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:26.003609 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338492f-f1f8-4819-8cdb-97acf6b8f1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:26.004824 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338492f-f1f8-4819-8cdb-97acf6b8f1a1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:26.005743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338492f-f1f8-4819-8cdb-97acf6b8f1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:26.006482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338492f-f1f8-4819-8cdb-97acf6b8f1a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:26.020110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338492f-f1f8-4819-8cdb-97acf6b8f1a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-c338492f-f1f8-4819-8cdb-97acf6b8f1a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:26.027163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:26.028633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:26.029507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:26.029507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:26.029507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:26.029507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:26.029507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:26.029507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:26.029507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:26.029507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:26.029507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:26.029507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:26.029507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:26.029507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:26.036402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 56/114] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:38:26.036402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338492f-f1f8-4819-8cdb-97acf6b8f1a1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:26.090641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b957fae-5dfe-42c8-8afa-eac2958cfc9e None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:26.128772 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80e1e4-0813-4a75-bb73-86ae73ac601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:26.129452 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80e1e4-0813-4a75-bb73-86ae73ac601d None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:26.129739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80e1e4-0813-4a75-bb73-86ae73ac601d None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:26.130030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80e1e4-0813-4a75-bb73-86ae73ac601d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:26.132889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:26.146158 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80e1e4-0813-4a75-bb73-86ae73ac601d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-7a80e1e4-0813-4a75-bb73-86ae73ac601d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:26.151739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:26.152585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:26.153396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:26.153396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:26.153396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:26.153396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:26.153396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:26.153396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:26.153396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:26.153396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:26.153396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:26.153396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:26.153396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:26.153396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:26.153396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 59/115] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:38:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:26.154024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaeecfe-3829-4f81-aec3-ad9c82a3fa24 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:26.159421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaeecfe-3829-4f81-aec3-ad9c82a3fa24 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:26.159421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaeecfe-3829-4f81-aec3-ad9c82a3fa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:26.176569 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338492f-f1f8-4819-8cdb-97acf6b8f1a1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:26.176780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-2aaeecfe-3829-4f81-aec3-ad9c82a3fa24 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:26.178749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-2aaeecfe-3829-4f81-aec3-ad9c82a3fa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:26.237987 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e98b26-092a-4cf4-b928-e46ef7b3684e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:26.238965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e98b26-092a-4cf4-b928-e46ef7b3684e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:26.239407 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e98b26-092a-4cf4-b928-e46ef7b3684e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:26.239879 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e98b26-092a-4cf4-b928-e46ef7b3684e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:26.241168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e98b26-092a-4cf4-b928-e46ef7b3684e None admin] RBAC: Adding query filter params (role.id=2837b7fc2f2d4636bbdb0b4b8ccba069, scope.project.id=599592d0cae949b8a93e951a0a615729, user.id=dd65b889e9044ca188743cc21298a1ed) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:26.241695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e98b26-092a-4cf4-b928-e46ef7b3684e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:26.244279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e98b26-092a-4cf4-b928-e46ef7b3684e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:26.254080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 57/116] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:26 2022] GET /identity/v3/role_assignments?user.id=dd65b889e9044ca188743cc21298a1ed&scope.project.id=599592d0cae949b8a93e951a0a615729&role.id=2837b7fc2f2d4636bbdb0b4b8ccba069 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:26.255462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e98b26-092a-4cf4-b928-e46ef7b3684e None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:26.274789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:26.305833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 60/117] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:26.307300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaeecfe-3829-4f81-aec3-ad9c82a3fa24 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:26.448250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e98b26-092a-4cf4-b928-e46ef7b3684e None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:26.513428 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaeecfe-3829-4f81-aec3-ad9c82a3fa24 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:26.526209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf63a97-129f-4955-8484-40f8548bdb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:26.526831 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf63a97-129f-4955-8484-40f8548bdb5d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:26.527117 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf63a97-129f-4955-8484-40f8548bdb5d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:26.527399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf63a97-129f-4955-8484-40f8548bdb5d None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:26.528078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf63a97-129f-4955-8484-40f8548bdb5d None admin] RBAC: Adding query filter params (name=member) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:26.528391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf63a97-129f-4955-8484-40f8548bdb5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:26.532059 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf63a97-129f-4955-8484-40f8548bdb5d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:26.554906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 58/118] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:26.559518 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea91e8-b27d-4e06-b296-7c8ea987c1de None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:26.559825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea91e8-b27d-4e06-b296-7c8ea987c1de None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:26.560175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea91e8-b27d-4e06-b296-7c8ea987c1de None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:26.561818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 59/119] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:26.562925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea91e8-b27d-4e06-b296-7c8ea987c1de None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:26.569680 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:26.614245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6880f6d-36be-42b8-b440-f9a9487add98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:26.614968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6880f6d-36be-42b8-b440-f9a9487add98 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:26.615258 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6880f6d-36be-42b8-b440-f9a9487add98 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:26.615534 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6880f6d-36be-42b8-b440-f9a9487add98 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:26.616212 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6880f6d-36be-42b8-b440-f9a9487add98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:26.616517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6880f6d-36be-42b8-b440-f9a9487add98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:26.617950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6880f6d-36be-42b8-b440-f9a9487add98 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:26.628411 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 61/120] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:26.629424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7ae42-9370-432f-9045-50be1b797146 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:26.629716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7ae42-9370-432f-9045-50be1b797146 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:26.629990 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7ae42-9370-432f-9045-50be1b797146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:26.657121 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-27b7ae42-9370-432f-9045-50be1b797146 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:26.658638 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-27b7ae42-9370-432f-9045-50be1b797146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:26.677514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:26.714592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea91e8-b27d-4e06-b296-7c8ea987c1de None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:26.745122 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 62/121] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:26.746112 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7ae42-9370-432f-9045-50be1b797146 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:26.762248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30800746-4a12-4533-8ff6-5330e2096ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:26.763148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30800746-4a12-4533-8ff6-5330e2096ab6 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:26.763919 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30800746-4a12-4533-8ff6-5330e2096ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:26.764285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30800746-4a12-4533-8ff6-5330e2096ab6 None admin] PATH_INFO: `/v3/users/75c78ba256b046a890982a91574c5ec6` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:26.766128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30800746-4a12-4533-8ff6-5330e2096ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=75c78ba256b046a890982a91574c5ec6)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:26.768384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30800746-4a12-4533-8ff6-5330e2096ab6 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:26.770821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 60/122] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:26 2022] GET /identity/v3/users/75c78ba256b046a890982a91574c5ec6 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:26.771821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30800746-4a12-4533-8ff6-5330e2096ab6 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:26.859857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7ae42-9370-432f-9045-50be1b797146 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:26.879122 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:26.898460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2524c3-8206-45a6-8e68-30ad216d3b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:26.899104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2524c3-8206-45a6-8e68-30ad216d3b35 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:26.899398 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2524c3-8206-45a6-8e68-30ad216d3b35 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:26.899680 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2524c3-8206-45a6-8e68-30ad216d3b35 None admin] PATH_INFO: `/v3/users/d9cceada370c47109408165adf5fe287` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:26.900824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2524c3-8206-45a6-8e68-30ad216d3b35 None admin] RBAC: Authorizing `identity:get_user(user_id=d9cceada370c47109408165adf5fe287)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:26.902575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2524c3-8206-45a6-8e68-30ad216d3b35 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:26.905183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 63/123] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:26 2022] GET /identity/v3/users/d9cceada370c47109408165adf5fe287 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:26.905962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2524c3-8206-45a6-8e68-30ad216d3b35 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:26.969095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30800746-4a12-4533-8ff6-5330e2096ab6 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:27.033580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b985c-6893-41e2-9739-68fc31fb1f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:27.034209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b985c-6893-41e2-9739-68fc31fb1f7a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:27.034495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b985c-6893-41e2-9739-68fc31fb1f7a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:27.034781 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b985c-6893-41e2-9739-68fc31fb1f7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:27.047753 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:27.054750 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b985c-6893-41e2-9739-68fc31fb1f7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-7a3b985c-6893-41e2-9739-68fc31fb1f7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:27.059482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:27.060312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:27.061164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:27.061164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:27.061164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:27.061164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:27.061164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:27.061164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:27.061164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:27.061164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:27.061164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:27.061164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:27.061164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:27.061164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:27.064597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 61/124] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:38:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:27.068892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b985c-6893-41e2-9739-68fc31fb1f7a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:27.093872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2524c3-8206-45a6-8e68-30ad216d3b35 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:27.141090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d679f5-30e7-4bc3-bc2a-1df9b8fcb048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:27.141090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d679f5-30e7-4bc3-bc2a-1df9b8fcb048 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:27.141090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d679f5-30e7-4bc3-bc2a-1df9b8fcb048 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:27.141090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d679f5-30e7-4bc3-bc2a-1df9b8fcb048 None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:27.141642 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d679f5-30e7-4bc3-bc2a-1df9b8fcb048 None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:27.143067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d679f5-30e7-4bc3-bc2a-1df9b8fcb048 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:27.144884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 64/125] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:26 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:27.146092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d679f5-30e7-4bc3-bc2a-1df9b8fcb048 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:27.199170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b985c-6893-41e2-9739-68fc31fb1f7a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:27.222928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:27.249588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f548f4c-7f54-496c-8469-86f7c0d7117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:27.250469 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f548f4c-7f54-496c-8469-86f7c0d7117c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:27.250925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f548f4c-7f54-496c-8469-86f7c0d7117c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:27.251352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f548f4c-7f54-496c-8469-86f7c0d7117c None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:27.253312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f548f4c-7f54-496c-8469-86f7c0d7117c None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:27.255451 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f548f4c-7f54-496c-8469-86f7c0d7117c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:27.257688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 62/126] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:27 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:27.259015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f548f4c-7f54-496c-8469-86f7c0d7117c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:27.288634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d679f5-30e7-4bc3-bc2a-1df9b8fcb048 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:27.333026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703a4ff-8231-40ba-835c-7e41b0590a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:27.334019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703a4ff-8231-40ba-835c-7e41b0590a8b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:27.334316 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703a4ff-8231-40ba-835c-7e41b0590a8b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:27.334599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703a4ff-8231-40ba-835c-7e41b0590a8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:27.346155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:27.349238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703a4ff-8231-40ba-835c-7e41b0590a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-9703a4ff-8231-40ba-835c-7e41b0590a8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:27.355604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:27.356513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:27.358162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:27.358162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:27.358162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:27.358162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:27.358162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:27.358162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:27.358162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:27.358162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:27.358162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:27.358162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:27.358162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:27.358162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:27.358162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 65/127] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:27.358162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703a4ff-8231-40ba-835c-7e41b0590a8b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:27.396983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f548f4c-7f54-496c-8469-86f7c0d7117c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:27.437873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dea98-8cc7-4d03-8add-b49118419f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:27.438923 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dea98-8cc7-4d03-8add-b49118419f45 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:27.439412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dea98-8cc7-4d03-8add-b49118419f45 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:27.439936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dea98-8cc7-4d03-8add-b49118419f45 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:27.440803 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dea98-8cc7-4d03-8add-b49118419f45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:27.441334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dea98-8cc7-4d03-8add-b49118419f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:27.443046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dea98-8cc7-4d03-8add-b49118419f45 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:27.453063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 63/128] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:38:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:27.458843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dea98-8cc7-4d03-8add-b49118419f45 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:27.481133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703a4ff-8231-40ba-835c-7e41b0590a8b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:27.499759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:27.528620 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf12594-ebde-43b9-a258-3ad2dec3b702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:27.529615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf12594-ebde-43b9-a258-3ad2dec3b702 None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:27.530469 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf12594-ebde-43b9-a258-3ad2dec3b702 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:27.530754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf12594-ebde-43b9-a258-3ad2dec3b702 None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729/users/75c78ba256b046a890982a91574c5ec6/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:27.532727 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf12594-ebde-43b9-a258-3ad2dec3b702 None admin] RBAC: Authorizing `identity:create_grant(project_id=599592d0cae949b8a93e951a0a615729, user_id=75c78ba256b046a890982a91574c5ec6, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:27.534415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf12594-ebde-43b9-a258-3ad2dec3b702 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:27.557243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 66/129] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:38:27 2022] PUT /identity/v3/projects/599592d0cae949b8a93e951a0a615729/users/75c78ba256b046a890982a91574c5ec6/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:38:27.557243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf12594-ebde-43b9-a258-3ad2dec3b702 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:27.631224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dea98-8cc7-4d03-8add-b49118419f45 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:27.693198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:27.694966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf12594-ebde-43b9-a258-3ad2dec3b702 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:27.712019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7239c-633a-4444-aa36-922b42cff219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:27.712709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7239c-633a-4444-aa36-922b42cff219 None admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:27.713068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7239c-633a-4444-aa36-922b42cff219 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:27.713627 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7239c-633a-4444-aa36-922b42cff219 None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729/users/d9cceada370c47109408165adf5fe287/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:27.718784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7239c-633a-4444-aa36-922b42cff219 None admin] RBAC: Authorizing `identity:create_grant(project_id=599592d0cae949b8a93e951a0a615729, user_id=d9cceada370c47109408165adf5fe287, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:27.720325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7239c-633a-4444-aa36-922b42cff219 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:27.750361 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 64/130] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:38:27 2022] PUT /identity/v3/projects/599592d0cae949b8a93e951a0a615729/users/d9cceada370c47109408165adf5fe287/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:38:27.751136 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7239c-633a-4444-aa36-922b42cff219 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:27.769562 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc72260-e03c-4534-ac31-4ffcfc826498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:27.770245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc72260-e03c-4534-ac31-4ffcfc826498 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:27.770535 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc72260-e03c-4534-ac31-4ffcfc826498 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:27.770815 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc72260-e03c-4534-ac31-4ffcfc826498 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:27.771499 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc72260-e03c-4534-ac31-4ffcfc826498 None admin] RBAC: Adding query filter params (name=member) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:27.771809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc72260-e03c-4534-ac31-4ffcfc826498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:27.773309 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc72260-e03c-4534-ac31-4ffcfc826498 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:27.783046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 67/131] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:27.784332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c3d85-5b65-46b0-b53f-15c0f9b79d30 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:27.784622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c3d85-5b65-46b0-b53f-15c0f9b79d30 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:27.784901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c3d85-5b65-46b0-b53f-15c0f9b79d30 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:27.786354 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 68/132] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:27.791373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c3d85-5b65-46b0-b53f-15c0f9b79d30 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:27.833107 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:27.882294 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7239c-633a-4444-aa36-922b42cff219 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:27.911772 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c3d85-5b65-46b0-b53f-15c0f9b79d30 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:27.920910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d3dd7-d4b7-498a-9b58-41472f0a8cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:27.921605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d3dd7-d4b7-498a-9b58-41472f0a8cae None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:27.921893 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d3dd7-d4b7-498a-9b58-41472f0a8cae None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:27.922178 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d3dd7-d4b7-498a-9b58-41472f0a8cae None admin] PATH_INFO: `/v3/users/75c78ba256b046a890982a91574c5ec6` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:27.923471 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d3dd7-d4b7-498a-9b58-41472f0a8cae None admin] RBAC: Authorizing `identity:get_user(user_id=75c78ba256b046a890982a91574c5ec6)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:27.924979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d3dd7-d4b7-498a-9b58-41472f0a8cae None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:27.928024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 65/133] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:27 2022] GET /identity/v3/users/75c78ba256b046a890982a91574c5ec6 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:27.933560 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877dcb5-21be-4fda-8e0c-1ef3a2a2435b None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:27.933560 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877dcb5-21be-4fda-8e0c-1ef3a2a2435b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:27.933944 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877dcb5-21be-4fda-8e0c-1ef3a2a2435b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:27.959198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-2877dcb5-21be-4fda-8e0c-1ef3a2a2435b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:27.960425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-2877dcb5-21be-4fda-8e0c-1ef3a2a2435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:27.960597 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93d7fd-af64-4196-91c0-00c315ca8d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:27.961120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93d7fd-af64-4196-91c0-00c315ca8d67 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:27.961462 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93d7fd-af64-4196-91c0-00c315ca8d67 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:27.961741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93d7fd-af64-4196-91c0-00c315ca8d67 None admin] PATH_INFO: `/v3/users/75c78ba256b046a890982a91574c5ec6` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:27.963124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93d7fd-af64-4196-91c0-00c315ca8d67 None admin] RBAC: Authorizing `identity:get_user(user_id=75c78ba256b046a890982a91574c5ec6)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:27.966566 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93d7fd-af64-4196-91c0-00c315ca8d67 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:27.968258 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 69/134] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:27 2022] GET /identity/v3/users/75c78ba256b046a890982a91574c5ec6 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:27.969045 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93d7fd-af64-4196-91c0-00c315ca8d67 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:28.036518 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:28.056564 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 66/135] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:28.057468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877dcb5-21be-4fda-8e0c-1ef3a2a2435b None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:28.107007 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93d7fd-af64-4196-91c0-00c315ca8d67 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:28.109313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:28.166489 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877dcb5-21be-4fda-8e0c-1ef3a2a2435b None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:28.168486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47ac11-b2a1-44e7-8497-cd483091820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:28.169837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47ac11-b2a1-44e7-8497-cd483091820f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:28.169837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47ac11-b2a1-44e7-8497-cd483091820f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:28.169837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47ac11-b2a1-44e7-8497-cd483091820f None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:28.171669 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47ac11-b2a1-44e7-8497-cd483091820f None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:28.173162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47ac11-b2a1-44e7-8497-cd483091820f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:28.174867 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 70/136] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:27 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:28.197528 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47ac11-b2a1-44e7-8497-cd483091820f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:28.210157 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efbb97-781c-4948-8583-897e02d451e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:28.211338 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efbb97-781c-4948-8583-897e02d451e1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:28.211804 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efbb97-781c-4948-8583-897e02d451e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:28.212255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efbb97-781c-4948-8583-897e02d451e1 None admin] PATH_INFO: `/v3/projects/0db2e465141047bfb6d5e829fef8599c` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:28.213887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efbb97-781c-4948-8583-897e02d451e1 None admin] RBAC: Authorizing `identity:get_project(project_id=0db2e465141047bfb6d5e829fef8599c)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:28.215590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efbb97-781c-4948-8583-897e02d451e1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:28.217685 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 67/137] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:28 2022] GET /identity/v3/projects/0db2e465141047bfb6d5e829fef8599c => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:28.223621 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efbb97-781c-4948-8583-897e02d451e1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:28.330330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47ac11-b2a1-44e7-8497-cd483091820f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:28.353391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:28.368890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7843a-9eea-4fb4-b183-01faf0f38e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:28.369852 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7843a-9eea-4fb4-b183-01faf0f38e87 None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:28.370346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7843a-9eea-4fb4-b183-01faf0f38e87 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:28.370804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7843a-9eea-4fb4-b183-01faf0f38e87 None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729/users/75c78ba256b046a890982a91574c5ec6/roles/222316862a15450198a3b454c14558c4` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:28.373197 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7843a-9eea-4fb4-b183-01faf0f38e87 None admin] RBAC: Authorizing `identity:create_grant(project_id=599592d0cae949b8a93e951a0a615729, user_id=75c78ba256b046a890982a91574c5ec6, role_id=222316862a15450198a3b454c14558c4)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:28.374973 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7843a-9eea-4fb4-b183-01faf0f38e87 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:28.390766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 71/138] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:38:28 2022] PUT /identity/v3/projects/599592d0cae949b8a93e951a0a615729/users/75c78ba256b046a890982a91574c5ec6/roles/222316862a15450198a3b454c14558c4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:38:28.440825 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7843a-9eea-4fb4-b183-01faf0f38e87 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:28.443516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efbb97-781c-4948-8583-897e02d451e1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:28.486407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:28.497949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b874983-1614-4903-b974-cda6f492d5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:28.499051 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b874983-1614-4903-b974-cda6f492d5cf None admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:28.500484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b874983-1614-4903-b974-cda6f492d5cf None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:28.501555 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b874983-1614-4903-b974-cda6f492d5cf None admin] PATH_INFO: `/v3/projects/0db2e465141047bfb6d5e829fef8599c/users/75c78ba256b046a890982a91574c5ec6/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:28.508478 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b874983-1614-4903-b974-cda6f492d5cf None admin] RBAC: Authorizing `identity:create_grant(project_id=0db2e465141047bfb6d5e829fef8599c, user_id=75c78ba256b046a890982a91574c5ec6, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:28.510453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b874983-1614-4903-b974-cda6f492d5cf None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:28.540295 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 68/139] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:38:28 2022] PUT /identity/v3/projects/0db2e465141047bfb6d5e829fef8599c/users/75c78ba256b046a890982a91574c5ec6/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:38:28.542048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffa23a-bdbb-44f3-af62-df519f2df88b None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:28.542583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffa23a-bdbb-44f3-af62-df519f2df88b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:28.543054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffa23a-bdbb-44f3-af62-df519f2df88b None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:28.544796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 69/140] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:28.551432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fada4ed-e5a3-4da4-98de-fe0266bc04df None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:28.552048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fada4ed-e5a3-4da4-98de-fe0266bc04df None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:28.552530 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fada4ed-e5a3-4da4-98de-fe0266bc04df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:28.589329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-9fada4ed-e5a3-4da4-98de-fe0266bc04df None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:28.590874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-9fada4ed-e5a3-4da4-98de-fe0266bc04df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:28.625913 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7843a-9eea-4fb4-b183-01faf0f38e87 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:28.684277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d7784-46ee-4530-ab63-2c56118fcf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:28.685534 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d7784-46ee-4530-ab63-2c56118fcf11 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:28.687407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d7784-46ee-4530-ab63-2c56118fcf11 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:28.687911 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d7784-46ee-4530-ab63-2c56118fcf11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:28.691652 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d7784-46ee-4530-ab63-2c56118fcf11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:28.693542 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d7784-46ee-4530-ab63-2c56118fcf11 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:28.698437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 72/141] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:28.703884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d7784-46ee-4530-ab63-2c56118fcf11 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:28.714389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 70/142] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:28.851216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:28.855297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d7784-46ee-4530-ab63-2c56118fcf11 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:28.895377 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d1080-ab08-4ac5-a04e-4b85c7b80b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:28.896052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d1080-ab08-4ac5-a04e-4b85c7b80b23 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:28.896339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d1080-ab08-4ac5-a04e-4b85c7b80b23 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:28.896619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d1080-ab08-4ac5-a04e-4b85c7b80b23 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:28.897337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d1080-ab08-4ac5-a04e-4b85c7b80b23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:28.898857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d1080-ab08-4ac5-a04e-4b85c7b80b23 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:28.928520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 73/143] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:38:28 2022] POST /identity/v3/users => generated 283 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:38:29.076069 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fada4ed-e5a3-4da4-98de-fe0266bc04df None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:29.130696 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:29.202208 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fada4ed-e5a3-4da4-98de-fe0266bc04df None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:29.248159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89282075-3c9f-4350-a9f0-710c2fc2cf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:29.248849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89282075-3c9f-4350-a9f0-710c2fc2cf88 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:29.249170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89282075-3c9f-4350-a9f0-710c2fc2cf88 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:29.249454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89282075-3c9f-4350-a9f0-710c2fc2cf88 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:29.266381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89282075-3c9f-4350-a9f0-710c2fc2cf88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-89282075-3c9f-4350-a9f0-710c2fc2cf88 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:29.271253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:29.272106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:29.272888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:29.272888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:29.272888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:29.272888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:29.272888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:29.272888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:29.272888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:29.272888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:29.272888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:29.272888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:29.272888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:29.272888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:29.272888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 71/144] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:29.278384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d1080-ab08-4ac5-a04e-4b85c7b80b23 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:29.421726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d1080-ab08-4ac5-a04e-4b85c7b80b23 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:29.467176 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d8afd-a5ed-4bf1-b125-c5413872cc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:29.467796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d8afd-a5ed-4bf1-b125-c5413872cc25 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:29.468080 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d8afd-a5ed-4bf1-b125-c5413872cc25 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:29.468358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d8afd-a5ed-4bf1-b125-c5413872cc25 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:29.469052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d8afd-a5ed-4bf1-b125-c5413872cc25 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:29.469364 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d8afd-a5ed-4bf1-b125-c5413872cc25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:29.470743 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d8afd-a5ed-4bf1-b125-c5413872cc25 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:29.484333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 74/145] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:29.489874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89282075-3c9f-4350-a9f0-710c2fc2cf88 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:29.625400 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89282075-3c9f-4350-a9f0-710c2fc2cf88 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:29.631590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:29.679560 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f0d2d-de73-4ee7-be57-691eed08bb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:29.680120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f0d2d-de73-4ee7-be57-691eed08bb18 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:29.680405 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f0d2d-de73-4ee7-be57-691eed08bb18 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:29.680684 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f0d2d-de73-4ee7-be57-691eed08bb18 None admin] PATH_INFO: `/v3/users/dd65b889e9044ca188743cc21298a1ed` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:29.684982 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f0d2d-de73-4ee7-be57-691eed08bb18 None admin] RBAC: Authorizing `identity:get_user(user_id=dd65b889e9044ca188743cc21298a1ed)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:29.687229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f0d2d-de73-4ee7-be57-691eed08bb18 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:29.688983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 72/146] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:29 2022] GET /identity/v3/users/dd65b889e9044ca188743cc21298a1ed => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:29.694748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d8afd-a5ed-4bf1-b125-c5413872cc25 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:29.724709 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:29.846663 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d8afd-a5ed-4bf1-b125-c5413872cc25 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:29.891305 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3b7a0-acd9-4b49-92c1-887670bd96b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:29.891938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3b7a0-acd9-4b49-92c1-887670bd96b2 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:29.892220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3b7a0-acd9-4b49-92c1-887670bd96b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:29.892491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3b7a0-acd9-4b49-92c1-887670bd96b2 None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:29.893920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3b7a0-acd9-4b49-92c1-887670bd96b2 None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:29.895358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3b7a0-acd9-4b49-92c1-887670bd96b2 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:29.897327 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 75/147] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:29 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:29.902958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f0d2d-de73-4ee7-be57-691eed08bb18 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:30.036531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f0d2d-de73-4ee7-be57-691eed08bb18 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:30.079842 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6afa5c-f4d7-48c2-95fd-044023a2bb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:30.080603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6afa5c-f4d7-48c2-95fd-044023a2bb86 None admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:30.080797 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6afa5c-f4d7-48c2-95fd-044023a2bb86 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:30.081112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6afa5c-f4d7-48c2-95fd-044023a2bb86 None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729/users/dd65b889e9044ca188743cc21298a1ed/roles/2837b7fc2f2d4636bbdb0b4b8ccba069` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:30.084509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6afa5c-f4d7-48c2-95fd-044023a2bb86 None admin] RBAC: Authorizing `identity:create_grant(project_id=599592d0cae949b8a93e951a0a615729, user_id=dd65b889e9044ca188743cc21298a1ed, role_id=2837b7fc2f2d4636bbdb0b4b8ccba069)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:30.086018 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6afa5c-f4d7-48c2-95fd-044023a2bb86 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:30.112107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 73/148] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:38:29 2022] PUT /identity/v3/projects/599592d0cae949b8a93e951a0a615729/users/dd65b889e9044ca188743cc21298a1ed/roles/2837b7fc2f2d4636bbdb0b4b8ccba069 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:38:30.449089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ff09f-5322-4ff4-9c6c-a82636748b58 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:30.449617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ff09f-5322-4ff4-9c6c-a82636748b58 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:30.449617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ff09f-5322-4ff4-9c6c-a82636748b58 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:30.451123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 76/149] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:30.457785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f5b3-af84-4e20-93fc-b144363947ab None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:30.458076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f5b3-af84-4e20-93fc-b144363947ab None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:30.458361 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f5b3-af84-4e20-93fc-b144363947ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:30.483701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-a9b3f5b3-af84-4e20-93fc-b144363947ab None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:30.484974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a9b3f5b3-af84-4e20-93fc-b144363947ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:30.512961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:30.573104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 74/150] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:30.841444 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc206bb-570e-4478-b144-56faa39ccb83 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:30.841784 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc206bb-570e-4478-b144-56faa39ccb83 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:30.842023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc206bb-570e-4478-b144-56faa39ccb83 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:30.843376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 77/151] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:30.850041 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca18e3-4a2f-4fa2-a6a3-6ec88932c2f3 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:30.850337 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca18e3-4a2f-4fa2-a6a3-6ec88932c2f3 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:30.850620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca18e3-4a2f-4fa2-a6a3-6ec88932c2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:30.873224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-c3ca18e3-4a2f-4fa2-a6a3-6ec88932c2f3 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:30.874999 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c3ca18e3-4a2f-4fa2-a6a3-6ec88932c2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:30.961066 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 75/152] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:31.192464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc206bb-570e-4478-b144-56faa39ccb83 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:31.288097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:31.308966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc206bb-570e-4478-b144-56faa39ccb83 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:31.345019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7e23b-b200-4b19-8564-0ce07ce3ca1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:31.345672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7e23b-b200-4b19-8564-0ce07ce3ca1e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:31.345959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7e23b-b200-4b19-8564-0ce07ce3ca1e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:31.346236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7e23b-b200-4b19-8564-0ce07ce3ca1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:31.357401 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7e23b-b200-4b19-8564-0ce07ce3ca1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-bef7e23b-b200-4b19-8564-0ce07ce3ca1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:31.365794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:31.366694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:31.369090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:31.369090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:31.369090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:31.369090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:31.369090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:31.369090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:31.369090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:31.369090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:31.369090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:31.369090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:31.369090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:31.369090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:31.369090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 78/153] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:31.374480 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca18e3-4a2f-4fa2-a6a3-6ec88932c2f3 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:31.409831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772659bf-d413-47f5-aff2-2081f4e7c3e2 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:31.410168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772659bf-d413-47f5-aff2-2081f4e7c3e2 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:31.410382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772659bf-d413-47f5-aff2-2081f4e7c3e2 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:31.411915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 79/154] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:31.430491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8bec4-ff8f-4f27-824a-b00baf4872f3 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:31.430807 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8bec4-ff8f-4f27-824a-b00baf4872f3 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:31.431043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8bec4-ff8f-4f27-824a-b00baf4872f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:31.465067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-00c8bec4-ff8f-4f27-824a-b00baf4872f3 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:31.466218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-00c8bec4-ff8f-4f27-824a-b00baf4872f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:31.527214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:31.555428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca18e3-4a2f-4fa2-a6a3-6ec88932c2f3 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:31.604133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 80/155] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:31.604818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8bec4-ff8f-4f27-824a-b00baf4872f3 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:31.620426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605cd0b-3dee-477d-8182-4e8ea3440dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:31.621062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605cd0b-3dee-477d-8182-4e8ea3440dfd None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:31.621350 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605cd0b-3dee-477d-8182-4e8ea3440dfd None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:31.621627 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605cd0b-3dee-477d-8182-4e8ea3440dfd None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:31.622300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605cd0b-3dee-477d-8182-4e8ea3440dfd None admin] RBAC: Adding query filter params (name=member) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:31.622601 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605cd0b-3dee-477d-8182-4e8ea3440dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:31.624016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605cd0b-3dee-477d-8182-4e8ea3440dfd None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:31.637314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 76/156] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:31.643213 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605cd0b-3dee-477d-8182-4e8ea3440dfd None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:31.745449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:31.801547 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605cd0b-3dee-477d-8182-4e8ea3440dfd None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:31.803875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8bec4-ff8f-4f27-824a-b00baf4872f3 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:31.839144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a78830-f715-4086-80e4-4ac2c229826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:31.839858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a78830-f715-4086-80e4-4ac2c229826d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:31.840189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a78830-f715-4086-80e4-4ac2c229826d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:31.840469 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a78830-f715-4086-80e4-4ac2c229826d None admin] PATH_INFO: `/v3/users/75c78ba256b046a890982a91574c5ec6` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:31.843053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a78830-f715-4086-80e4-4ac2c229826d None admin] RBAC: Authorizing `identity:get_user(user_id=75c78ba256b046a890982a91574c5ec6)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:31.844512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a78830-f715-4086-80e4-4ac2c229826d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:31.846128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 77/157] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:31 2022] GET /identity/v3/users/75c78ba256b046a890982a91574c5ec6 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:31.847276 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ff143-9c3f-4c38-be86-7935b1c201b2 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:31.847733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ff143-9c3f-4c38-be86-7935b1c201b2 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:31.848205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ff143-9c3f-4c38-be86-7935b1c201b2 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:31.853817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 78/158] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:31.854482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ff143-9c3f-4c38-be86-7935b1c201b2 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:31.877092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7bb9b-15ed-4fe3-8225-1744a2f0a712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:31.877778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7bb9b-15ed-4fe3-8225-1744a2f0a712 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:31.878101 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7bb9b-15ed-4fe3-8225-1744a2f0a712 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:31.878379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7bb9b-15ed-4fe3-8225-1744a2f0a712 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:31.900684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7bb9b-15ed-4fe3-8225-1744a2f0a712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:31.906830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-b3b7bb9b-15ed-4fe3-8225-1744a2f0a712 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:31.912880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:31.913917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:31.914706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:31.914706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:31.914706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:31.914706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:31.914706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:31.914706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:31.914706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:31.914706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:31.914706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:31.914706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:31.914706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:31.914706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:31.914706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 81/159] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:38:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:31.921024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ddbfe-5d47-44ee-af73-896e1cba074b None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:31.921024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ddbfe-5d47-44ee-af73-896e1cba074b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:31.926039 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ddbfe-5d47-44ee-af73-896e1cba074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:31.955402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0c7ddbfe-5d47-44ee-af73-896e1cba074b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:31.956797 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0c7ddbfe-5d47-44ee-af73-896e1cba074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:32.083837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 82/160] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:32.084694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ddbfe-5d47-44ee-af73-896e1cba074b None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:32.102617 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ff143-9c3f-4c38-be86-7935b1c201b2 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:32.182616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edc8c9-0b2e-46a1-a005-13d3a900a36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:32.183590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edc8c9-0b2e-46a1-a005-13d3a900a36c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:32.184103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edc8c9-0b2e-46a1-a005-13d3a900a36c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:32.184603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edc8c9-0b2e-46a1-a005-13d3a900a36c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:32.201017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:32.267493 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ddbfe-5d47-44ee-af73-896e1cba074b None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:32.276018 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edc8c9-0b2e-46a1-a005-13d3a900a36c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:32.277762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edc8c9-0b2e-46a1-a005-13d3a900a36c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:32.302126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:32.339374 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fdc2b-1796-4961-91d9-2e28a14b878f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:32.340345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fdc2b-1796-4961-91d9-2e28a14b878f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:32.340782 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fdc2b-1796-4961-91d9-2e28a14b878f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:32.341273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fdc2b-1796-4961-91d9-2e28a14b878f None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:32.342650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fdc2b-1796-4961-91d9-2e28a14b878f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:32.343117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fdc2b-1796-4961-91d9-2e28a14b878f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:32.344665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fdc2b-1796-4961-91d9-2e28a14b878f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:32.363568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 83/161] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:32.364693 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fdc2b-1796-4961-91d9-2e28a14b878f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:32.409942 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 79/162] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:32.411444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edc8c9-0b2e-46a1-a005-13d3a900a36c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:32.554538 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fdc2b-1796-4961-91d9-2e28a14b878f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:32.596355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edc8c9-0b2e-46a1-a005-13d3a900a36c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:32.613470 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:32.632198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef0b5e-21f7-4c0d-b580-e108786225be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:32.632813 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:32.632923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef0b5e-21f7-4c0d-b580-e108786225be None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:32.633111 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef0b5e-21f7-4c0d-b580-e108786225be None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:32.633384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef0b5e-21f7-4c0d-b580-e108786225be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:32.654220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef0b5e-21f7-4c0d-b580-e108786225be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-2cef0b5e-21f7-4c0d-b580-e108786225be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:32.659477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:32.660351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:32.661169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:32.661169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:32.661169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:32.661169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:32.661169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:32.661169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:32.661169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:32.661169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:32.661169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:32.661169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:32.661169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:32.661169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:32.661169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 84/163] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:38:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:32.669944 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b932175-c5b4-478c-a3e5-b55bc277b4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:32.670616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b932175-c5b4-478c-a3e5-b55bc277b4a1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:32.670896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b932175-c5b4-478c-a3e5-b55bc277b4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:32.671169 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b932175-c5b4-478c-a3e5-b55bc277b4a1 None admin] PATH_INFO: `/v3/users/d9cceada370c47109408165adf5fe287` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:32.672304 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b932175-c5b4-478c-a3e5-b55bc277b4a1 None admin] RBAC: Authorizing `identity:get_user(user_id=d9cceada370c47109408165adf5fe287)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:32.673776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b932175-c5b4-478c-a3e5-b55bc277b4a1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:32.675328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 80/164] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:32 2022] GET /identity/v3/users/d9cceada370c47109408165adf5fe287 => generated 247 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:32.676077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b932175-c5b4-478c-a3e5-b55bc277b4a1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:32.676444 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef0b5e-21f7-4c0d-b580-e108786225be None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:32.834145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef0b5e-21f7-4c0d-b580-e108786225be None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:32.893788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9490f-e0de-4891-b934-5baa531905fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:32.894358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9490f-e0de-4891-b934-5baa531905fc None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:32.894648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9490f-e0de-4891-b934-5baa531905fc None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:32.894943 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9490f-e0de-4891-b934-5baa531905fc None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:32.896084 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9490f-e0de-4891-b934-5baa531905fc None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:32.897555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9490f-e0de-4891-b934-5baa531905fc None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:32.899193 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 85/165] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:32 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:32.899958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9490f-e0de-4891-b934-5baa531905fc None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:32.974926 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b932175-c5b4-478c-a3e5-b55bc277b4a1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:32.997715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:33.050606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9490f-e0de-4891-b934-5baa531905fc None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:33.054243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a5e69-7627-44d5-8fea-9cd84b42afad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:33.054901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a5e69-7627-44d5-8fea-9cd84b42afad None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:33.055184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a5e69-7627-44d5-8fea-9cd84b42afad None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:33.055454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a5e69-7627-44d5-8fea-9cd84b42afad None admin] PATH_INFO: `/v3/roles/member` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:33.070604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a5e69-7627-44d5-8fea-9cd84b42afad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-6e6a5e69-7627-44d5-8fea-9cd84b42afad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:33.083954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:33.084890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:33.085722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:33.085722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:33.085722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:33.085722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:33.085722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:33.085722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:33.085722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:33.085722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:33.085722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:33.085722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:33.085722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:33.085722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:33.091653 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 81/166] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:33.092768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a5e69-7627-44d5-8fea-9cd84b42afad None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:33.138518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94215c77-2e93-4966-8d4b-2b618bae25e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:33.139723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94215c77-2e93-4966-8d4b-2b618bae25e2 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:33.140009 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94215c77-2e93-4966-8d4b-2b618bae25e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:33.140273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94215c77-2e93-4966-8d4b-2b618bae25e2 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:33.141445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94215c77-2e93-4966-8d4b-2b618bae25e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:33.141445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94215c77-2e93-4966-8d4b-2b618bae25e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:33.142652 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94215c77-2e93-4966-8d4b-2b618bae25e2 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:33.160515 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 86/167] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:38:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:33.161088 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94215c77-2e93-4966-8d4b-2b618bae25e2 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:33.178224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:33.282096 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a5e69-7627-44d5-8fea-9cd84b42afad None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:33.301145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94215c77-2e93-4966-8d4b-2b618bae25e2 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:33.320962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:33.341022 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5b909-7b9c-4dcd-9f18-fb5c030d0803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:33.341794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5b909-7b9c-4dcd-9f18-fb5c030d0803 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:33.342526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5b909-7b9c-4dcd-9f18-fb5c030d0803 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:33.342936 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5b909-7b9c-4dcd-9f18-fb5c030d0803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:33.344059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5b909-7b9c-4dcd-9f18-fb5c030d0803 None admin] RBAC: Adding query filter params (role.id=6a5e7cb9300845e4b60b696aa66f4219, scope.project.id=599592d0cae949b8a93e951a0a615729, user.id=75c78ba256b046a890982a91574c5ec6) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:33.344350 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5b909-7b9c-4dcd-9f18-fb5c030d0803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:33.349095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5b909-7b9c-4dcd-9f18-fb5c030d0803 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:33.352902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 87/168] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:33 2022] GET /identity/v3/role_assignments?user.id=75c78ba256b046a890982a91574c5ec6&scope.project.id=599592d0cae949b8a93e951a0a615729&role.id=6a5e7cb9300845e4b60b696aa66f4219 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:33.353677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5b909-7b9c-4dcd-9f18-fb5c030d0803 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:33.366800 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63801e0b-7c7f-4676-84eb-d3f45bfc5332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:33.367838 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63801e0b-7c7f-4676-84eb-d3f45bfc5332 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:33.368355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63801e0b-7c7f-4676-84eb-d3f45bfc5332 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:33.368880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63801e0b-7c7f-4676-84eb-d3f45bfc5332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:33.471315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5b909-7b9c-4dcd-9f18-fb5c030d0803 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:33.513102 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf97e42-3eee-4e15-bc40-ffaef499923a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:33.514636 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf97e42-3eee-4e15-bc40-ffaef499923a None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:33.514922 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf97e42-3eee-4e15-bc40-ffaef499923a None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:33.515200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf97e42-3eee-4e15-bc40-ffaef499923a None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:33.515872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf97e42-3eee-4e15-bc40-ffaef499923a None admin] RBAC: Adding query filter params (name=member) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:33.516179 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf97e42-3eee-4e15-bc40-ffaef499923a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:33.517758 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf97e42-3eee-4e15-bc40-ffaef499923a None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:33.528175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 88/169] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:33.528839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf97e42-3eee-4e15-bc40-ffaef499923a None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:33.537243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63801e0b-7c7f-4676-84eb-d3f45bfc5332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:33.539419 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63801e0b-7c7f-4676-84eb-d3f45bfc5332 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:33.596214 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:33.659923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf97e42-3eee-4e15-bc40-ffaef499923a None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:33.663157 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:33.702169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7b4d6-82ca-4b55-95e9-fc63562342d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:33.703170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7b4d6-82ca-4b55-95e9-fc63562342d8 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:33.703671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7b4d6-82ca-4b55-95e9-fc63562342d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:33.704222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7b4d6-82ca-4b55-95e9-fc63562342d8 None admin] PATH_INFO: `/v3/users/75c78ba256b046a890982a91574c5ec6` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:33.709777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7b4d6-82ca-4b55-95e9-fc63562342d8 None admin] RBAC: Authorizing `identity:get_user(user_id=75c78ba256b046a890982a91574c5ec6)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:33.711478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7b4d6-82ca-4b55-95e9-fc63562342d8 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:33.713610 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 89/170] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:33 2022] GET /identity/v3/users/75c78ba256b046a890982a91574c5ec6 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:33.715008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa10f4d-3ba2-4ab2-8b63-7b038f564baa None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:33.715518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa10f4d-3ba2-4ab2-8b63-7b038f564baa None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:33.715989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa10f4d-3ba2-4ab2-8b63-7b038f564baa None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:33.719140 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 90/171] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:33.720110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa10f4d-3ba2-4ab2-8b63-7b038f564baa None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:33.735380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 82/172] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:33.736409 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63801e0b-7c7f-4676-84eb-d3f45bfc5332 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:33.831358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa10f4d-3ba2-4ab2-8b63-7b038f564baa None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:33.846654 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:33.866058 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63801e0b-7c7f-4676-84eb-d3f45bfc5332 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:33.878958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31636262-3930-4e8a-8555-8991b18a4cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:33.879993 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31636262-3930-4e8a-8555-8991b18a4cd8 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:33.880288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31636262-3930-4e8a-8555-8991b18a4cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:33.880862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31636262-3930-4e8a-8555-8991b18a4cd8 None admin] PATH_INFO: `/v3/users/75c78ba256b046a890982a91574c5ec6` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:33.882890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31636262-3930-4e8a-8555-8991b18a4cd8 None admin] RBAC: Authorizing `identity:get_user(user_id=75c78ba256b046a890982a91574c5ec6)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:33.885070 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31636262-3930-4e8a-8555-8991b18a4cd8 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:33.887223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 91/173] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:33 2022] GET /identity/v3/users/75c78ba256b046a890982a91574c5ec6 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:33.888555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535e27e-efbe-48fe-a579-c6e4b4eb782f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:33.889028 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535e27e-efbe-48fe-a579-c6e4b4eb782f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:33.889859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535e27e-efbe-48fe-a579-c6e4b4eb782f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:33.918537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-4535e27e-efbe-48fe-a579-c6e4b4eb782f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:33.919740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4535e27e-efbe-48fe-a579-c6e4b4eb782f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:33.921945 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f6241-b7a2-4d42-81e7-41edb586c1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:33.922777 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f6241-b7a2-4d42-81e7-41edb586c1f0 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:33.923204 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f6241-b7a2-4d42-81e7-41edb586c1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:33.923707 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f6241-b7a2-4d42-81e7-41edb586c1f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:33.947814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:34.002511 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 92/174] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:34.002511 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535e27e-efbe-48fe-a579-c6e4b4eb782f None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:34.011130 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f6241-b7a2-4d42-81e7-41edb586c1f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:34.013324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f6241-b7a2-4d42-81e7-41edb586c1f0 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:34.101365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535e27e-efbe-48fe-a579-c6e4b4eb782f None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:34.111389 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:34.135738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 83/175] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:34.136983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e159e7-62da-450a-89da-de1f75a0d393 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:34.137294 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e159e7-62da-450a-89da-de1f75a0d393 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:34.137565 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e159e7-62da-450a-89da-de1f75a0d393 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:34.138942 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 84/176] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:34.141836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12396f-c9f8-4a95-baf7-063cbc3d538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:34.141966 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e159e7-62da-450a-89da-de1f75a0d393 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:34.143029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12396f-c9f8-4a95-baf7-063cbc3d538e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:34.143510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12396f-c9f8-4a95-baf7-063cbc3d538e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:34.143990 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12396f-c9f8-4a95-baf7-063cbc3d538e None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:34.145357 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12396f-c9f8-4a95-baf7-063cbc3d538e None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:34.146998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12396f-c9f8-4a95-baf7-063cbc3d538e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:34.148832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 93/177] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:33 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:34.150162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc38f89-6c8f-4786-8e45-66b8b2c10ff2 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:34.150666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc38f89-6c8f-4786-8e45-66b8b2c10ff2 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:34.151147 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc38f89-6c8f-4786-8e45-66b8b2c10ff2 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:34.152593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 94/178] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:34.157718 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea4d78-674c-4d3c-bbe9-e36c88d76deb None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:34.158007 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea4d78-674c-4d3c-bbe9-e36c88d76deb None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:34.158285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea4d78-674c-4d3c-bbe9-e36c88d76deb None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:34.159495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 95/179] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:34.160186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea4d78-674c-4d3c-bbe9-e36c88d76deb None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:34.201275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:34.255984 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e159e7-62da-450a-89da-de1f75a0d393 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:34.269619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea4d78-674c-4d3c-bbe9-e36c88d76deb None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:34.290918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664ccfe-03f4-480e-9378-cecafb49913d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:34.291521 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664ccfe-03f4-480e-9378-cecafb49913d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:34.291803 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664ccfe-03f4-480e-9378-cecafb49913d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:34.292084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664ccfe-03f4-480e-9378-cecafb49913d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:34.303740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c30c5-7953-4e79-be0b-ec6ca87dd0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:34.304359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c30c5-7953-4e79-be0b-ec6ca87dd0bb None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:34.304640 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c30c5-7953-4e79-be0b-ec6ca87dd0bb None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:34.304923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c30c5-7953-4e79-be0b-ec6ca87dd0bb None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:34.306068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c30c5-7953-4e79-be0b-ec6ca87dd0bb None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:34.307518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c30c5-7953-4e79-be0b-ec6ca87dd0bb None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:34.309159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 96/180] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:34 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:34.310243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dba79-200e-4841-95f2-13b448f25547 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:34.310520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dba79-200e-4841-95f2-13b448f25547 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:34.310828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dba79-200e-4841-95f2-13b448f25547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:34.327801 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-be2dba79-200e-4841-95f2-13b448f25547 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:34.328976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-be2dba79-200e-4841-95f2-13b448f25547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:34.364489 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664ccfe-03f4-480e-9378-cecafb49913d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:34.365991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664ccfe-03f4-480e-9378-cecafb49913d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:34.370022 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:34.395895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 97/181] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:34.396914 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dba79-200e-4841-95f2-13b448f25547 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:34.421393 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:34.478392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 85/182] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:34.479888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9d67-4842-44b9-8dee-ed22632139ef None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:34.480254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9d67-4842-44b9-8dee-ed22632139ef None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:34.480538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9d67-4842-44b9-8dee-ed22632139ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:34.498085 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-64ae9d67-4842-44b9-8dee-ed22632139ef None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:34.499306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-64ae9d67-4842-44b9-8dee-ed22632139ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:34.506959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dba79-200e-4841-95f2-13b448f25547 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:34.546824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac4ab9-60eb-4492-b48f-b7b60f9bfb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:34.547419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac4ab9-60eb-4492-b48f-b7b60f9bfb83 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:34.547699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac4ab9-60eb-4492-b48f-b7b60f9bfb83 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:34.547970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac4ab9-60eb-4492-b48f-b7b60f9bfb83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:34.548688 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac4ab9-60eb-4492-b48f-b7b60f9bfb83 None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=599592d0cae949b8a93e951a0a615729, user.id=d9cceada370c47109408165adf5fe287) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:34.549021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac4ab9-60eb-4492-b48f-b7b60f9bfb83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:34.550445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac4ab9-60eb-4492-b48f-b7b60f9bfb83 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:34.565025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 98/183] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:34 2022] GET /identity/v3/role_assignments?user.id=d9cceada370c47109408165adf5fe287&scope.project.id=599592d0cae949b8a93e951a0a615729&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:34.565025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c1e4-79cd-4e8f-a662-599ff3d42ddf None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:34.565025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c1e4-79cd-4e8f-a662-599ff3d42ddf None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:34.565025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c1e4-79cd-4e8f-a662-599ff3d42ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:34.577569 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-a889c1e4-79cd-4e8f-a662-599ff3d42ddf None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:34.578763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a889c1e4-79cd-4e8f-a662-599ff3d42ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:34.593573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 86/184] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:34.595727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9d67-4842-44b9-8dee-ed22632139ef None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:34.617038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:34.677203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 99/185] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:34.678102 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c1e4-79cd-4e8f-a662-599ff3d42ddf None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:34.735348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:34.772435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9d67-4842-44b9-8dee-ed22632139ef None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:34.817740 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f587f7-6c82-4091-98c0-aacfc34e14dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:34.818376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f587f7-6c82-4091-98c0-aacfc34e14dd None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:34.818656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f587f7-6c82-4091-98c0-aacfc34e14dd None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:34.818925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f587f7-6c82-4091-98c0-aacfc34e14dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:34.832560 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f587f7-6c82-4091-98c0-aacfc34e14dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:34.832799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c1e4-79cd-4e8f-a662-599ff3d42ddf None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-92f587f7-6c82-4091-98c0-aacfc34e14dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:34.838231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:34.839366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:34.840581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:34.840581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:34.840581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:34.840581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:34.840581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:34.840581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:34.840581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:34.840581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:34.840581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:34.840581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:34.840581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:34.840581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:34.840581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 87/186] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:38:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:34.841287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f587f7-6c82-4091-98c0-aacfc34e14dd None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:34.877767 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649b9fd-b980-4806-b5dc-d5230774b5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:34.878544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b9fd-b980-4806-b5dc-d5230774b5b5 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:34.879190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b9fd-b980-4806-b5dc-d5230774b5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:34.879474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b9fd-b980-4806-b5dc-d5230774b5b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:34.880496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649b9fd-b980-4806-b5dc-d5230774b5b5 None admin] RBAC: Adding query filter params (role.id=222316862a15450198a3b454c14558c4, scope.project.id=599592d0cae949b8a93e951a0a615729, user.id=75c78ba256b046a890982a91574c5ec6) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:34.880809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649b9fd-b980-4806-b5dc-d5230774b5b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:34.883048 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649b9fd-b980-4806-b5dc-d5230774b5b5 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:34.891759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 100/187] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:34 2022] GET /identity/v3/role_assignments?user.id=75c78ba256b046a890982a91574c5ec6&scope.project.id=599592d0cae949b8a93e951a0a615729&role.id=222316862a15450198a3b454c14558c4 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:34.893205 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649b9fd-b980-4806-b5dc-d5230774b5b5 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:34.946358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:34.977514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f587f7-6c82-4091-98c0-aacfc34e14dd None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:35.020952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea73f87-9a0e-4c9f-b04e-61599a8b6572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:35.021807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea73f87-9a0e-4c9f-b04e-61599a8b6572 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:35.022092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea73f87-9a0e-4c9f-b04e-61599a8b6572 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:35.022370 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea73f87-9a0e-4c9f-b04e-61599a8b6572 None admin] PATH_INFO: `/v3/projects/0db2e465141047bfb6d5e829fef8599c` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:35.023620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea73f87-9a0e-4c9f-b04e-61599a8b6572 None admin] RBAC: Authorizing `identity:get_project(project_id=0db2e465141047bfb6d5e829fef8599c)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:35.026403 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea73f87-9a0e-4c9f-b04e-61599a8b6572 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:35.027253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 88/188] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:34 2022] GET /identity/v3/projects/0db2e465141047bfb6d5e829fef8599c => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:35.028058 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea73f87-9a0e-4c9f-b04e-61599a8b6572 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:35.041952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:35.051931 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649b9fd-b980-4806-b5dc-d5230774b5b5 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:35.097469 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ff927-675e-440b-b56a-29615aa47dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:35.098337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ff927-675e-440b-b56a-29615aa47dce None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:35.098760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ff927-675e-440b-b56a-29615aa47dce None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:35.099035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ff927-675e-440b-b56a-29615aa47dce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:35.112808 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ff927-675e-440b-b56a-29615aa47dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-500ff927-675e-440b-b56a-29615aa47dce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:35.119821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:35.120747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:35.121627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:35.121627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:35.121627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:35.121627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:35.121627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:35.121627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:35.121627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:35.121627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:35.121627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:35.121627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:35.121627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:35.121627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:35.121627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 101/189] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:35.122814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ff927-675e-440b-b56a-29615aa47dce None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:35.150829 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea73f87-9a0e-4c9f-b04e-61599a8b6572 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:35.186745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2ceaf-bb4f-497e-8a71-814b165a7e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:35.187348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2ceaf-bb4f-497e-8a71-814b165a7e76 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:35.187630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2ceaf-bb4f-497e-8a71-814b165a7e76 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:35.187909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2ceaf-bb4f-497e-8a71-814b165a7e76 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:35.188574 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2ceaf-bb4f-497e-8a71-814b165a7e76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:35.188876 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2ceaf-bb4f-497e-8a71-814b165a7e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:35.190276 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2ceaf-bb4f-497e-8a71-814b165a7e76 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:35.198385 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 89/190] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:35.199157 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2ceaf-bb4f-497e-8a71-814b165a7e76 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:35.221294 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:35.230161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ff927-675e-440b-b56a-29615aa47dce None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:35.263119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e96fc5-f608-4d1c-b6cd-b3d407d1b4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:35.263778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e96fc5-f608-4d1c-b6cd-b3d407d1b4f5 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:35.264092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e96fc5-f608-4d1c-b6cd-b3d407d1b4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:35.264363 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e96fc5-f608-4d1c-b6cd-b3d407d1b4f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:35.265984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e96fc5-f608-4d1c-b6cd-b3d407d1b4f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:35.267412 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e96fc5-f608-4d1c-b6cd-b3d407d1b4f5 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:35.268945 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 102/191] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:35.269495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:35.269719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e96fc5-f608-4d1c-b6cd-b3d407d1b4f5 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:35.300368 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2ceaf-bb4f-497e-8a71-814b165a7e76 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:35.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579414f-f9f4-464f-867b-9729fd5baa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:35.333978 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579414f-f9f4-464f-867b-9729fd5baa3b None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:35.334264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579414f-f9f4-464f-867b-9729fd5baa3b None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:35.334542 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579414f-f9f4-464f-867b-9729fd5baa3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:35.344623 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579414f-f9f4-464f-867b-9729fd5baa3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-2579414f-f9f4-464f-867b-9729fd5baa3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:35.349760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:35.350830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:35.351901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:35.351901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:35.351901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:35.351901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:35.351901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:35.351901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:35.351901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:35.351901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:35.351901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:35.351901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:35.351901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:35.351901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:35.351901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 90/192] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:38:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:35.351901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579414f-f9f4-464f-867b-9729fd5baa3b None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:35.368509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e96fc5-f608-4d1c-b6cd-b3d407d1b4f5 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:35.402523 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485f4ea-0b52-4cc1-b734-ce6bf9a5906a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:35.403125 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485f4ea-0b52-4cc1-b734-ce6bf9a5906a None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:35.403412 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485f4ea-0b52-4cc1-b734-ce6bf9a5906a None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:35.403690 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485f4ea-0b52-4cc1-b734-ce6bf9a5906a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:35.404419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485f4ea-0b52-4cc1-b734-ce6bf9a5906a None admin] RBAC: Adding query filter params (role.id=6a5e7cb9300845e4b60b696aa66f4219, scope.project.id=0db2e465141047bfb6d5e829fef8599c, user.id=75c78ba256b046a890982a91574c5ec6) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:35.404756 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485f4ea-0b52-4cc1-b734-ce6bf9a5906a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:35.406236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485f4ea-0b52-4cc1-b734-ce6bf9a5906a None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:35.411896 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 103/193] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:35 2022] GET /identity/v3/role_assignments?user.id=75c78ba256b046a890982a91574c5ec6&scope.project.id=0db2e465141047bfb6d5e829fef8599c&role.id=6a5e7cb9300845e4b60b696aa66f4219 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:35.412662 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485f4ea-0b52-4cc1-b734-ce6bf9a5906a None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:35.442739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:35.459272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579414f-f9f4-464f-867b-9729fd5baa3b None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:35.492491 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:35.499926 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f4c98-5b94-4505-8048-afa085280954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:35.500552 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f4c98-5b94-4505-8048-afa085280954 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:35.500836 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f4c98-5b94-4505-8048-afa085280954 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:35.501165 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f4c98-5b94-4505-8048-afa085280954 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:35.502035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f4c98-5b94-4505-8048-afa085280954 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:35.502349 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f4c98-5b94-4505-8048-afa085280954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:35.503911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f4c98-5b94-4505-8048-afa085280954 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:35.518511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 91/194] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:35.518511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f4c98-5b94-4505-8048-afa085280954 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:35.531467 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485f4ea-0b52-4cc1-b734-ce6bf9a5906a None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:35.573950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb22ac-2915-42f7-92b7-d34c726c9f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:35.573950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb22ac-2915-42f7-92b7-d34c726c9f91 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:35.574245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb22ac-2915-42f7-92b7-d34c726c9f91 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:35.574449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb22ac-2915-42f7-92b7-d34c726c9f91 None admin] PATH_INFO: `/v3/users/3b71a625e5e149f6bebf76182a2ca22e` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:35.592908 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb22ac-2915-42f7-92b7-d34c726c9f91 None admin] RBAC: Authorizing `identity:get_user(user_id=3b71a625e5e149f6bebf76182a2ca22e)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:35.594418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb22ac-2915-42f7-92b7-d34c726c9f91 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:35.596105 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 104/195] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:35 2022] GET /identity/v3/users/3b71a625e5e149f6bebf76182a2ca22e => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:35.596881 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb22ac-2915-42f7-92b7-d34c726c9f91 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:35.637062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f4c98-5b94-4505-8048-afa085280954 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:35.669932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff120e3-09d7-4995-9ab2-1f1e6451b698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:35.671055 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff120e3-09d7-4995-9ab2-1f1e6451b698 None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:35.671339 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff120e3-09d7-4995-9ab2-1f1e6451b698 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:35.671615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff120e3-09d7-4995-9ab2-1f1e6451b698 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:35.672263 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff120e3-09d7-4995-9ab2-1f1e6451b698 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:35.673751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff120e3-09d7-4995-9ab2-1f1e6451b698 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:35.687091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:35.701582 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 92/196] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:38:35 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:38:35.702405 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff120e3-09d7-4995-9ab2-1f1e6451b698 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:35.710808 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb22ac-2915-42f7-92b7-d34c726c9f91 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:35.750300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321b404-92e8-40af-9e80-b7ed88c83492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:35.750932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321b404-92e8-40af-9e80-b7ed88c83492 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:35.751212 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321b404-92e8-40af-9e80-b7ed88c83492 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:35.751486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321b404-92e8-40af-9e80-b7ed88c83492 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:35.752176 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321b404-92e8-40af-9e80-b7ed88c83492 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:35.752478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321b404-92e8-40af-9e80-b7ed88c83492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:35.753946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321b404-92e8-40af-9e80-b7ed88c83492 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:35.762924 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 105/197] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:38:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:35.763113 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:35.768371 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321b404-92e8-40af-9e80-b7ed88c83492 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:35.824202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff120e3-09d7-4995-9ab2-1f1e6451b698 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:35.864273 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc071c-86f6-4e37-adf7-9e39887408d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:35.864916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc071c-86f6-4e37-adf7-9e39887408d2 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:35.865228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc071c-86f6-4e37-adf7-9e39887408d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:35.865517 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc071c-86f6-4e37-adf7-9e39887408d2 None admin] PATH_INFO: `/v3/users/dd65b889e9044ca188743cc21298a1ed` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:35.866776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc071c-86f6-4e37-adf7-9e39887408d2 None admin] RBAC: Authorizing `identity:get_user(user_id=dd65b889e9044ca188743cc21298a1ed)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:35.868107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc071c-86f6-4e37-adf7-9e39887408d2 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:35.869884 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 93/198] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:35 2022] GET /identity/v3/users/dd65b889e9044ca188743cc21298a1ed => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:35.870574 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc071c-86f6-4e37-adf7-9e39887408d2 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:35.890110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321b404-92e8-40af-9e80-b7ed88c83492 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:35.929457 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1983e87-8aa1-4786-909f-2966b00336b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:35.930184 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1983e87-8aa1-4786-909f-2966b00336b3 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:35.930576 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1983e87-8aa1-4786-909f-2966b00336b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:35.930926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1983e87-8aa1-4786-909f-2966b00336b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:35.949836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:35.999258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc071c-86f6-4e37-adf7-9e39887408d2 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:36.022786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:36.030994 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1983e87-8aa1-4786-909f-2966b00336b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:36.032326 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1983e87-8aa1-4786-909f-2966b00336b3 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:36.050988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7cb87-393a-4846-a3c9-9fa09c4bb4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:36.051636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7cb87-393a-4846-a3c9-9fa09c4bb4df None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:36.051922 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7cb87-393a-4846-a3c9-9fa09c4bb4df None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:36.052202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7cb87-393a-4846-a3c9-9fa09c4bb4df None admin] PATH_INFO: `/v3/users/3b71a625e5e149f6bebf76182a2ca22e` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:36.053383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7cb87-393a-4846-a3c9-9fa09c4bb4df None admin] RBAC: Authorizing `identity:get_user(user_id=3b71a625e5e149f6bebf76182a2ca22e)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:36.054850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7cb87-393a-4846-a3c9-9fa09c4bb4df None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:36.056440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 94/199] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:35 2022] GET /identity/v3/users/3b71a625e5e149f6bebf76182a2ca22e => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:36.057226 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7cb87-393a-4846-a3c9-9fa09c4bb4df None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:36.164398 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 106/200] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:36.166306 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1983e87-8aa1-4786-909f-2966b00336b3 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:36.188986 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7cb87-393a-4846-a3c9-9fa09c4bb4df None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:36.231339 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28250a7-7605-45e7-ac41-33bbc01bfbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:36.232749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:36.233354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28250a7-7605-45e7-ac41-33bbc01bfbb8 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:36.233863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28250a7-7605-45e7-ac41-33bbc01bfbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:36.234347 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28250a7-7605-45e7-ac41-33bbc01bfbb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:36.300595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1983e87-8aa1-4786-909f-2966b00336b3 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:36.302695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:36.317009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28250a7-7605-45e7-ac41-33bbc01bfbb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:36.319331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28250a7-7605-45e7-ac41-33bbc01bfbb8 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:36.350378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017cd5c-85cc-43da-a5ca-319571c30200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:36.351421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017cd5c-85cc-43da-a5ca-319571c30200 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:36.351963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017cd5c-85cc-43da-a5ca-319571c30200 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:36.352448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017cd5c-85cc-43da-a5ca-319571c30200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:36.421829 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 95/201] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:36.423035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28250a7-7605-45e7-ac41-33bbc01bfbb8 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:36.435525 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017cd5c-85cc-43da-a5ca-319571c30200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:36.437334 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017cd5c-85cc-43da-a5ca-319571c30200 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:36.495628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:36.517390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:36.533889 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28250a7-7605-45e7-ac41-33bbc01bfbb8 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:36.563906 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 107/202] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:36.569550 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017cd5c-85cc-43da-a5ca-319571c30200 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:36.581729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc6e28-01b1-4e99-97c1-eeeaff48f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:36.582370 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc6e28-01b1-4e99-97c1-eeeaff48f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:36.582653 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc6e28-01b1-4e99-97c1-eeeaff48f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:36.582930 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc6e28-01b1-4e99-97c1-eeeaff48f9b0 None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:36.585616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc6e28-01b1-4e99-97c1-eeeaff48f9b0 None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:36.587283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc6e28-01b1-4e99-97c1-eeeaff48f9b0 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:36.593103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 96/203] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:36 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:36.593103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc6e28-01b1-4e99-97c1-eeeaff48f9b0 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:36.709270 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc6e28-01b1-4e99-97c1-eeeaff48f9b0 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:36.709956 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017cd5c-85cc-43da-a5ca-319571c30200 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:36.747226 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da5227-2904-4649-985b-9832118d6e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:36.748735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da5227-2904-4649-985b-9832118d6e8f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:36.749150 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da5227-2904-4649-985b-9832118d6e8f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:36.749760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da5227-2904-4649-985b-9832118d6e8f None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:36.750850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da5227-2904-4649-985b-9832118d6e8f None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:36.752498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da5227-2904-4649-985b-9832118d6e8f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:36.754656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 97/204] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:36 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:36.755246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606b1ca-d86b-429a-9f3e-1221c8846ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:36.756052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606b1ca-d86b-429a-9f3e-1221c8846ace None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:36.756472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606b1ca-d86b-429a-9f3e-1221c8846ace None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:36.756873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606b1ca-d86b-429a-9f3e-1221c8846ace None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:36.758167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606b1ca-d86b-429a-9f3e-1221c8846ace None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:36.759735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606b1ca-d86b-429a-9f3e-1221c8846ace None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:36.760351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da5227-2904-4649-985b-9832118d6e8f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:36.761839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 108/205] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:36 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:36.762735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606b1ca-d86b-429a-9f3e-1221c8846ace None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:36.782175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:36.787202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:36.883131 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da5227-2904-4649-985b-9832118d6e8f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:36.889994 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606b1ca-d86b-429a-9f3e-1221c8846ace None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:36.923054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421277a2-672d-4b8b-813a-7cdb2222564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:36.924194 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421277a2-672d-4b8b-813a-7cdb2222564e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:36.924374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421277a2-672d-4b8b-813a-7cdb2222564e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:36.924761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421277a2-672d-4b8b-813a-7cdb2222564e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:36.925668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421277a2-672d-4b8b-813a-7cdb2222564e None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2, user.id=3b71a625e5e149f6bebf76182a2ca22e) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:36.926089 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421277a2-672d-4b8b-813a-7cdb2222564e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:36.927827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421277a2-672d-4b8b-813a-7cdb2222564e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:36.934288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034a22b-b1a9-40b7-81e5-b2dc5f9c8e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:36.935190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034a22b-b1a9-40b7-81e5-b2dc5f9c8e21 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:36.935685 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034a22b-b1a9-40b7-81e5-b2dc5f9c8e21 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:36.936603 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034a22b-b1a9-40b7-81e5-b2dc5f9c8e21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:36.937533 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034a22b-b1a9-40b7-81e5-b2dc5f9c8e21 None admin] RBAC: Adding query filter params (role.id=222316862a15450198a3b454c14558c4, scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2, user.id=3b71a625e5e149f6bebf76182a2ca22e) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:36.938001 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034a22b-b1a9-40b7-81e5-b2dc5f9c8e21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:36.939652 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034a22b-b1a9-40b7-81e5-b2dc5f9c8e21 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:36.941528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 98/206] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:36 2022] GET /identity/v3/role_assignments?user.id=3b71a625e5e149f6bebf76182a2ca22e&scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:36.942730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421277a2-672d-4b8b-813a-7cdb2222564e None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:36.946766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 109/207] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:36 2022] GET /identity/v3/role_assignments?user.id=3b71a625e5e149f6bebf76182a2ca22e&scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2&role.id=222316862a15450198a3b454c14558c4 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:37.081442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:37.106142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421277a2-672d-4b8b-813a-7cdb2222564e None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:37.147342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b407d91-2778-44e0-960e-ccc2b5347138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:37.148182 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b407d91-2778-44e0-960e-ccc2b5347138 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:37.148466 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b407d91-2778-44e0-960e-ccc2b5347138 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:37.148740 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b407d91-2778-44e0-960e-ccc2b5347138 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:37.149514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b407d91-2778-44e0-960e-ccc2b5347138 None admin] RBAC: Adding query filter params (role.id=2837b7fc2f2d4636bbdb0b4b8ccba069, scope.project.id=599592d0cae949b8a93e951a0a615729, user.id=dd65b889e9044ca188743cc21298a1ed) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:37.149822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b407d91-2778-44e0-960e-ccc2b5347138 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:37.151291 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b407d91-2778-44e0-960e-ccc2b5347138 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:37.158325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 99/208] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:36 2022] GET /identity/v3/role_assignments?user.id=dd65b889e9044ca188743cc21298a1ed&scope.project.id=599592d0cae949b8a93e951a0a615729&role.id=2837b7fc2f2d4636bbdb0b4b8ccba069 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:37.810546 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b21094-d931-4e80-b2c9-c399eb4b4bad None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:37.811116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b21094-d931-4e80-b2c9-c399eb4b4bad None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:37.811116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b21094-d931-4e80-b2c9-c399eb4b4bad None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:37.812484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 110/209] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:37.817947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc3c03-b81b-46c0-a96e-17c7bc95bde3 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:37.818378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc3c03-b81b-46c0-a96e-17c7bc95bde3 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:37.818570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc3c03-b81b-46c0-a96e-17c7bc95bde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:37.839251 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-e4fc3c03-b81b-46c0-a96e-17c7bc95bde3 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:37.840470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-e4fc3c03-b81b-46c0-a96e-17c7bc95bde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:37.902372 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d918b8-bdf2-4f4e-bd71-ee299fdddab9 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:37.902696 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d918b8-bdf2-4f4e-bd71-ee299fdddab9 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:37.902937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d918b8-bdf2-4f4e-bd71-ee299fdddab9 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:37.904426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 111/210] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:37.909380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04f4aa-0062-4dcc-9b6d-ee05aa4272ed None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:37.909671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04f4aa-0062-4dcc-9b6d-ee05aa4272ed None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:37.909949 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04f4aa-0062-4dcc-9b6d-ee05aa4272ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:37.924002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 100/211] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:37.933024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-7a04f4aa-0062-4dcc-9b6d-ee05aa4272ed None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:37.934476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-7a04f4aa-0062-4dcc-9b6d-ee05aa4272ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:38.001129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 112/212] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:38.195262 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc3c03-b81b-46c0-a96e-17c7bc95bde3 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:38.278901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:38.284122 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04f4aa-0062-4dcc-9b6d-ee05aa4272ed None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:38.294419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:38.314797 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc3c03-b81b-46c0-a96e-17c7bc95bde3 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:38.365010 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4d68d-468a-488e-9e87-ae207bf82b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:38.365646 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4d68d-468a-488e-9e87-ae207bf82b64 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:38.365931 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4d68d-468a-488e-9e87-ae207bf82b64 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:38.366206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4d68d-468a-488e-9e87-ae207bf82b64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:38.380270 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4d68d-468a-488e-9e87-ae207bf82b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-80d4d68d-468a-488e-9e87-ae207bf82b64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:38.386520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:38.387435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:38.393855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:38.393855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:38.393855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:38.393855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:38.393855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:38.393855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:38.393855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:38.393855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:38.393855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:38.393855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:38.393855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:38.393855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:38.393855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 101/213] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:38.394536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4d68d-468a-488e-9e87-ae207bf82b64 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:38.404217 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04f4aa-0062-4dcc-9b6d-ee05aa4272ed None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:38.442104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100701d3-098c-4623-891b-665645e023eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:38.443063 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100701d3-098c-4623-891b-665645e023eb None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:38.443615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100701d3-098c-4623-891b-665645e023eb None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:38.444091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100701d3-098c-4623-891b-665645e023eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:38.445506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100701d3-098c-4623-891b-665645e023eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:38.447161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100701d3-098c-4623-891b-665645e023eb None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:38.453096 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 113/214] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:38.455585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100701d3-098c-4623-891b-665645e023eb None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:38.520737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4d68d-468a-488e-9e87-ae207bf82b64 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:38.538424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:38.561895 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0a438-5e54-44c4-bbcb-48378690776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:38.562869 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0a438-5e54-44c4-bbcb-48378690776b None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:38.563434 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0a438-5e54-44c4-bbcb-48378690776b None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:38.564032 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0a438-5e54-44c4-bbcb-48378690776b None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:38.564908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0a438-5e54-44c4-bbcb-48378690776b None admin] RBAC: Adding query filter params (name=member) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:38.565507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0a438-5e54-44c4-bbcb-48378690776b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:38.567335 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0a438-5e54-44c4-bbcb-48378690776b None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:38.570321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100701d3-098c-4623-891b-665645e023eb None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:38.576119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:38.587334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 102/215] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:38.589283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0a438-5e54-44c4-bbcb-48378690776b None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:38.611891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc2778-7aee-4af3-8356-be0f011c8997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:38.612504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc2778-7aee-4af3-8356-be0f011c8997 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:38.612788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc2778-7aee-4af3-8356-be0f011c8997 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:38.613085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc2778-7aee-4af3-8356-be0f011c8997 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:38.613734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc2778-7aee-4af3-8356-be0f011c8997 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:38.615177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc2778-7aee-4af3-8356-be0f011c8997 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:38.643245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 114/216] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:38:38 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:38:38.709183 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0a438-5e54-44c4-bbcb-48378690776b None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:38.751400 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b461b-c6f7-40d6-8fc8-1c4bd8ecf985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:38.752479 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b461b-c6f7-40d6-8fc8-1c4bd8ecf985 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:38.753072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b461b-c6f7-40d6-8fc8-1c4bd8ecf985 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:38.753577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b461b-c6f7-40d6-8fc8-1c4bd8ecf985 None admin] PATH_INFO: `/v3/users/92f30348c46e4049a0e7a7e8d374a6a6` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:38.770867 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b461b-c6f7-40d6-8fc8-1c4bd8ecf985 None admin] RBAC: Authorizing `identity:get_user(user_id=92f30348c46e4049a0e7a7e8d374a6a6)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:38.772703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b461b-c6f7-40d6-8fc8-1c4bd8ecf985 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:38.780160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 103/217] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:38 2022] GET /identity/v3/users/92f30348c46e4049a0e7a7e8d374a6a6 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:38.781972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc2778-7aee-4af3-8356-be0f011c8997 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:38.891441 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc2778-7aee-4af3-8356-be0f011c8997 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:38.922535 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:38.932273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f016b0-bf3f-4d07-bc5b-0899b0f885e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:38.933250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f016b0-bf3f-4d07-bc5b-0899b0f885e6 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:38.933739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f016b0-bf3f-4d07-bc5b-0899b0f885e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:38.934245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f016b0-bf3f-4d07-bc5b-0899b0f885e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:38.987555 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81b57f-bba8-492e-b1df-33f13b004455 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:38.988042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81b57f-bba8-492e-b1df-33f13b004455 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:38.988042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81b57f-bba8-492e-b1df-33f13b004455 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:38.989535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 104/218] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:38:38.994847 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d1ef8-3740-4144-a541-fbe237790fc6 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:38.995142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d1ef8-3740-4144-a541-fbe237790fc6 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:38.995425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d1ef8-3740-4144-a541-fbe237790fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:39.016845 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f016b0-bf3f-4d07-bc5b-0899b0f885e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:39.018362 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f016b0-bf3f-4d07-bc5b-0899b0f885e6 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:39.018849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-105d1ef8-3740-4144-a541-fbe237790fc6 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:39.020076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-105d1ef8-3740-4144-a541-fbe237790fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:39.078307 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:39.099536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 105/219] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:39.126071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 115/220] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:39.131824 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d1ef8-3740-4144-a541-fbe237790fc6 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:39.198393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb7140-1a07-461e-9086-6eb908a8e504 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:39.199010 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb7140-1a07-461e-9086-6eb908a8e504 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:39.199513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb7140-1a07-461e-9086-6eb908a8e504 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:39.201069 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 116/221] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:38:39.206202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f493-35b2-4710-a8c3-0c6f00b07cf2 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:39.206732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f493-35b2-4710-a8c3-0c6f00b07cf2 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:39.207220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f493-35b2-4710-a8c3-0c6f00b07cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:39.235598 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-6092f493-35b2-4710-a8c3-0c6f00b07cf2 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:39.237201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6092f493-35b2-4710-a8c3-0c6f00b07cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:39.253975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d1ef8-3740-4144-a541-fbe237790fc6 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:39.273361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:39.289840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f69ded-c2f6-44ed-a6bb-d0f2684ca771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:39.290484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f69ded-c2f6-44ed-a6bb-d0f2684ca771 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:39.290770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f69ded-c2f6-44ed-a6bb-d0f2684ca771 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:39.291049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f69ded-c2f6-44ed-a6bb-d0f2684ca771 None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:39.292286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f69ded-c2f6-44ed-a6bb-d0f2684ca771 None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:39.293772 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f69ded-c2f6-44ed-a6bb-d0f2684ca771 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:39.295968 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 106/222] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:39 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:39.309043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f69ded-c2f6-44ed-a6bb-d0f2684ca771 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:39.359765 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 117/223] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:39.363062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:39.409987 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f69ded-c2f6-44ed-a6bb-d0f2684ca771 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:39.447032 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f2dd2-7b7a-4b93-b9ee-ed4a46ebcf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:39.447649 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f2dd2-7b7a-4b93-b9ee-ed4a46ebcf6a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:39.447936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f2dd2-7b7a-4b93-b9ee-ed4a46ebcf6a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:39.448212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f2dd2-7b7a-4b93-b9ee-ed4a46ebcf6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:39.448942 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f2dd2-7b7a-4b93-b9ee-ed4a46ebcf6a None admin] RBAC: Adding query filter params (role.id=6a5e7cb9300845e4b60b696aa66f4219, scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2, user.id=92f30348c46e4049a0e7a7e8d374a6a6) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:39.449283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f2dd2-7b7a-4b93-b9ee-ed4a46ebcf6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:39.450726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f2dd2-7b7a-4b93-b9ee-ed4a46ebcf6a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:39.461146 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 107/224] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:39 2022] GET /identity/v3/role_assignments?user.id=92f30348c46e4049a0e7a7e8d374a6a6&scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2&role.id=6a5e7cb9300845e4b60b696aa66f4219 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:39.519363 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092f493-35b2-4710-a8c3-0c6f00b07cf2 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:39.665723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092f493-35b2-4710-a8c3-0c6f00b07cf2 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:39.713361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbea73b-9134-47d5-8a96-0bee021f41d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:39.714254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbea73b-9134-47d5-8a96-0bee021f41d7 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:39.714532 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbea73b-9134-47d5-8a96-0bee021f41d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:39.714806 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbea73b-9134-47d5-8a96-0bee021f41d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:39.728714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbea73b-9134-47d5-8a96-0bee021f41d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-0fbea73b-9134-47d5-8a96-0bee021f41d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:39.734366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:39.735274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:39.736086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:39.736086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:39.736086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:39.736086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:39.736086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:39.736086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:39.736086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:39.736086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:39.736086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:39.736086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:39.736086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:39.736086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:39.736086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 118/225] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:38:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:39.741304 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f2dd2-7b7a-4b93-b9ee-ed4a46ebcf6a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:39.817050 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbea73b-9134-47d5-8a96-0bee021f41d7 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:39.853359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:39.916740 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f2dd2-7b7a-4b93-b9ee-ed4a46ebcf6a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:39.953919 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:39.980909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a03158-ca6c-46a8-9052-995076904338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:39.981671 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a03158-ca6c-46a8-9052-995076904338 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:39.981957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a03158-ca6c-46a8-9052-995076904338 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:39.982234 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a03158-ca6c-46a8-9052-995076904338 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:39.983555 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a03158-ca6c-46a8-9052-995076904338 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:39.985101 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a03158-ca6c-46a8-9052-995076904338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:39.988155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a03158-ca6c-46a8-9052-995076904338 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:40.002501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbea73b-9134-47d5-8a96-0bee021f41d7 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:40.006955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 108/226] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:40.011311 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a03158-ca6c-46a8-9052-995076904338 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:40.066317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e719a-b1a8-4398-bd54-04da811d770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:40.066955 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e719a-b1a8-4398-bd54-04da811d770d None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:40.067292 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e719a-b1a8-4398-bd54-04da811d770d None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:40.067514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e719a-b1a8-4398-bd54-04da811d770d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:40.090317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e719a-b1a8-4398-bd54-04da811d770d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-c38e719a-b1a8-4398-bd54-04da811d770d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:40.095119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:40.096008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:40.096814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:40.096814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:40.096814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:40.096814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:40.096814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:40.096814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:40.096814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:40.096814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:40.096814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:40.096814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:40.096814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:40.096814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:40.098633 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 119/227] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:38:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:38:40.104324 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e719a-b1a8-4398-bd54-04da811d770d None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:40.195599 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a03158-ca6c-46a8-9052-995076904338 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:40.233733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d7def-5e9f-4828-93c3-22278f9e5aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:40.234526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d7def-5e9f-4828-93c3-22278f9e5aea None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:40.234823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d7def-5e9f-4828-93c3-22278f9e5aea None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:40.235105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d7def-5e9f-4828-93c3-22278f9e5aea None admin] PATH_INFO: `/v3/users/3b71a625e5e149f6bebf76182a2ca22e` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:40.236242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d7def-5e9f-4828-93c3-22278f9e5aea None admin] RBAC: Authorizing `identity:get_user(user_id=3b71a625e5e149f6bebf76182a2ca22e)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:40.237799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d7def-5e9f-4828-93c3-22278f9e5aea None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:40.240543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 109/228] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:40 2022] GET /identity/v3/users/3b71a625e5e149f6bebf76182a2ca22e => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:40.248087 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d7def-5e9f-4828-93c3-22278f9e5aea None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:40.274781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:40.309473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:40.343165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e719a-b1a8-4398-bd54-04da811d770d None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:40.366731 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d7def-5e9f-4828-93c3-22278f9e5aea None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:40.400104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e48f1c-379c-45a6-8269-65881bf92453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:40.400717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e48f1c-379c-45a6-8269-65881bf92453 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:40.401078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e48f1c-379c-45a6-8269-65881bf92453 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:40.401361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e48f1c-379c-45a6-8269-65881bf92453 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:40.402083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e48f1c-379c-45a6-8269-65881bf92453 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:40.402394 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e48f1c-379c-45a6-8269-65881bf92453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:40.403832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e48f1c-379c-45a6-8269-65881bf92453 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:40.412614 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 120/229] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:38:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:40.418287 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e48f1c-379c-45a6-8269-65881bf92453 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:40.434965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a8b51-a1b4-449b-bc0d-d51d6ce8db15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:40.436142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a8b51-a1b4-449b-bc0d-d51d6ce8db15 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:40.436421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a8b51-a1b4-449b-bc0d-d51d6ce8db15 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:40.436699 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a8b51-a1b4-449b-bc0d-d51d6ce8db15 None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:40.441671 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a8b51-a1b4-449b-bc0d-d51d6ce8db15 None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:40.443119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a8b51-a1b4-449b-bc0d-d51d6ce8db15 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:40.445064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 110/230] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:40 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:40.450303 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a8b51-a1b4-449b-bc0d-d51d6ce8db15 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:40.529441 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e48f1c-379c-45a6-8269-65881bf92453 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:40.565390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055cfcc-f98c-4852-86a7-4c874c07ca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:40.566074 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055cfcc-f98c-4852-86a7-4c874c07ca87 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:40.566365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055cfcc-f98c-4852-86a7-4c874c07ca87 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:40.566646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055cfcc-f98c-4852-86a7-4c874c07ca87 None admin] PATH_INFO: `/v3/users/3b71a625e5e149f6bebf76182a2ca22e` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:40.567793 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055cfcc-f98c-4852-86a7-4c874c07ca87 None admin] RBAC: Authorizing `identity:get_user(user_id=3b71a625e5e149f6bebf76182a2ca22e)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:40.569296 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055cfcc-f98c-4852-86a7-4c874c07ca87 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:40.575563 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 121/231] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:40 2022] GET /identity/v3/users/3b71a625e5e149f6bebf76182a2ca22e => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:40.577904 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055cfcc-f98c-4852-86a7-4c874c07ca87 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:40.591394 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:40.618267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a8b51-a1b4-449b-bc0d-d51d6ce8db15 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:40.637447 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:40.655900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d446729-9e29-4873-b066-9b89d7ff9347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:40.656665 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d446729-9e29-4873-b066-9b89d7ff9347 None admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:40.656954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d446729-9e29-4873-b066-9b89d7ff9347 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:40.657264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d446729-9e29-4873-b066-9b89d7ff9347 None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2/users/3b71a625e5e149f6bebf76182a2ca22e/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:40.659217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d446729-9e29-4873-b066-9b89d7ff9347 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2, user_id=3b71a625e5e149f6bebf76182a2ca22e, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:40.660676 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d446729-9e29-4873-b066-9b89d7ff9347 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:40.691495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055cfcc-f98c-4852-86a7-4c874c07ca87 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:40.695422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 111/232] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:38:40 2022] PUT /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2/users/3b71a625e5e149f6bebf76182a2ca22e/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:38:40.731853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f14ee-ec90-41d5-961d-e6878a2e7f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:40.733066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f14ee-ec90-41d5-961d-e6878a2e7f94 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:40.733361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f14ee-ec90-41d5-961d-e6878a2e7f94 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:40.733641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f14ee-ec90-41d5-961d-e6878a2e7f94 None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:40.734936 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f14ee-ec90-41d5-961d-e6878a2e7f94 None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:40.736582 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f14ee-ec90-41d5-961d-e6878a2e7f94 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:40.738606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 122/233] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:40 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:40.744800 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d446729-9e29-4873-b066-9b89d7ff9347 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:40.887585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d446729-9e29-4873-b066-9b89d7ff9347 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:40.937196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284a56e-9520-4e50-86ac-e48d50f732f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:40.937939 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284a56e-9520-4e50-86ac-e48d50f732f8 None admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:40.938229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284a56e-9520-4e50-86ac-e48d50f732f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:40.938558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284a56e-9520-4e50-86ac-e48d50f732f8 None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2/users/3b71a625e5e149f6bebf76182a2ca22e/roles/222316862a15450198a3b454c14558c4` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:40.941109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284a56e-9520-4e50-86ac-e48d50f732f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2, user_id=3b71a625e5e149f6bebf76182a2ca22e, role_id=222316862a15450198a3b454c14558c4)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:40.942606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284a56e-9520-4e50-86ac-e48d50f732f8 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:40.973931 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 112/234] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:38:40 2022] PUT /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2/users/3b71a625e5e149f6bebf76182a2ca22e/roles/222316862a15450198a3b454c14558c4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:38:41.014567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3e3b-1b3b-4595-abfd-4615ae241a75 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:41.015107 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3e3b-1b3b-4595-abfd-4615ae241a75 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:41.015107 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3e3b-1b3b-4595-abfd-4615ae241a75 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:41.016626 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 123/235] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:41.022712 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7e6cf-7a4b-47a5-bbd7-89af36663a93 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:41.023224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7e6cf-7a4b-47a5-bbd7-89af36663a93 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:41.023328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7e6cf-7a4b-47a5-bbd7-89af36663a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:41.043402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-7de7e6cf-7a4b-47a5-bbd7-89af36663a93 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:41.044694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7de7e6cf-7a4b-47a5-bbd7-89af36663a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:41.079214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:41.128309 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 113/236] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:41.286884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b35af-bd5b-4146-bd6b-4398201b9778 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:41.287260 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b35af-bd5b-4146-bd6b-4398201b9778 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:41.287643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b35af-bd5b-4146-bd6b-4398201b9778 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:41.289349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 124/237] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:41.294680 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f0d94-b943-4721-bb29-52120a03a465 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:41.295583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f0d94-b943-4721-bb29-52120a03a465 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:41.295872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f0d94-b943-4721-bb29-52120a03a465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:41.314249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-871f0d94-b943-4721-bb29-52120a03a465 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:41.315449 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-871f0d94-b943-4721-bb29-52120a03a465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:41.401167 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 114/238] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:41.456515 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b35af-bd5b-4146-bd6b-4398201b9778 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:41.544590 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:41.567536 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b35af-bd5b-4146-bd6b-4398201b9778 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:41.603051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ce4e6-baa1-4647-8bb2-37b587415060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:41.603685 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ce4e6-baa1-4647-8bb2-37b587415060 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:41.603968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ce4e6-baa1-4647-8bb2-37b587415060 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:41.604244 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ce4e6-baa1-4647-8bb2-37b587415060 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:41.614707 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ce4e6-baa1-4647-8bb2-37b587415060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-c38ce4e6-baa1-4647-8bb2-37b587415060 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:41.619858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:41.620741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:41.621595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:41.621595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:41.621595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:41.621595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:41.621595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:41.621595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:41.621595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:41.621595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:41.621595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:41.621595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:41.621595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:41.621595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:41.621595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 125/239] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:41.629052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f0d94-b943-4721-bb29-52120a03a465 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:41.745632 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:41.755180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f0d94-b943-4721-bb29-52120a03a465 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:41.757370 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ce4e6-baa1-4647-8bb2-37b587415060 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:41.817404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a5a26-8a46-4d2e-9638-a5e1b29ac9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:41.817942 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a5a26-8a46-4d2e-9638-a5e1b29ac9d1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:41.818226 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a5a26-8a46-4d2e-9638-a5e1b29ac9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:41.818500 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a5a26-8a46-4d2e-9638-a5e1b29ac9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:41.819174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a5a26-8a46-4d2e-9638-a5e1b29ac9d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:41.819478 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a5a26-8a46-4d2e-9638-a5e1b29ac9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:41.820930 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a5a26-8a46-4d2e-9638-a5e1b29ac9d1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:41.830386 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 115/240] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:41.831593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c77a09-5a34-490a-8c88-d0183a7cf22b None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:41.831996 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c77a09-5a34-490a-8c88-d0183a7cf22b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:41.832315 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c77a09-5a34-490a-8c88-d0183a7cf22b None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:41.833551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 116/241] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:41.838214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c77a09-5a34-490a-8c88-d0183a7cf22b None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:41.865488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ce4e6-baa1-4647-8bb2-37b587415060 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:41.903185 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e513083-cd0f-4d16-8803-3750cbff0ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:41.903926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e513083-cd0f-4d16-8803-3750cbff0ca1 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:41.904241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e513083-cd0f-4d16-8803-3750cbff0ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:41.904558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e513083-cd0f-4d16-8803-3750cbff0ca1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:41.905884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e513083-cd0f-4d16-8803-3750cbff0ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:41.907323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e513083-cd0f-4d16-8803-3750cbff0ca1 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:41.909043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 126/242] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:41.910349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3c0f9-57c4-4020-98c2-f8b3d660616b None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:41.910924 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3c0f9-57c4-4020-98c2-f8b3d660616b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:41.911266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3c0f9-57c4-4020-98c2-f8b3d660616b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:41.929532 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-c8c3c0f9-57c4-4020-98c2-f8b3d660616b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:41.930864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c8c3c0f9-57c4-4020-98c2-f8b3d660616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:41.948574 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:41.951205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c77a09-5a34-490a-8c88-d0183a7cf22b None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:41.990578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50ddd9-35b3-4d9f-9d67-b417bb0cebff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:41.991309 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50ddd9-35b3-4d9f-9d67-b417bb0cebff None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:41.991593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50ddd9-35b3-4d9f-9d67-b417bb0cebff None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:41.991861 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50ddd9-35b3-4d9f-9d67-b417bb0cebff None admin] PATH_INFO: `/v3/users/639a7cbedca3428da0b24effcd9ac882` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:42.007481 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50ddd9-35b3-4d9f-9d67-b417bb0cebff None admin] RBAC: Authorizing `identity:get_user(user_id=639a7cbedca3428da0b24effcd9ac882)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:42.008962 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50ddd9-35b3-4d9f-9d67-b417bb0cebff None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:42.009324 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 127/243] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:42.010252 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3c0f9-57c4-4020-98c2-f8b3d660616b None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:42.015817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 117/244] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:41 2022] GET /identity/v3/users/639a7cbedca3428da0b24effcd9ac882 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:42.016658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50ddd9-35b3-4d9f-9d67-b417bb0cebff None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:42.053159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:42.118883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3c0f9-57c4-4020-98c2-f8b3d660616b None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:42.167278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f29cc4-5904-4c26-857d-69b508120d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:42.167892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f29cc4-5904-4c26-857d-69b508120d44 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:42.168172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f29cc4-5904-4c26-857d-69b508120d44 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:42.168446 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f29cc4-5904-4c26-857d-69b508120d44 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:42.170665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f29cc4-5904-4c26-857d-69b508120d44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:42.173327 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f29cc4-5904-4c26-857d-69b508120d44 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:42.190645 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50ddd9-35b3-4d9f-9d67-b417bb0cebff None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:42.193887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:42.231665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 128/245] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:38:42 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:38:42.235369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053419ce-8f85-41df-807e-84afc3c744ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:42.236083 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053419ce-8f85-41df-807e-84afc3c744ad None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:42.236413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053419ce-8f85-41df-807e-84afc3c744ad None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:42.236701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053419ce-8f85-41df-807e-84afc3c744ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:42.288229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f29cc4-5904-4c26-857d-69b508120d44 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:42.325470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053419ce-8f85-41df-807e-84afc3c744ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:42.328007 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053419ce-8f85-41df-807e-84afc3c744ad None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:42.371902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:42.469679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f29cc4-5904-4c26-857d-69b508120d44 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:42.506758 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 118/246] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:42.508849 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f1b8e-e5e5-46b7-927d-8a42f2d2aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:42.509537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f1b8e-e5e5-46b7-927d-8a42f2d2aca2 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:42.509820 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f1b8e-e5e5-46b7-927d-8a42f2d2aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:42.510097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f1b8e-e5e5-46b7-927d-8a42f2d2aca2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:42.512201 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053419ce-8f85-41df-807e-84afc3c744ad None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:42.521682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f1b8e-e5e5-46b7-927d-8a42f2d2aca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-9b3f1b8e-e5e5-46b7-927d-8a42f2d2aca2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:42.528551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:42.530174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:42.531641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:42.531641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:42.531641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:42.531641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:42.531641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:42.531641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:42.531641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:42.531641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:42.531641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:42.531641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:42.531641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:42.531641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:42.531641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 129/247] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:38:42.536271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f1b8e-e5e5-46b7-927d-8a42f2d2aca2 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:42.590770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:42.635411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053419ce-8f85-41df-807e-84afc3c744ad None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:42.641382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f1b8e-e5e5-46b7-927d-8a42f2d2aca2 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:42.656314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:42.676751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2e871-7c30-4e13-be69-bba235accbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:42.677983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2e871-7c30-4e13-be69-bba235accbc8 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:42.678578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2e871-7c30-4e13-be69-bba235accbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:42.679059 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2e871-7c30-4e13-be69-bba235accbc8 None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:42.679186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ec65e-264d-4afb-a1be-2a4e1669c624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:42.679742 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ec65e-264d-4afb-a1be-2a4e1669c624 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:42.680024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ec65e-264d-4afb-a1be-2a4e1669c624 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:42.680309 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ec65e-264d-4afb-a1be-2a4e1669c624 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:42.680959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ec65e-264d-4afb-a1be-2a4e1669c624 None admin] RBAC: Adding query filter params (name=member) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:42.681316 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ec65e-264d-4afb-a1be-2a4e1669c624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:42.681569 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2e871-7c30-4e13-be69-bba235accbc8 None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:42.682705 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ec65e-264d-4afb-a1be-2a4e1669c624 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:42.683417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2e871-7c30-4e13-be69-bba235accbc8 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:42.686040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 119/248] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:42 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:42.691873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2e871-7c30-4e13-be69-bba235accbc8 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:42.692248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 130/249] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:42.697749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ec65e-264d-4afb-a1be-2a4e1669c624 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:42.825771 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2e871-7c30-4e13-be69-bba235accbc8 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:42.837678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ec65e-264d-4afb-a1be-2a4e1669c624 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:42.856484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:42.870137 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529fc46-dfdb-4a1d-ab23-4a26d6397f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:42.870872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529fc46-dfdb-4a1d-ab23-4a26d6397f32 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:42.871228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529fc46-dfdb-4a1d-ab23-4a26d6397f32 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:42.871576 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529fc46-dfdb-4a1d-ab23-4a26d6397f32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:42.872384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529fc46-dfdb-4a1d-ab23-4a26d6397f32 None admin] RBAC: Adding query filter params (role.id=2837b7fc2f2d4636bbdb0b4b8ccba069, scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2, user.id=639a7cbedca3428da0b24effcd9ac882) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:42.872770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529fc46-dfdb-4a1d-ab23-4a26d6397f32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:42.875772 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529fc46-dfdb-4a1d-ab23-4a26d6397f32 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:42.881928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 120/250] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:42 2022] GET /identity/v3/role_assignments?user.id=639a7cbedca3428da0b24effcd9ac882&scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2&role.id=2837b7fc2f2d4636bbdb0b4b8ccba069 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:42.887120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd68d6-43d4-40ce-92e7-d8d88cce770f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:42.888075 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd68d6-43d4-40ce-92e7-d8d88cce770f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:42.888658 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd68d6-43d4-40ce-92e7-d8d88cce770f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:42.889677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd68d6-43d4-40ce-92e7-d8d88cce770f None admin] PATH_INFO: `/v3/users/92f30348c46e4049a0e7a7e8d374a6a6` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:42.891239 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd68d6-43d4-40ce-92e7-d8d88cce770f None admin] RBAC: Authorizing `identity:get_user(user_id=92f30348c46e4049a0e7a7e8d374a6a6)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:42.894472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd68d6-43d4-40ce-92e7-d8d88cce770f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:42.897896 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 131/251] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:42 2022] GET /identity/v3/users/92f30348c46e4049a0e7a7e8d374a6a6 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:42.903703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529fc46-dfdb-4a1d-ab23-4a26d6397f32 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:42.969795 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:43.028085 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529fc46-dfdb-4a1d-ab23-4a26d6397f32 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:43.066495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ba8e3-1b0c-4dc5-af81-5198f596e0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:43.067141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ba8e3-1b0c-4dc5-af81-5198f596e0cd None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:43.067402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ba8e3-1b0c-4dc5-af81-5198f596e0cd None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:43.067675 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ba8e3-1b0c-4dc5-af81-5198f596e0cd None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:43.068840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ba8e3-1b0c-4dc5-af81-5198f596e0cd None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:43.070318 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ba8e3-1b0c-4dc5-af81-5198f596e0cd None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:43.072236 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 121/252] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:42 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:43.078692 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd68d6-43d4-40ce-92e7-d8d88cce770f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:43.214443 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd68d6-43d4-40ce-92e7-d8d88cce770f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:43.257796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02acca-acd4-4193-8469-c8b4a0ae48b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:43.258757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02acca-acd4-4193-8469-c8b4a0ae48b9 None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:43.259236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02acca-acd4-4193-8469-c8b4a0ae48b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:43.259684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02acca-acd4-4193-8469-c8b4a0ae48b9 None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2/users/92f30348c46e4049a0e7a7e8d374a6a6/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:43.266285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02acca-acd4-4193-8469-c8b4a0ae48b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2, user_id=92f30348c46e4049a0e7a7e8d374a6a6, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:43.267917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02acca-acd4-4193-8469-c8b4a0ae48b9 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:43.302873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 132/253] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:38:43 2022] PUT /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2/users/92f30348c46e4049a0e7a7e8d374a6a6/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:38:43.366983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc3870-147d-476d-986b-6eb1fddfc917 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:43.367624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc3870-147d-476d-986b-6eb1fddfc917 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:43.368095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc3870-147d-476d-986b-6eb1fddfc917 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:43.369978 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 122/254] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:43.375334 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bec2f-541c-48a8-992f-cca0b0df9440 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:43.375878 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bec2f-541c-48a8-992f-cca0b0df9440 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:43.376344 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bec2f-541c-48a8-992f-cca0b0df9440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:43.397860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-283bec2f-541c-48a8-992f-cca0b0df9440 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:43.399404 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-283bec2f-541c-48a8-992f-cca0b0df9440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:43.417333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f8be5-f10b-47d8-afb5-c7a6bc063929 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:43.417692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f8be5-f10b-47d8-afb5-c7a6bc063929 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:43.417925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f8be5-f10b-47d8-afb5-c7a6bc063929 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:43.419581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 123/255] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:43.428295 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b74292-98cd-4176-b32a-e0fe0e997abb None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:43.428634 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b74292-98cd-4176-b32a-e0fe0e997abb None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:43.428862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b74292-98cd-4176-b32a-e0fe0e997abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:43.456639 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:43.467364 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-f2b74292-98cd-4176-b32a-e0fe0e997abb None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:43.467872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-f2b74292-98cd-4176-b32a-e0fe0e997abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:43.516688 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 133/256] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:43.599543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 124/257] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:43.850047 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bec2f-541c-48a8-992f-cca0b0df9440 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:43.971633 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bec2f-541c-48a8-992f-cca0b0df9440 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:44.021673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264f654-1b50-4e69-bf47-3dd173c2934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:44.022710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264f654-1b50-4e69-bf47-3dd173c2934c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:44.023214 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264f654-1b50-4e69-bf47-3dd173c2934c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:44.023676 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264f654-1b50-4e69-bf47-3dd173c2934c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:44.037504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264f654-1b50-4e69-bf47-3dd173c2934c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-f264f654-1b50-4e69-bf47-3dd173c2934c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:44.042423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:44.043290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:44.044076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:44.044076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:44.044076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:44.044076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:44.044076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:44.044076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:44.044076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:44.044076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:44.044076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:44.044076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:44.044076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:44.044076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:44.046393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 134/258] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:38:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:44.052332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b74292-98cd-4176-b32a-e0fe0e997abb None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:44.105310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:44.154197 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264f654-1b50-4e69-bf47-3dd173c2934c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:44.172778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b74292-98cd-4176-b32a-e0fe0e997abb None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:44.222624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dbeb7-06c0-4b35-a1a1-835b6a048ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:44.223612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dbeb7-06c0-4b35-a1a1-835b6a048ff8 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:44.224088 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dbeb7-06c0-4b35-a1a1-835b6a048ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:44.224551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dbeb7-06c0-4b35-a1a1-835b6a048ff8 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:44.225458 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dbeb7-06c0-4b35-a1a1-835b6a048ff8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:44.225969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dbeb7-06c0-4b35-a1a1-835b6a048ff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:44.227617 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dbeb7-06c0-4b35-a1a1-835b6a048ff8 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:44.241048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 125/259] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:44.247557 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dbeb7-06c0-4b35-a1a1-835b6a048ff8 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:44.255045 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:44.427972 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dbeb7-06c0-4b35-a1a1-835b6a048ff8 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:44.431129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264f654-1b50-4e69-bf47-3dd173c2934c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:44.446585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:44.493836 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cf95a-ba75-4a86-8b90-9c092449f48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:44.495017 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cf95a-ba75-4a86-8b90-9c092449f48d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:44.495590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cf95a-ba75-4a86-8b90-9c092449f48d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:44.495872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cf95a-ba75-4a86-8b90-9c092449f48d None admin] PATH_INFO: `/v3/users/3b71a625e5e149f6bebf76182a2ca22e` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:44.497279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cf95a-ba75-4a86-8b90-9c092449f48d None admin] RBAC: Authorizing `identity:get_user(user_id=3b71a625e5e149f6bebf76182a2ca22e)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:44.499316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cf95a-ba75-4a86-8b90-9c092449f48d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:44.501082 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 126/260] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:44 2022] GET /identity/v3/users/3b71a625e5e149f6bebf76182a2ca22e => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:44.508312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cf95a-ba75-4a86-8b90-9c092449f48d None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:44.515536 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b78491-a463-493f-a56b-62ba3f4ae98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:44.516180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b78491-a463-493f-a56b-62ba3f4ae98f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:44.516460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b78491-a463-493f-a56b-62ba3f4ae98f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:44.516732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b78491-a463-493f-a56b-62ba3f4ae98f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:44.549721 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b78491-a463-493f-a56b-62ba3f4ae98f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-e8b78491-a463-493f-a56b-62ba3f4ae98f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:44.554518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:44.555391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:44.556186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:44.556186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:44.556186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:44.556186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:44.556186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:44.556186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:44.556186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:44.556186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:44.556186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:44.556186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:44.556186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:44.556186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:44.556186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 135/261] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:38:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:38:44.561818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b78491-a463-493f-a56b-62ba3f4ae98f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:44.693202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b78491-a463-493f-a56b-62ba3f4ae98f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:44.705440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:44.719938 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cf95a-ba75-4a86-8b90-9c092449f48d None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:44.733573 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9228bf-ddf6-488e-9eac-47033e9fc3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:44.734189 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9228bf-ddf6-488e-9eac-47033e9fc3a2 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:44.734469 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9228bf-ddf6-488e-9eac-47033e9fc3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:44.734744 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9228bf-ddf6-488e-9eac-47033e9fc3a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:44.735416 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9228bf-ddf6-488e-9eac-47033e9fc3a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:44.735721 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9228bf-ddf6-488e-9eac-47033e9fc3a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:44.737140 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9228bf-ddf6-488e-9eac-47033e9fc3a2 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:44.756399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 136/262] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:38:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:44.765471 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9228bf-ddf6-488e-9eac-47033e9fc3a2 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:44.795975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a989f-93e6-4150-964d-846e9c5b4aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:44.796596 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a989f-93e6-4150-964d-846e9c5b4aef None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:44.796885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a989f-93e6-4150-964d-846e9c5b4aef None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:44.797193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a989f-93e6-4150-964d-846e9c5b4aef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:44.930093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:44.931572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9228bf-ddf6-488e-9eac-47033e9fc3a2 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:44.969698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904827da-24f7-4f37-881d-49d43b047db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:44.970251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904827da-24f7-4f37-881d-49d43b047db4 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:44.970539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904827da-24f7-4f37-881d-49d43b047db4 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:44.970815 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904827da-24f7-4f37-881d-49d43b047db4 None admin] PATH_INFO: `/v3/users/3b71a625e5e149f6bebf76182a2ca22e` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:44.971944 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904827da-24f7-4f37-881d-49d43b047db4 None admin] RBAC: Authorizing `identity:get_user(user_id=3b71a625e5e149f6bebf76182a2ca22e)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:44.973952 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904827da-24f7-4f37-881d-49d43b047db4 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:44.976007 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 137/263] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:44 2022] GET /identity/v3/users/3b71a625e5e149f6bebf76182a2ca22e => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:44.982115 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904827da-24f7-4f37-881d-49d43b047db4 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:44.985123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a989f-93e6-4150-964d-846e9c5b4aef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:44.987052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a989f-93e6-4150-964d-846e9c5b4aef None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:45.025355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:45.170670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904827da-24f7-4f37-881d-49d43b047db4 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:45.205501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838f81f-6728-4a70-9392-03d161eca1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:45.206407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838f81f-6728-4a70-9392-03d161eca1c4 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:45.206696 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838f81f-6728-4a70-9392-03d161eca1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:45.206967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838f81f-6728-4a70-9392-03d161eca1c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:45.256003 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 127/264] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 08:38:45.262150 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a989f-93e6-4150-964d-846e9c5b4aef None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:45.330025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838f81f-6728-4a70-9392-03d161eca1c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:45.332216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838f81f-6728-4a70-9392-03d161eca1c4 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:45.405361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:45.464955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:45.512876 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a989f-93e6-4150-964d-846e9c5b4aef None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:45.550302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 138/265] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:45.555464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2dd2b-763d-4416-bfac-bae2c543d1b6 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:45.555753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2dd2b-763d-4416-bfac-bae2c543d1b6 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:45.556031 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2dd2b-763d-4416-bfac-bae2c543d1b6 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:45.557500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 139/266] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:38:45.559929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2dd2b-763d-4416-bfac-bae2c543d1b6 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:45.575203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f8e68-f8e0-437e-a5a4-41bda501f22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:45.575848 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f8e68-f8e0-437e-a5a4-41bda501f22d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:45.576167 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f8e68-f8e0-437e-a5a4-41bda501f22d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:45.576446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f8e68-f8e0-437e-a5a4-41bda501f22d None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:45.577612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f8e68-f8e0-437e-a5a4-41bda501f22d None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:45.579126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f8e68-f8e0-437e-a5a4-41bda501f22d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:45.584898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 128/267] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:45 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:45.584898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491a37f-a6d4-49c7-b594-9f719bd74e3e None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:45.584898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491a37f-a6d4-49c7-b594-9f719bd74e3e None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:45.584898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491a37f-a6d4-49c7-b594-9f719bd74e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:45.607973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-1491a37f-a6d4-49c7-b594-9f719bd74e3e None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:45.609511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1491a37f-a6d4-49c7-b594-9f719bd74e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:45.698775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 129/268] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:45.701454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491a37f-a6d4-49c7-b594-9f719bd74e3e None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:45.729387 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2dd2b-763d-4416-bfac-bae2c543d1b6 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:45.775257 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:45.806631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdda761-9616-45bb-82f9-6831c72c2e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:45.807291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdda761-9616-45bb-82f9-6831c72c2e0b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:45.807575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdda761-9616-45bb-82f9-6831c72c2e0b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:45.807853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdda761-9616-45bb-82f9-6831c72c2e0b None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:45.809021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdda761-9616-45bb-82f9-6831c72c2e0b None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:45.810514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdda761-9616-45bb-82f9-6831c72c2e0b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:45.812329 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 140/269] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:45 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:45.821367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:45.823169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48c877-34b3-4fb6-9108-7205ce03a69e None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:45.823454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48c877-34b3-4fb6-9108-7205ce03a69e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:45.823728 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48c877-34b3-4fb6-9108-7205ce03a69e None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:45.825079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 141/270] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:45 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:45.825781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48c877-34b3-4fb6-9108-7205ce03a69e None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:45.853020 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491a37f-a6d4-49c7-b594-9f719bd74e3e None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:45.902903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfb9b8-8f45-47c6-a666-aa4d44d8b552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:45.903526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfb9b8-8f45-47c6-a666-aa4d44d8b552 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:45.903865 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfb9b8-8f45-47c6-a666-aa4d44d8b552 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:45.904688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfb9b8-8f45-47c6-a666-aa4d44d8b552 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:45.905470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cfb9b8-8f45-47c6-a666-aa4d44d8b552 None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2, user.id=3b71a625e5e149f6bebf76182a2ca22e) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:45.905784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cfb9b8-8f45-47c6-a666-aa4d44d8b552 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:45.907296 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cfb9b8-8f45-47c6-a666-aa4d44d8b552 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:45.913457 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 130/271] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:45 2022] GET /identity/v3/role_assignments?user.id=3b71a625e5e149f6bebf76182a2ca22e&scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:45.922570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2042a74-ad0c-4b41-9a39-03493581812c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:45.922866 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2042a74-ad0c-4b41-9a39-03493581812c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:45.923133 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2042a74-ad0c-4b41-9a39-03493581812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:45.938714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48c877-34b3-4fb6-9108-7205ce03a69e None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:45.954621 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-f2042a74-ad0c-4b41-9a39-03493581812c None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:45.956725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-f2042a74-ad0c-4b41-9a39-03493581812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:45.986365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe66bd-66a9-4751-b5db-9c1e2a325d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:45.987055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe66bd-66a9-4751-b5db-9c1e2a325d77 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:45.987334 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe66bd-66a9-4751-b5db-9c1e2a325d77 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:45.987611 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe66bd-66a9-4751-b5db-9c1e2a325d77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:45.988369 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe66bd-66a9-4751-b5db-9c1e2a325d77 None admin] RBAC: Adding query filter params (role.id=222316862a15450198a3b454c14558c4, scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2, user.id=3b71a625e5e149f6bebf76182a2ca22e) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:45.988678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe66bd-66a9-4751-b5db-9c1e2a325d77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:45.990295 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe66bd-66a9-4751-b5db-9c1e2a325d77 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:45.997297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 142/272] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:45 2022] GET /identity/v3/role_assignments?user.id=3b71a625e5e149f6bebf76182a2ca22e&scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2&role.id=222316862a15450198a3b454c14558c4 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:45.998597 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abba5c4-5444-47fb-ae53-0e94b8f70433 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:45.998881 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abba5c4-5444-47fb-ae53-0e94b8f70433 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:45.999152 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abba5c4-5444-47fb-ae53-0e94b8f70433 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:46.000349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 143/273] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:46.006015 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2471c-543e-43e9-996c-2a209da84bce None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:46.006299 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2471c-543e-43e9-996c-2a209da84bce None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:46.006570 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2471c-543e-43e9-996c-2a209da84bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:46.027303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-e6b2471c-543e-43e9-996c-2a209da84bce None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:46.028429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e6b2471c-543e-43e9-996c-2a209da84bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:46.086959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:46.108567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 144/274] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:46.117780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2471c-543e-43e9-996c-2a209da84bce None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:46.129787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 131/275] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:46.259942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2471c-543e-43e9-996c-2a209da84bce None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:46.273026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554802cf-776e-4b2b-a0cd-860ffb29f6cd None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:46.273516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554802cf-776e-4b2b-a0cd-860ffb29f6cd None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:46.273591 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554802cf-776e-4b2b-a0cd-860ffb29f6cd None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:46.276617 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 132/276] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:46.284170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda09507-e0ec-4078-b353-7dc7586c25e4 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:46.284394 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda09507-e0ec-4078-b353-7dc7586c25e4 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:46.284743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda09507-e0ec-4078-b353-7dc7586c25e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:46.304613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c817ba9-dc93-446f-b753-b54ef53de547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:46.305979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c817ba9-dc93-446f-b753-b54ef53de547 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:46.307599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c817ba9-dc93-446f-b753-b54ef53de547 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:46.308049 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c817ba9-dc93-446f-b753-b54ef53de547 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:46.314008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-bda09507-e0ec-4078-b353-7dc7586c25e4 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:46.315222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-bda09507-e0ec-4078-b353-7dc7586c25e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:46.324662 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c817ba9-dc93-446f-b753-b54ef53de547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-9c817ba9-dc93-446f-b753-b54ef53de547 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:46.332005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:46.333567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:46.334637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:46.334637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:46.334637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:46.334637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:46.334637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:46.334637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:46.334637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:46.334637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:46.334637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:46.334637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:46.334637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:46.334637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:46.341503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 145/277] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:46.343774 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c817ba9-dc93-446f-b753-b54ef53de547 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:46.411142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:46.422768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:46.430145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 133/278] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:46.489736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c817ba9-dc93-446f-b753-b54ef53de547 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:46.499462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda09507-e0ec-4078-b353-7dc7586c25e4 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:46.530408 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53c470-0e58-4d5b-a5b5-365557c7165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:46.531021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53c470-0e58-4d5b-a5b5-365557c7165b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:46.531304 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53c470-0e58-4d5b-a5b5-365557c7165b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:46.531578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53c470-0e58-4d5b-a5b5-365557c7165b None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:46.532243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53c470-0e58-4d5b-a5b5-365557c7165b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:46.532549 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53c470-0e58-4d5b-a5b5-365557c7165b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:46.533969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53c470-0e58-4d5b-a5b5-365557c7165b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:46.542363 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 146/279] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:46.543035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53c470-0e58-4d5b-a5b5-365557c7165b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:46.610543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda09507-e0ec-4078-b353-7dc7586c25e4 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:46.647028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2a1a0-5aa0-400e-9bb7-cc74376bda8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:46.647945 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2a1a0-5aa0-400e-9bb7-cc74376bda8f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:46.648430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2a1a0-5aa0-400e-9bb7-cc74376bda8f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:46.648914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2a1a0-5aa0-400e-9bb7-cc74376bda8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:46.650227 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2a1a0-5aa0-400e-9bb7-cc74376bda8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:46.651837 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2a1a0-5aa0-400e-9bb7-cc74376bda8f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:46.653941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 134/280] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:46.655005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2a1a0-5aa0-400e-9bb7-cc74376bda8f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:46.661825 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53c470-0e58-4d5b-a5b5-365557c7165b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:46.671633 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:46.703341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be0ff0-325b-4cd6-a335-bb18808722de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:46.703998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be0ff0-325b-4cd6-a335-bb18808722de None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:46.704283 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be0ff0-325b-4cd6-a335-bb18808722de None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:46.704560 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be0ff0-325b-4cd6-a335-bb18808722de None admin] PATH_INFO: `/v3/roles/member` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:46.715910 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be0ff0-325b-4cd6-a335-bb18808722de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-18be0ff0-325b-4cd6-a335-bb18808722de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:46.721134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:46.721998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:46.722777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:46.722777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:46.722777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:46.722777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:46.722777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:46.722777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:46.722777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:46.722777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:46.722777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:46.722777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:46.722777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:46.722777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:46.722777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 147/281] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:46.723430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be0ff0-325b-4cd6-a335-bb18808722de None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:46.725603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:46.761815 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2a1a0-5aa0-400e-9bb7-cc74376bda8f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:46.795276 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9333d-0e29-4f05-bbdf-72aad9430cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:46.795839 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9333d-0e29-4f05-bbdf-72aad9430cff None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:46.796121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9333d-0e29-4f05-bbdf-72aad9430cff None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:46.796394 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9333d-0e29-4f05-bbdf-72aad9430cff None admin] PATH_INFO: `/v3/users/639a7cbedca3428da0b24effcd9ac882` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:46.797540 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9333d-0e29-4f05-bbdf-72aad9430cff None admin] RBAC: Authorizing `identity:get_user(user_id=639a7cbedca3428da0b24effcd9ac882)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:46.798976 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9333d-0e29-4f05-bbdf-72aad9430cff None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:46.800529 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 135/282] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:46 2022] GET /identity/v3/users/639a7cbedca3428da0b24effcd9ac882 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:46.801345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9333d-0e29-4f05-bbdf-72aad9430cff None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:46.823085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be0ff0-325b-4cd6-a335-bb18808722de None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:46.855527 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdba97b-64f5-43f5-840a-f2dd82d85c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:46.856128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdba97b-64f5-43f5-840a-f2dd82d85c96 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:46.856405 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdba97b-64f5-43f5-840a-f2dd82d85c96 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:46.856680 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdba97b-64f5-43f5-840a-f2dd82d85c96 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:46.857871 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdba97b-64f5-43f5-840a-f2dd82d85c96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:46.859320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdba97b-64f5-43f5-840a-f2dd82d85c96 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:46.880889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 148/283] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:38:46 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:38:46.881499 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdba97b-64f5-43f5-840a-f2dd82d85c96 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:46.909456 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:46.911699 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9333d-0e29-4f05-bbdf-72aad9430cff None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:46.954554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655db63-c0a3-417b-88f7-9e1949a726c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:46.955299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655db63-c0a3-417b-88f7-9e1949a726c6 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:46.955648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655db63-c0a3-417b-88f7-9e1949a726c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:46.955935 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655db63-c0a3-417b-88f7-9e1949a726c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:46.956625 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655db63-c0a3-417b-88f7-9e1949a726c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:46.956934 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655db63-c0a3-417b-88f7-9e1949a726c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:46.958394 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655db63-c0a3-417b-88f7-9e1949a726c6 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:46.961600 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:46.973376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 136/284] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:46.976473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655db63-c0a3-417b-88f7-9e1949a726c6 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:47.003344 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdba97b-64f5-43f5-840a-f2dd82d85c96 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:47.042982 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a514f61-95a7-4bc5-8fe6-52aec9277038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:47.045617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a514f61-95a7-4bc5-8fe6-52aec9277038 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:47.045841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a514f61-95a7-4bc5-8fe6-52aec9277038 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:47.046116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a514f61-95a7-4bc5-8fe6-52aec9277038 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:47.059434 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a514f61-95a7-4bc5-8fe6-52aec9277038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-0a514f61-95a7-4bc5-8fe6-52aec9277038 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:47.064017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:47.064921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:47.065754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:47.065754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:47.065754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:47.065754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:47.065754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:47.065754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:47.065754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:47.065754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:47.065754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:47.065754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:47.065754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:47.065754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:47.065754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 149/285] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:47.066418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a514f61-95a7-4bc5-8fe6-52aec9277038 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:47.103865 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655db63-c0a3-417b-88f7-9e1949a726c6 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:47.145189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566a176-a75d-4018-9a1d-5a6ee94fd9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:47.146228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566a176-a75d-4018-9a1d-5a6ee94fd9eb None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:47.146710 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566a176-a75d-4018-9a1d-5a6ee94fd9eb None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:47.147207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566a176-a75d-4018-9a1d-5a6ee94fd9eb None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:47.148667 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566a176-a75d-4018-9a1d-5a6ee94fd9eb None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:47.150519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566a176-a75d-4018-9a1d-5a6ee94fd9eb None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:47.153527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 137/286] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:46 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:47.155109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566a176-a75d-4018-9a1d-5a6ee94fd9eb None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:47.164070 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:47.190723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a514f61-95a7-4bc5-8fe6-52aec9277038 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:47.240318 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed753c-0c6a-45fb-b69c-bc55ca0baa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:47.240972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed753c-0c6a-45fb-b69c-bc55ca0baa21 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:47.241291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed753c-0c6a-45fb-b69c-bc55ca0baa21 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:47.241716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed753c-0c6a-45fb-b69c-bc55ca0baa21 None admin] PATH_INFO: `/v3/users/80ab60b0b37a43c7944a6e058920d809` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:47.256641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed753c-0c6a-45fb-b69c-bc55ca0baa21 None admin] RBAC: Authorizing `identity:get_user(user_id=80ab60b0b37a43c7944a6e058920d809)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:47.258164 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed753c-0c6a-45fb-b69c-bc55ca0baa21 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:47.259834 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 150/287] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:47 2022] GET /identity/v3/users/80ab60b0b37a43c7944a6e058920d809 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:47.260583 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed753c-0c6a-45fb-b69c-bc55ca0baa21 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:47.290054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566a176-a75d-4018-9a1d-5a6ee94fd9eb None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:47.293303 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:47.328715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464caf57-2e15-4e5d-ac28-9d7cc3753f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:47.329886 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464caf57-2e15-4e5d-ac28-9d7cc3753f17 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:47.330384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464caf57-2e15-4e5d-ac28-9d7cc3753f17 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:47.330851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464caf57-2e15-4e5d-ac28-9d7cc3753f17 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:47.331867 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464caf57-2e15-4e5d-ac28-9d7cc3753f17 None admin] RBAC: Adding query filter params (name=member) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:47.332369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464caf57-2e15-4e5d-ac28-9d7cc3753f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:47.334162 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464caf57-2e15-4e5d-ac28-9d7cc3753f17 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:47.344250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 138/288] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:47.350205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464caf57-2e15-4e5d-ac28-9d7cc3753f17 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:47.365971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed753c-0c6a-45fb-b69c-bc55ca0baa21 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:47.405625 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fefed-448b-4b2e-b0da-3f1da76b7407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:47.406294 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fefed-448b-4b2e-b0da-3f1da76b7407 None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:47.406574 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fefed-448b-4b2e-b0da-3f1da76b7407 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:47.406847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fefed-448b-4b2e-b0da-3f1da76b7407 None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2/users/639a7cbedca3428da0b24effcd9ac882/roles/2837b7fc2f2d4636bbdb0b4b8ccba069` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:47.408873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fefed-448b-4b2e-b0da-3f1da76b7407 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2, user_id=639a7cbedca3428da0b24effcd9ac882, role_id=2837b7fc2f2d4636bbdb0b4b8ccba069)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:47.410379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fefed-448b-4b2e-b0da-3f1da76b7407 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:47.421755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:47.426751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 151/289] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:38:47 2022] PUT /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2/users/639a7cbedca3428da0b24effcd9ac882/roles/2837b7fc2f2d4636bbdb0b4b8ccba069 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:38:47.427663 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fefed-448b-4b2e-b0da-3f1da76b7407 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:47.474774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464caf57-2e15-4e5d-ac28-9d7cc3753f17 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:47.505093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:47.514920 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5e928-ae37-4ab2-a5ea-bbf73a3cbd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:47.516406 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5e928-ae37-4ab2-a5ea-bbf73a3cbd32 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:47.516406 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5e928-ae37-4ab2-a5ea-bbf73a3cbd32 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:47.516699 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5e928-ae37-4ab2-a5ea-bbf73a3cbd32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:47.517793 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5e928-ae37-4ab2-a5ea-bbf73a3cbd32 None admin] RBAC: Adding query filter params (role.id=6a5e7cb9300845e4b60b696aa66f4219, user.id=80ab60b0b37a43c7944a6e058920d809, scope.system=all) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:47.518205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5e928-ae37-4ab2-a5ea-bbf73a3cbd32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:47.519805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5e928-ae37-4ab2-a5ea-bbf73a3cbd32 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:47.526114 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 139/290] 10.222.0.76 () {56 vars in 1308 bytes} [Fri Aug 26 08:38:47 2022] GET /identity/v3/role_assignments?user.id=80ab60b0b37a43c7944a6e058920d809&scope.system=all&role.id=6a5e7cb9300845e4b60b696aa66f4219 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:47.556550 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fefed-448b-4b2e-b0da-3f1da76b7407 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:47.598127 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6709ccb-8497-4ebd-bc18-2595c5ff6d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:47.599041 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6709ccb-8497-4ebd-bc18-2595c5ff6d99 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:47.599473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6709ccb-8497-4ebd-bc18-2595c5ff6d99 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:47.599917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6709ccb-8497-4ebd-bc18-2595c5ff6d99 None admin] PATH_INFO: `/v3/users/92f30348c46e4049a0e7a7e8d374a6a6` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:47.601363 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6709ccb-8497-4ebd-bc18-2595c5ff6d99 None admin] RBAC: Authorizing `identity:get_user(user_id=92f30348c46e4049a0e7a7e8d374a6a6)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:47.603055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6709ccb-8497-4ebd-bc18-2595c5ff6d99 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:47.605197 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 152/291] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:47 2022] GET /identity/v3/users/92f30348c46e4049a0e7a7e8d374a6a6 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:47.612323 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5e928-ae37-4ab2-a5ea-bbf73a3cbd32 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:47.742533 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5e928-ae37-4ab2-a5ea-bbf73a3cbd32 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:47.777744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865c573-0164-4952-b5dc-b69424420190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:47.778359 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865c573-0164-4952-b5dc-b69424420190 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:47.778642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865c573-0164-4952-b5dc-b69424420190 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:47.778915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865c573-0164-4952-b5dc-b69424420190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:47.847980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:47.859966 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865c573-0164-4952-b5dc-b69424420190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:47.861372 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865c573-0164-4952-b5dc-b69424420190 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:48.000722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 140/292] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:48.006436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6709ccb-8497-4ebd-bc18-2595c5ff6d99 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:48.100243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:48.145881 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6709ccb-8497-4ebd-bc18-2595c5ff6d99 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:48.196435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0377d9-03b5-4a2f-8b8d-c621ad7f29fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:48.197095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0377d9-03b5-4a2f-8b8d-c621ad7f29fb None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:48.197385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0377d9-03b5-4a2f-8b8d-c621ad7f29fb None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:48.197663 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0377d9-03b5-4a2f-8b8d-c621ad7f29fb None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:48.198810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0377d9-03b5-4a2f-8b8d-c621ad7f29fb None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:48.200252 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0377d9-03b5-4a2f-8b8d-c621ad7f29fb None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:48.202123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 153/293] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:48 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:48.207969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865c573-0164-4952-b5dc-b69424420190 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:48.346378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:48.356247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865c573-0164-4952-b5dc-b69424420190 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:48.397374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d6ea8-d7ee-4460-9d62-0f843423ccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:48.397911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d6ea8-d7ee-4460-9d62-0f843423ccbd None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:48.398188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d6ea8-d7ee-4460-9d62-0f843423ccbd None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:48.398460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d6ea8-d7ee-4460-9d62-0f843423ccbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:48.399249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d6ea8-d7ee-4460-9d62-0f843423ccbd None admin] RBAC: Adding query filter params (role.id=6a5e7cb9300845e4b60b696aa66f4219, scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2, user.id=92f30348c46e4049a0e7a7e8d374a6a6) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:48.399555 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d6ea8-d7ee-4460-9d62-0f843423ccbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:48.401067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d6ea8-d7ee-4460-9d62-0f843423ccbd None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:48.407812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 141/294] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:48 2022] GET /identity/v3/role_assignments?user.id=92f30348c46e4049a0e7a7e8d374a6a6&scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2&role.id=6a5e7cb9300845e4b60b696aa66f4219 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:49.262922 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee23612-06ba-42f8-987a-a9abab1bb61e None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:49.263985 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee23612-06ba-42f8-987a-a9abab1bb61e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:49.264065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee23612-06ba-42f8-987a-a9abab1bb61e None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:49.265629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 154/295] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:49.271274 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e2d54-8a92-4c25-b9cc-3a9db373c162 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:49.271572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e2d54-8a92-4c25-b9cc-3a9db373c162 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:49.271848 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e2d54-8a92-4c25-b9cc-3a9db373c162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:49.295859 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-0a7e2d54-8a92-4c25-b9cc-3a9db373c162 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:49.297357 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0a7e2d54-8a92-4c25-b9cc-3a9db373c162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:49.368109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 142/296] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:49.527635 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd200fce-f83d-44d5-bacc-818f991b7a98 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:49.527635 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd200fce-f83d-44d5-bacc-818f991b7a98 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:49.527635 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd200fce-f83d-44d5-bacc-818f991b7a98 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:49.528240 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 155/297] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:49.533706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f54e6-9c0d-4a0e-b2c6-3684111b3647 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:49.534233 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f54e6-9c0d-4a0e-b2c6-3684111b3647 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:49.534730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f54e6-9c0d-4a0e-b2c6-3684111b3647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:49.552908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-a44f54e6-9c0d-4a0e-b2c6-3684111b3647 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:49.554484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a44f54e6-9c0d-4a0e-b2c6-3684111b3647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:49.625301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 143/298] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:49.637822 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd200fce-f83d-44d5-bacc-818f991b7a98 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:49.743251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd200fce-f83d-44d5-bacc-818f991b7a98 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:49.749061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb37554-4442-4cf8-8235-8e4d753d8fc0 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:49.749607 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb37554-4442-4cf8-8235-8e4d753d8fc0 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:49.750091 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb37554-4442-4cf8-8235-8e4d753d8fc0 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:49.751656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 144/299] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:38:49.756814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ae975-5541-4349-9686-8c5bf5fe0827 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:49.757351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ae975-5541-4349-9686-8c5bf5fe0827 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:49.757837 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ae975-5541-4349-9686-8c5bf5fe0827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:49.778845 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-fc1ae975-5541-4349-9686-8c5bf5fe0827 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:49.779046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a48de-7d0f-4319-ba6f-bbc75f120c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:49.779441 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a48de-7d0f-4319-ba6f-bbc75f120c56 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:49.779713 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a48de-7d0f-4319-ba6f-bbc75f120c56 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:49.779987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a48de-7d0f-4319-ba6f-bbc75f120c56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:49.781254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-fc1ae975-5541-4349-9686-8c5bf5fe0827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:49.782990 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:49.791928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a48de-7d0f-4319-ba6f-bbc75f120c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-d29a48de-7d0f-4319-ba6f-bbc75f120c56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:49.797615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:49.798517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:49.799720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:49.799720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:49.799720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:49.799720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:49.799720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:49.799720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:49.799720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:49.799720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:49.799720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:49.799720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:49.799720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:49.799720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:49.799720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 156/300] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:49.804641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a48de-7d0f-4319-ba6f-bbc75f120c56 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:49.805353 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:49.882925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 145/301] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:49.911262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a48de-7d0f-4319-ba6f-bbc75f120c56 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:49.913936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ae975-5541-4349-9686-8c5bf5fe0827 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:49.947813 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b81ad-0ea8-42cd-89e5-34a5292405c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:49.948417 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b81ad-0ea8-42cd-89e5-34a5292405c4 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:49.948699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b81ad-0ea8-42cd-89e5-34a5292405c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:49.948969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b81ad-0ea8-42cd-89e5-34a5292405c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:49.949659 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b81ad-0ea8-42cd-89e5-34a5292405c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:49.949962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b81ad-0ea8-42cd-89e5-34a5292405c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:49.951383 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b81ad-0ea8-42cd-89e5-34a5292405c4 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:49.960292 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 157/302] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:49.966049 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b81ad-0ea8-42cd-89e5-34a5292405c4 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:50.024871 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ae975-5541-4349-9686-8c5bf5fe0827 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:50.032897 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:50.062628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49da9b-4001-41b5-8a85-35e2224e093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:50.063354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49da9b-4001-41b5-8a85-35e2224e093d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:50.063704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49da9b-4001-41b5-8a85-35e2224e093d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:50.064088 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49da9b-4001-41b5-8a85-35e2224e093d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:50.065305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49da9b-4001-41b5-8a85-35e2224e093d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:50.066795 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49da9b-4001-41b5-8a85-35e2224e093d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:50.068582 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 146/303] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:50.069614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a8d17-f902-485f-8f4f-38ff0a0300d7 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:50.069964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a8d17-f902-485f-8f4f-38ff0a0300d7 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:50.070303 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a8d17-f902-485f-8f4f-38ff0a0300d7 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:50.071668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 147/304] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:50.076196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a8d17-f902-485f-8f4f-38ff0a0300d7 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:50.090396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b81ad-0ea8-42cd-89e5-34a5292405c4 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:50.092762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:50.126976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3393f-031a-4281-8b34-3e35c38f6b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:50.127765 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3393f-031a-4281-8b34-3e35c38f6b51 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:50.127899 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3393f-031a-4281-8b34-3e35c38f6b51 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:50.128152 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3393f-031a-4281-8b34-3e35c38f6b51 None admin] PATH_INFO: `/v3/users/91c5ca00e3b946aa9f88d5848e0854e5` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:50.142376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3393f-031a-4281-8b34-3e35c38f6b51 None admin] RBAC: Authorizing `identity:get_user(user_id=91c5ca00e3b946aa9f88d5848e0854e5)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:50.143756 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3393f-031a-4281-8b34-3e35c38f6b51 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:50.150556 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 158/305] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:49 2022] GET /identity/v3/users/91c5ca00e3b946aa9f88d5848e0854e5 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:50.150556 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060ec8-3120-428d-9c2b-84c18f375f8e None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:50.150556 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060ec8-3120-428d-9c2b-84c18f375f8e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:50.150556 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060ec8-3120-428d-9c2b-84c18f375f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:50.167201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-d3060ec8-3120-428d-9c2b-84c18f375f8e None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:50.168409 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d3060ec8-3120-428d-9c2b-84c18f375f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:50.188153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a8d17-f902-485f-8f4f-38ff0a0300d7 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:50.223746 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431384a-1459-4f28-bbf4-0536b9aa0ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:50.224352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431384a-1459-4f28-bbf4-0536b9aa0ff4 None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:50.224636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431384a-1459-4f28-bbf4-0536b9aa0ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:50.224907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431384a-1459-4f28-bbf4-0536b9aa0ff4 None admin] PATH_INFO: `/v3/groups` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:50.225555 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431384a-1459-4f28-bbf4-0536b9aa0ff4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:50.226978 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431384a-1459-4f28-bbf4-0536b9aa0ff4 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:50.235057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 159/306] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:50.249199 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3060ec8-3120-428d-9c2b-84c18f375f8e None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:50.249331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 148/307] 10.222.0.76 () {60 vars in 1134 bytes} [Fri Aug 26 08:38:50 2022] POST /identity/v3/groups => generated 229 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:38:50.249331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431384a-1459-4f28-bbf4-0536b9aa0ff4 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:50.313503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:50.355661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:50.391209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3060ec8-3120-428d-9c2b-84c18f375f8e None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:50.396868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431384a-1459-4f28-bbf4-0536b9aa0ff4 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:50.432633 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242ea70-5ea2-4730-9f19-94a961d62cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:50.433279 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242ea70-5ea2-4730-9f19-94a961d62cea None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:50.433561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242ea70-5ea2-4730-9f19-94a961d62cea None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:50.433837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242ea70-5ea2-4730-9f19-94a961d62cea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:50.434565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242ea70-5ea2-4730-9f19-94a961d62cea None admin] RBAC: Adding query filter params (role.id=2837b7fc2f2d4636bbdb0b4b8ccba069, user.id=91c5ca00e3b946aa9f88d5848e0854e5, scope.system=all) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:50.434874 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242ea70-5ea2-4730-9f19-94a961d62cea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:50.436531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f6633-2c64-474c-aca5-970674643201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:50.436878 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242ea70-5ea2-4730-9f19-94a961d62cea None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:50.437268 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f6633-2c64-474c-aca5-970674643201 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:50.437557 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f6633-2c64-474c-aca5-970674643201 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:50.437833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f6633-2c64-474c-aca5-970674643201 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:50.443713 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 160/308] 10.222.0.76 () {56 vars in 1308 bytes} [Fri Aug 26 08:38:50 2022] GET /identity/v3/role_assignments?user.id=91c5ca00e3b946aa9f88d5848e0854e5&scope.system=all&role.id=2837b7fc2f2d4636bbdb0b4b8ccba069 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:50.455702 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f6633-2c64-474c-aca5-970674643201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-c64f6633-2c64-474c-aca5-970674643201 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:50.461843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:50.463875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:50.465306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:50.465306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:50.465306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:50.465306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:50.465306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:50.465306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:50.465306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:50.465306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:50.465306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:50.465306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:50.465306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:50.465306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:50.465306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 149/309] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:50.470426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242ea70-5ea2-4730-9f19-94a961d62cea None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:50.515349 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f6633-2c64-474c-aca5-970674643201 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:50.600103 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242ea70-5ea2-4730-9f19-94a961d62cea None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:50.614150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:50.645245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ab43c-d9df-43d1-bae8-d3f0728560c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:50.645956 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ab43c-d9df-43d1-bae8-d3f0728560c7 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:50.646310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ab43c-d9df-43d1-bae8-d3f0728560c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:50.646861 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ab43c-d9df-43d1-bae8-d3f0728560c7 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:50.647388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ab43c-d9df-43d1-bae8-d3f0728560c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:50.647767 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ab43c-d9df-43d1-bae8-d3f0728560c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:50.649232 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ab43c-d9df-43d1-bae8-d3f0728560c7 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:50.661946 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f6633-2c64-474c-aca5-970674643201 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:50.662842 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 161/310] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:50.663802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ab43c-d9df-43d1-bae8-d3f0728560c7 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:50.709382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b27ee-933c-46ab-ba53-9c6c84959fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:50.710715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b27ee-933c-46ab-ba53-9c6c84959fbd None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:50.711433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b27ee-933c-46ab-ba53-9c6c84959fbd None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:50.711860 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b27ee-933c-46ab-ba53-9c6c84959fbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:50.714925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:50.730771 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b27ee-933c-46ab-ba53-9c6c84959fbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-d09b27ee-933c-46ab-ba53-9c6c84959fbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:50.739110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:50.740071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:50.741761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:50.741761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:50.741761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:50.741761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:50.741761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:50.741761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:50.741761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:50.741761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:50.741761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:50.741761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:50.741761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:50.741761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:50.741761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 150/311] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:38:50.746996 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b27ee-933c-46ab-ba53-9c6c84959fbd None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:50.778354 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ab43c-d9df-43d1-bae8-d3f0728560c7 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:50.813590 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7da9af-fa26-47d7-a86f-4280aef6fe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:50.814509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7da9af-fa26-47d7-a86f-4280aef6fe25 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:50.814967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7da9af-fa26-47d7-a86f-4280aef6fe25 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:50.815412 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7da9af-fa26-47d7-a86f-4280aef6fe25 None admin] PATH_INFO: `/v3/users/639a7cbedca3428da0b24effcd9ac882` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:50.816772 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7da9af-fa26-47d7-a86f-4280aef6fe25 None admin] RBAC: Authorizing `identity:get_user(user_id=639a7cbedca3428da0b24effcd9ac882)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:50.818450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7da9af-fa26-47d7-a86f-4280aef6fe25 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:50.825291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 162/312] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:50 2022] GET /identity/v3/users/639a7cbedca3428da0b24effcd9ac882 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:50.826381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7da9af-fa26-47d7-a86f-4280aef6fe25 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:50.861877 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b27ee-933c-46ab-ba53-9c6c84959fbd None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:50.870026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:50.901260 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2620cc-e04a-4528-8ff6-277c16732e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:50.901887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2620cc-e04a-4528-8ff6-277c16732e7d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:50.902160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2620cc-e04a-4528-8ff6-277c16732e7d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:50.902438 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2620cc-e04a-4528-8ff6-277c16732e7d None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:50.903106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2620cc-e04a-4528-8ff6-277c16732e7d None admin] RBAC: Adding query filter params (name=member) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:50.903412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2620cc-e04a-4528-8ff6-277c16732e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:50.905465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2620cc-e04a-4528-8ff6-277c16732e7d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:50.919006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 151/313] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:50.920909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2620cc-e04a-4528-8ff6-277c16732e7d None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:50.931131 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7da9af-fa26-47d7-a86f-4280aef6fe25 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:50.965513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83805ee-63a3-43f4-9309-d3d2596f0dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:50.967137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83805ee-63a3-43f4-9309-d3d2596f0dea None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:50.967632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83805ee-63a3-43f4-9309-d3d2596f0dea None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:50.968139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83805ee-63a3-43f4-9309-d3d2596f0dea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:50.984297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:51.035586 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2620cc-e04a-4528-8ff6-277c16732e7d None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:51.038988 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83805ee-63a3-43f4-9309-d3d2596f0dea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:51.040638 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83805ee-63a3-43f4-9309-d3d2596f0dea None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:51.074775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b7611-7be7-4563-bb49-d8a34c095f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:51.075411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7611-7be7-4563-bb49-d8a34c095f17 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:51.075692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7611-7be7-4563-bb49-d8a34c095f17 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:51.075996 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7611-7be7-4563-bb49-d8a34c095f17 None admin] PATH_INFO: `/v3/users/80ab60b0b37a43c7944a6e058920d809` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:51.078571 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b7611-7be7-4563-bb49-d8a34c095f17 None admin] RBAC: Authorizing `identity:get_user(user_id=80ab60b0b37a43c7944a6e058920d809)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:51.080247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b7611-7be7-4563-bb49-d8a34c095f17 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:51.086868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 152/314] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:50 2022] GET /identity/v3/users/80ab60b0b37a43c7944a6e058920d809 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:51.088435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b7611-7be7-4563-bb49-d8a34c095f17 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:51.089801 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:51.159714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 163/315] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:51.160544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83805ee-63a3-43f4-9309-d3d2596f0dea None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:51.233053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b7611-7be7-4563-bb49-d8a34c095f17 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:51.265294 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83805ee-63a3-43f4-9309-d3d2596f0dea None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:51.269901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:51.286309 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514320d-301b-490d-92a9-bf60f4c2da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:51.287751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514320d-301b-490d-92a9-bf60f4c2da2f None admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:51.288371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514320d-301b-490d-92a9-bf60f4c2da2f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:51.288936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514320d-301b-490d-92a9-bf60f4c2da2f None admin] PATH_INFO: `/v3/system/users/80ab60b0b37a43c7944a6e058920d809/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:51.291258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514320d-301b-490d-92a9-bf60f4c2da2f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=80ab60b0b37a43c7944a6e058920d809, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:51.293447 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514320d-301b-490d-92a9-bf60f4c2da2f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:51.302340 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dc8e4-d970-4744-8548-a1aff3f1200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:51.303096 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dc8e4-d970-4744-8548-a1aff3f1200f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:51.303451 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dc8e4-d970-4744-8548-a1aff3f1200f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:51.303780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dc8e4-d970-4744-8548-a1aff3f1200f None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:51.305157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dc8e4-d970-4744-8548-a1aff3f1200f None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:51.313021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dc8e4-d970-4744-8548-a1aff3f1200f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:51.313021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 164/317] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:51 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:51.313665 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 153/317] 10.222.0.76 () {58 vars in 1334 bytes} [Fri Aug 26 08:38:51 2022] PUT /identity/v3/system/users/80ab60b0b37a43c7944a6e058920d809/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:38:51.315704 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dc8e4-d970-4744-8548-a1aff3f1200f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:51.330649 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:51.436717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dc8e4-d970-4744-8548-a1aff3f1200f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:51.480646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff648e-6a65-406e-a033-4b9aa28f07fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:51.481284 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff648e-6a65-406e-a033-4b9aa28f07fd None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:51.481562 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff648e-6a65-406e-a033-4b9aa28f07fd None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:51.481834 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff648e-6a65-406e-a033-4b9aa28f07fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:51.482603 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff648e-6a65-406e-a033-4b9aa28f07fd None admin] RBAC: Adding query filter params (role.id=2837b7fc2f2d4636bbdb0b4b8ccba069, scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2, user.id=639a7cbedca3428da0b24effcd9ac882) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:51.482912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff648e-6a65-406e-a033-4b9aa28f07fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:51.484342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff648e-6a65-406e-a033-4b9aa28f07fd None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:51.490427 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 165/318] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:38:51 2022] GET /identity/v3/role_assignments?user.id=639a7cbedca3428da0b24effcd9ac882&scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2&role.id=2837b7fc2f2d4636bbdb0b4b8ccba069 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:52.318175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d04a32-3868-45e3-b201-9765e843ed58 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:52.319088 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d04a32-3868-45e3-b201-9765e843ed58 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:52.319546 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d04a32-3868-45e3-b201-9765e843ed58 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:52.321477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 154/319] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:52.327069 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7cf83-1ea0-4f4b-8550-5d36d89de8c6 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:52.327827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7cf83-1ea0-4f4b-8550-5d36d89de8c6 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:52.328251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7cf83-1ea0-4f4b-8550-5d36d89de8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:52.347116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-c6e7cf83-1ea0-4f4b-8550-5d36d89de8c6 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:52.348521 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c6e7cf83-1ea0-4f4b-8550-5d36d89de8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:52.402205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122177b-78f3-4dfc-8720-ade59e728747 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:52.402729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122177b-78f3-4dfc-8720-ade59e728747 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:52.403150 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122177b-78f3-4dfc-8720-ade59e728747 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:52.405277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 155/320] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:38:52.411277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82645dae-f518-43a3-ab4b-8b32ba29da48 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:52.411621 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82645dae-f518-43a3-ab4b-8b32ba29da48 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:52.411850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82645dae-f518-43a3-ab4b-8b32ba29da48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:52.422883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 166/321] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:52.430485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-82645dae-f518-43a3-ab4b-8b32ba29da48 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:52.431681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-82645dae-f518-43a3-ab4b-8b32ba29da48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:52.500814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 156/322] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:52.687971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7cf83-1ea0-4f4b-8550-5d36d89de8c6 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:52.690290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:52.771661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82645dae-f518-43a3-ab4b-8b32ba29da48 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:52.791289 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7cf83-1ea0-4f4b-8550-5d36d89de8c6 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:52.828520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743a951-be97-4df4-b532-55dfa9390464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:52.829107 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743a951-be97-4df4-b532-55dfa9390464 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:52.829377 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743a951-be97-4df4-b532-55dfa9390464 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:52.829643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743a951-be97-4df4-b532-55dfa9390464 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:52.830916 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743a951-be97-4df4-b532-55dfa9390464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:52.832548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743a951-be97-4df4-b532-55dfa9390464 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:52.834251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 167/323] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:38:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:52.839612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743a951-be97-4df4-b532-55dfa9390464 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:52.877254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82645dae-f518-43a3-ab4b-8b32ba29da48 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:52.896233 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:52.909490 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:52.916876 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60b128-052c-47ed-b97a-7f729d6329b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:52.917529 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60b128-052c-47ed-b97a-7f729d6329b3 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:52.917807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60b128-052c-47ed-b97a-7f729d6329b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:52.918193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60b128-052c-47ed-b97a-7f729d6329b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:52.928809 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60b128-052c-47ed-b97a-7f729d6329b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-ef60b128-052c-47ed-b97a-7f729d6329b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:52.933878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:52.934770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:52.935814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:52.935814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:52.935814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:52.935814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:52.935814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:52.935814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:52.935814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:52.935814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:52.935814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:52.935814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:52.935814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:52.935814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:52.935814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 157/324] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:52.940922 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60b128-052c-47ed-b97a-7f729d6329b3 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:52.943550 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743a951-be97-4df4-b532-55dfa9390464 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:52.979110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53cc3d-5d71-43d4-90a3-2057d70bcedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:52.979857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53cc3d-5d71-43d4-90a3-2057d70bcedd None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:52.980137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53cc3d-5d71-43d4-90a3-2057d70bcedd None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:52.980407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53cc3d-5d71-43d4-90a3-2057d70bcedd None admin] PATH_INFO: `/v3/groups` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:52.981057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53cc3d-5d71-43d4-90a3-2057d70bcedd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:52.982526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53cc3d-5d71-43d4-90a3-2057d70bcedd None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:52.999238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 168/325] 10.222.0.76 () {60 vars in 1134 bytes} [Fri Aug 26 08:38:52 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:38:53.061174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60b128-052c-47ed-b97a-7f729d6329b3 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:53.098950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c017f2a-cb99-4253-856e-ad0b12f25b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:53.099553 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c017f2a-cb99-4253-856e-ad0b12f25b4f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:53.099834 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c017f2a-cb99-4253-856e-ad0b12f25b4f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:53.100109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c017f2a-cb99-4253-856e-ad0b12f25b4f None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:53.100794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c017f2a-cb99-4253-856e-ad0b12f25b4f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:53.101134 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c017f2a-cb99-4253-856e-ad0b12f25b4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:53.102562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c017f2a-cb99-4253-856e-ad0b12f25b4f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:53.116236 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 158/326] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:53.118147 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53cc3d-5d71-43d4-90a3-2057d70bcedd None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:53.224780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53cc3d-5d71-43d4-90a3-2057d70bcedd None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:53.242064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664679de-0624-4605-a89e-cfe9e71973e8 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:53.242431 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664679de-0624-4605-a89e-cfe9e71973e8 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:53.242718 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664679de-0624-4605-a89e-cfe9e71973e8 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:53.244210 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 159/327] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:53.250156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a22ae-a102-4b73-a71a-c0c5a11ec214 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:53.250445 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a22ae-a102-4b73-a71a-c0c5a11ec214 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:53.250723 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a22ae-a102-4b73-a71a-c0c5a11ec214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:53.253649 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:53.261588 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4094882-f3ec-4dcc-8ecd-9b2561d024b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:53.262449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4094882-f3ec-4dcc-8ecd-9b2561d024b1 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:53.262902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4094882-f3ec-4dcc-8ecd-9b2561d024b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:53.263976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4094882-f3ec-4dcc-8ecd-9b2561d024b1 None admin] PATH_INFO: `/v3/users/91c5ca00e3b946aa9f88d5848e0854e5` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:53.265402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4094882-f3ec-4dcc-8ecd-9b2561d024b1 None admin] RBAC: Authorizing `identity:get_user(user_id=91c5ca00e3b946aa9f88d5848e0854e5)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:53.267021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4094882-f3ec-4dcc-8ecd-9b2561d024b1 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:53.269146 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 169/328] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:53 2022] GET /identity/v3/users/91c5ca00e3b946aa9f88d5848e0854e5 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:53.276148 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4094882-f3ec-4dcc-8ecd-9b2561d024b1 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:53.282708 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-212a22ae-a102-4b73-a71a-c0c5a11ec214 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:53.283904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-212a22ae-a102-4b73-a71a-c0c5a11ec214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:53.328233 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:53.369048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 160/329] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:53.395673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4094882-f3ec-4dcc-8ecd-9b2561d024b1 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:53.435265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e4298-f4d6-42b4-a50e-c5b0c887e58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:53.436440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e4298-f4d6-42b4-a50e-c5b0c887e58d None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:53.436717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e4298-f4d6-42b4-a50e-c5b0c887e58d None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:53.437018 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e4298-f4d6-42b4-a50e-c5b0c887e58d None admin] PATH_INFO: `/v3/system/users/91c5ca00e3b946aa9f88d5848e0854e5/roles/2837b7fc2f2d4636bbdb0b4b8ccba069` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:53.438488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e4298-f4d6-42b4-a50e-c5b0c887e58d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=91c5ca00e3b946aa9f88d5848e0854e5, role_id=2837b7fc2f2d4636bbdb0b4b8ccba069)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:53.439866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e4298-f4d6-42b4-a50e-c5b0c887e58d None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:53.450470 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 170/330] 10.222.0.76 () {58 vars in 1334 bytes} [Fri Aug 26 08:38:53 2022] PUT /identity/v3/system/users/91c5ca00e3b946aa9f88d5848e0854e5/roles/2837b7fc2f2d4636bbdb0b4b8ccba069 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:38:53.651130 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a22ae-a102-4b73-a71a-c0c5a11ec214 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:53.766129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a22ae-a102-4b73-a71a-c0c5a11ec214 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:53.812289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307581-18b1-4db1-be58-43f024f08ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:53.813372 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307581-18b1-4db1-be58-43f024f08ad8 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:53.813865 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307581-18b1-4db1-be58-43f024f08ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:53.814344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307581-18b1-4db1-be58-43f024f08ad8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:53.828268 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14307581-18b1-4db1-be58-43f024f08ad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-14307581-18b1-4db1-be58-43f024f08ad8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:53.833616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:53.834520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:53.835331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:53.835331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:53.835331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:53.835331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:53.835331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:53.835331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:53.835331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:53.835331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:53.835331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:53.835331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:53.835331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:53.835331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:53.840805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 161/331] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:53.844836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e4298-f4d6-42b4-a50e-c5b0c887e58d None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:53.920464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:53.963496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e4298-f4d6-42b4-a50e-c5b0c887e58d None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:54.001187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a38603-c4e8-40c8-a8a9-bba614820691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:54.001805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a38603-c4e8-40c8-a8a9-bba614820691 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:54.002091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a38603-c4e8-40c8-a8a9-bba614820691 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:54.002368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a38603-c4e8-40c8-a8a9-bba614820691 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:54.003040 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a38603-c4e8-40c8-a8a9-bba614820691 None admin] RBAC: Adding query filter params (name=member) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:54.003346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a38603-c4e8-40c8-a8a9-bba614820691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:54.004715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a38603-c4e8-40c8-a8a9-bba614820691 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:54.013589 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 171/332] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:54.019177 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307581-18b1-4db1-be58-43f024f08ad8 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:54.070156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:54.155054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307581-18b1-4db1-be58-43f024f08ad8 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:54.200126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b4a7d-d5f4-4698-b22b-8c9767702112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:54.200684 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b4a7d-d5f4-4698-b22b-8c9767702112 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:54.201819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b4a7d-d5f4-4698-b22b-8c9767702112 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:54.202096 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b4a7d-d5f4-4698-b22b-8c9767702112 None admin] PATH_INFO: `/v3/users/80ab60b0b37a43c7944a6e058920d809` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:54.203259 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b4a7d-d5f4-4698-b22b-8c9767702112 None admin] RBAC: Authorizing `identity:get_user(user_id=80ab60b0b37a43c7944a6e058920d809)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:54.204713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b4a7d-d5f4-4698-b22b-8c9767702112 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:54.206614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 162/333] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:54 2022] GET /identity/v3/users/80ab60b0b37a43c7944a6e058920d809 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:54.212529 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a38603-c4e8-40c8-a8a9-bba614820691 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:54.347479 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a38603-c4e8-40c8-a8a9-bba614820691 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:54.380249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:54.396418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f853ee-a744-4ebf-959b-276640cef440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:54.397157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f853ee-a744-4ebf-959b-276640cef440 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:54.397360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f853ee-a744-4ebf-959b-276640cef440 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:54.397587 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f853ee-a744-4ebf-959b-276640cef440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:54.398311 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f853ee-a744-4ebf-959b-276640cef440 None admin] RBAC: Adding query filter params (role.id=6a5e7cb9300845e4b60b696aa66f4219, user.id=80ab60b0b37a43c7944a6e058920d809, scope.system=all) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:54.398618 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f853ee-a744-4ebf-959b-276640cef440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:54.400053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f853ee-a744-4ebf-959b-276640cef440 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:54.420448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 172/334] 10.222.0.76 () {56 vars in 1308 bytes} [Fri Aug 26 08:38:54 2022] GET /identity/v3/role_assignments?user.id=80ab60b0b37a43c7944a6e058920d809&scope.system=all&role.id=6a5e7cb9300845e4b60b696aa66f4219 => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:55.238231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eebf16-e677-47b9-b9eb-72694d9fc768 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:55.238748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eebf16-e677-47b9-b9eb-72694d9fc768 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:55.238748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eebf16-e677-47b9-b9eb-72694d9fc768 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:55.240320 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 163/335] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:55.245516 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb73fe5-68ff-49d1-9bec-da7c0e3efad1 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:55.245804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb73fe5-68ff-49d1-9bec-da7c0e3efad1 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:55.246078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb73fe5-68ff-49d1-9bec-da7c0e3efad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:55.269461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-fbb73fe5-68ff-49d1-9bec-da7c0e3efad1 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:55.270657 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-fbb73fe5-68ff-49d1-9bec-da7c0e3efad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:55.362530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 173/336] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:55.793218 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31376677-4a19-4d08-acce-50f7f6ad683a None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:55.793973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31376677-4a19-4d08-acce-50f7f6ad683a None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:55.794485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31376677-4a19-4d08-acce-50f7f6ad683a None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:55.796005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 164/337] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:55.801579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c3819-4c79-40ce-b367-30b2608ef33c None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:55.802470 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c3819-4c79-40ce-b367-30b2608ef33c None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:55.802951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c3819-4c79-40ce-b367-30b2608ef33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:55.829080 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-c49c3819-4c79-40ce-b367-30b2608ef33c None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:55.830581 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c49c3819-4c79-40ce-b367-30b2608ef33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:55.907520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 174/338] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:55.914087 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31376677-4a19-4d08-acce-50f7f6ad683a None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:56.037600 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:56.043291 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31376677-4a19-4d08-acce-50f7f6ad683a None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:56.086449 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cac32f-faa4-4e8a-9483-f64e624a50cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:56.087025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cac32f-faa4-4e8a-9483-f64e624a50cb None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:56.087311 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cac32f-faa4-4e8a-9483-f64e624a50cb None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:56.087589 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cac32f-faa4-4e8a-9483-f64e624a50cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:56.099582 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cac32f-faa4-4e8a-9483-f64e624a50cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-b4cac32f-faa4-4e8a-9483-f64e624a50cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:56.108619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:56.109606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:56.110421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:56.110421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:56.110421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:56.110421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:56.110421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:56.110421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:56.110421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:56.110421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:56.110421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:56.110421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:56.110421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:56.110421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:56.110421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 165/339] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:56.115696 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c3819-4c79-40ce-b367-30b2608ef33c None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:56.179499 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:56.227658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7204d1-f809-459c-82fd-f949719f034c None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:56.227981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7204d1-f809-459c-82fd-f949719f034c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:56.228222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7204d1-f809-459c-82fd-f949719f034c None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:56.229585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 166/340] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:38:56.234616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d170946-f8e8-4a1b-80d2-45819f6c8b60 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:56.234900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d170946-f8e8-4a1b-80d2-45819f6c8b60 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:56.235177 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d170946-f8e8-4a1b-80d2-45819f6c8b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:56.260825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-8d170946-f8e8-4a1b-80d2-45819f6c8b60 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:56.262073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-8d170946-f8e8-4a1b-80d2-45819f6c8b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:56.276077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c3819-4c79-40ce-b367-30b2608ef33c None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:56.329308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4235a-d609-4f55-b8f5-521e9ef965c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:56.330399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4235a-d609-4f55-b8f5-521e9ef965c5 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:56.330897 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4235a-d609-4f55-b8f5-521e9ef965c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:56.331369 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4235a-d609-4f55-b8f5-521e9ef965c5 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:56.332342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4235a-d609-4f55-b8f5-521e9ef965c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:56.332935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4235a-d609-4f55-b8f5-521e9ef965c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:56.334603 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4235a-d609-4f55-b8f5-521e9ef965c5 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:56.340958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 167/341] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:56.344752 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 175/342] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:56.349926 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d170946-f8e8-4a1b-80d2-45819f6c8b60 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:56.445057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f45f2b-d22b-4254-877e-aa001a8daa1a None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:56.445729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f45f2b-d22b-4254-877e-aa001a8daa1a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:56.446344 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f45f2b-d22b-4254-877e-aa001a8daa1a None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:56.448083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 176/343] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:38:56.459827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59324a-ae42-4b25-873b-2125055cdf7f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:56.460136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59324a-ae42-4b25-873b-2125055cdf7f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:56.460390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59324a-ae42-4b25-873b-2125055cdf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:56.462415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:56.481169 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d170946-f8e8-4a1b-80d2-45819f6c8b60 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:56.502166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-ac59324a-ae42-4b25-873b-2125055cdf7f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:56.503695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ac59324a-ae42-4b25-873b-2125055cdf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:56.516573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254e49-dea4-42b7-a29f-949126231373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:56.517234 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254e49-dea4-42b7-a29f-949126231373 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:56.517525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254e49-dea4-42b7-a29f-949126231373 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:56.525016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254e49-dea4-42b7-a29f-949126231373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:56.597556 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254e49-dea4-42b7-a29f-949126231373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:56.599041 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254e49-dea4-42b7-a29f-949126231373 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:56.610961 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 177/344] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:38:56.611875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59324a-ae42-4b25-873b-2125055cdf7f None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:56.676202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:56.763100 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:56.790381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 168/345] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:56.798075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254e49-dea4-42b7-a29f-949126231373 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:56.803480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59324a-ae42-4b25-873b-2125055cdf7f None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:56.874714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687044c-7481-434d-9356-5f71cf7932bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:56.875714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687044c-7481-434d-9356-5f71cf7932bf None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:56.876197 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687044c-7481-434d-9356-5f71cf7932bf None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:56.876664 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687044c-7481-434d-9356-5f71cf7932bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:56.892167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687044c-7481-434d-9356-5f71cf7932bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-4687044c-7481-434d-9356-5f71cf7932bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:56.901415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:56.902376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:56.903180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:56.903180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:56.903180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:56.903180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:56.903180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:56.903180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:56.903180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:56.903180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:56.903180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:56.903180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:56.903180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 08:38:56.903180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:38:56.906166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 178/346] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:56.915737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687044c-7481-434d-9356-5f71cf7932bf None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:57.003136 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254e49-dea4-42b7-a29f-949126231373 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:57.045844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b38ad2-a24c-4a55-946a-c634cb3949b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:57.048123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b38ad2-a24c-4a55-946a-c634cb3949b0 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:57.048123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b38ad2-a24c-4a55-946a-c634cb3949b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:57.048123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b38ad2-a24c-4a55-946a-c634cb3949b0 None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:57.049106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b38ad2-a24c-4a55-946a-c634cb3949b0 None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:57.050786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b38ad2-a24c-4a55-946a-c634cb3949b0 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:57.052865 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 169/347] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:56 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:57.053661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b38ad2-a24c-4a55-946a-c634cb3949b0 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:57.059856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:57.072817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687044c-7481-434d-9356-5f71cf7932bf None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:57.127762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:57.138659 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c41550-1c19-4ec9-ac0d-6d7f3bcf34a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:57.139285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c41550-1c19-4ec9-ac0d-6d7f3bcf34a3 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:57.139571 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c41550-1c19-4ec9-ac0d-6d7f3bcf34a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:57.139848 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c41550-1c19-4ec9-ac0d-6d7f3bcf34a3 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:57.140523 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c41550-1c19-4ec9-ac0d-6d7f3bcf34a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:57.140833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c41550-1c19-4ec9-ac0d-6d7f3bcf34a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:57.142343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c41550-1c19-4ec9-ac0d-6d7f3bcf34a3 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:57.154290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 179/348] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:38:57.154290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c41550-1c19-4ec9-ac0d-6d7f3bcf34a3 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:57.198314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b38ad2-a24c-4a55-946a-c634cb3949b0 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:57.237908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abc01d-c623-4cf3-ae5d-4f5fe3cf2f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:57.238546 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abc01d-c623-4cf3-ae5d-4f5fe3cf2f87 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:57.238887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abc01d-c623-4cf3-ae5d-4f5fe3cf2f87 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:57.239164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abc01d-c623-4cf3-ae5d-4f5fe3cf2f87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:57.253473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abc01d-c623-4cf3-ae5d-4f5fe3cf2f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-43abc01d-c623-4cf3-ae5d-4f5fe3cf2f87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:57.258570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:57.259612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:57.260751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:57.260751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:57.260751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:57.260751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:57.260751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:57.260751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:57.260751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:57.260751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:57.260751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:57.260751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:57.260751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:57.260751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:57.260751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 170/349] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:38:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:57.262137 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abc01d-c623-4cf3-ae5d-4f5fe3cf2f87 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:57.291117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c41550-1c19-4ec9-ac0d-6d7f3bcf34a3 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:57.337794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7706558-75d4-49b1-b657-03aa2c005c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:57.339329 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7706558-75d4-49b1-b657-03aa2c005c79 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:57.339761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7706558-75d4-49b1-b657-03aa2c005c79 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:57.340318 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7706558-75d4-49b1-b657-03aa2c005c79 None admin] PATH_INFO: `/v3/groups/be91e75b94bf4a8293fa3ae975757738` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:57.350040 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7706558-75d4-49b1-b657-03aa2c005c79 None admin] RBAC: Authorizing `identity:get_group(group_id=be91e75b94bf4a8293fa3ae975757738)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:57.352479 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7706558-75d4-49b1-b657-03aa2c005c79 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:57.354327 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 180/350] 10.222.0.76 () {56 vars in 1180 bytes} [Fri Aug 26 08:38:57 2022] GET /identity/v3/groups/be91e75b94bf4a8293fa3ae975757738 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:57.355390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7706558-75d4-49b1-b657-03aa2c005c79 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:57.387386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:57.391068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abc01d-c623-4cf3-ae5d-4f5fe3cf2f87 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:57.412547 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:57.433907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042d32a-b2c3-4c82-9ec3-5268bfe810e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:57.434835 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042d32a-b2c3-4c82-9ec3-5268bfe810e0 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:57.434953 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042d32a-b2c3-4c82-9ec3-5268bfe810e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:57.435230 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042d32a-b2c3-4c82-9ec3-5268bfe810e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:57.448077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042d32a-b2c3-4c82-9ec3-5268bfe810e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-3042d32a-b2c3-4c82-9ec3-5268bfe810e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:57.453745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:57.454821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:57.455863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:57.455863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:57.455863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:57.455863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:57.455863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:57.455863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:57.455863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:57.455863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:57.455863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:57.455863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:57.455863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:38:57.455863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:57.455863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 171/351] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:57.456550 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042d32a-b2c3-4c82-9ec3-5268bfe810e0 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:57.493427 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7706558-75d4-49b1-b657-03aa2c005c79 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:57.532026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e287971-01d1-48f0-a63e-918cb218ae7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:57.532941 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e287971-01d1-48f0-a63e-918cb218ae7f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:57.533441 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e287971-01d1-48f0-a63e-918cb218ae7f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:57.533866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e287971-01d1-48f0-a63e-918cb218ae7f None admin] PATH_INFO: `/v3/users/91c5ca00e3b946aa9f88d5848e0854e5` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:57.535194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e287971-01d1-48f0-a63e-918cb218ae7f None admin] RBAC: Authorizing `identity:get_user(user_id=91c5ca00e3b946aa9f88d5848e0854e5)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:57.536788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e287971-01d1-48f0-a63e-918cb218ae7f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:57.538586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 181/352] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:38:57 2022] GET /identity/v3/users/91c5ca00e3b946aa9f88d5848e0854e5 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:57.544307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e287971-01d1-48f0-a63e-918cb218ae7f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:57.585999 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042d32a-b2c3-4c82-9ec3-5268bfe810e0 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:57.633221 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b4fa6-512c-4498-8513-fbdb856999e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:57.633742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b4fa6-512c-4498-8513-fbdb856999e3 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:57.634022 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b4fa6-512c-4498-8513-fbdb856999e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:57.634297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b4fa6-512c-4498-8513-fbdb856999e3 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:57.634972 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b4fa6-512c-4498-8513-fbdb856999e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:57.635276 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b4fa6-512c-4498-8513-fbdb856999e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:57.636642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b4fa6-512c-4498-8513-fbdb856999e3 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:57.647165 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 172/353] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:38:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:57.647942 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b4fa6-512c-4498-8513-fbdb856999e3 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:57.662492 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:57.681319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e287971-01d1-48f0-a63e-918cb218ae7f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:57.698857 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:57.733723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010087bd-9208-47ad-aa90-42249c608f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:57.734335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010087bd-9208-47ad-aa90-42249c608f5c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:57.734612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010087bd-9208-47ad-aa90-42249c608f5c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:57.734888 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010087bd-9208-47ad-aa90-42249c608f5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:57.735613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010087bd-9208-47ad-aa90-42249c608f5c None admin] RBAC: Adding query filter params (group.id=be91e75b94bf4a8293fa3ae975757738, role.id=6a5e7cb9300845e4b60b696aa66f4219, scope.project.id=599592d0cae949b8a93e951a0a615729) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:57.735916 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010087bd-9208-47ad-aa90-42249c608f5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:57.737431 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010087bd-9208-47ad-aa90-42249c608f5c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:57.748928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 182/354] 10.222.0.76 () {56 vars in 1376 bytes} [Fri Aug 26 08:38:57 2022] GET /identity/v3/role_assignments?group.id=be91e75b94bf4a8293fa3ae975757738&scope.project.id=599592d0cae949b8a93e951a0a615729&role.id=6a5e7cb9300845e4b60b696aa66f4219 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:57.750601 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305d393-5ae5-45b5-93d9-a40b5f38898a None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:57.750890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305d393-5ae5-45b5-93d9-a40b5f38898a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:57.751174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305d393-5ae5-45b5-93d9-a40b5f38898a None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:57.753483 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 183/355] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:57.754445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305d393-5ae5-45b5-93d9-a40b5f38898a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:57.782311 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b4fa6-512c-4498-8513-fbdb856999e3 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:57.836795 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6ca65-0d12-4b88-ba28-1340d5a267bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:57.837427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6ca65-0d12-4b88-ba28-1340d5a267bc None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:57.837713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6ca65-0d12-4b88-ba28-1340d5a267bc None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:57.837981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6ca65-0d12-4b88-ba28-1340d5a267bc None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:57.839072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6ca65-0d12-4b88-ba28-1340d5a267bc None admin] RBAC: Adding query filter params (name=member) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:57.839396 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6ca65-0d12-4b88-ba28-1340d5a267bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:57.841014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6ca65-0d12-4b88-ba28-1340d5a267bc None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:57.852339 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 173/356] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:38:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:57.853594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6ca65-0d12-4b88-ba28-1340d5a267bc None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:57.910578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305d393-5ae5-45b5-93d9-a40b5f38898a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:57.959661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4647fe-d4d4-4a4e-9295-48e73188715a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:57.961855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4647fe-d4d4-4a4e-9295-48e73188715a None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:57.962136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4647fe-d4d4-4a4e-9295-48e73188715a None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:57.962409 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4647fe-d4d4-4a4e-9295-48e73188715a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:57.963134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4647fe-d4d4-4a4e-9295-48e73188715a None admin] RBAC: Adding query filter params (role.id=2837b7fc2f2d4636bbdb0b4b8ccba069, user.id=91c5ca00e3b946aa9f88d5848e0854e5, scope.system=all) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:57.963439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4647fe-d4d4-4a4e-9295-48e73188715a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:57.965256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4647fe-d4d4-4a4e-9295-48e73188715a None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:57.978940 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 184/357] 10.222.0.76 () {56 vars in 1308 bytes} [Fri Aug 26 08:38:57 2022] GET /identity/v3/role_assignments?user.id=91c5ca00e3b946aa9f88d5848e0854e5&scope.system=all&role.id=2837b7fc2f2d4636bbdb0b4b8ccba069 => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:57.984950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:57.986180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a890fd-06f7-4d88-80d7-24ada6793450 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:57.986383 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a890fd-06f7-4d88-80d7-24ada6793450 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:57.986693 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a890fd-06f7-4d88-80d7-24ada6793450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:57.987725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6ca65-0d12-4b88-ba28-1340d5a267bc None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:58.017399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-46a890fd-06f7-4d88-80d7-24ada6793450 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:58.018651 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-46a890fd-06f7-4d88-80d7-24ada6793450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:58.022805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:58.050331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130751e-0b00-44cc-a1e9-6de021132d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:58.051208 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130751e-0b00-44cc-a1e9-6de021132d0c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:58.051705 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130751e-0b00-44cc-a1e9-6de021132d0c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:58.052158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130751e-0b00-44cc-a1e9-6de021132d0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:58.136251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 185/358] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:58.136251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a890fd-06f7-4d88-80d7-24ada6793450 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:58.159932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130751e-0b00-44cc-a1e9-6de021132d0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:58.161987 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130751e-0b00-44cc-a1e9-6de021132d0c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:58.263604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a890fd-06f7-4d88-80d7-24ada6793450 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:58.275261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:58.281038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 174/359] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:58.281522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a67c3-ccc1-4659-97cc-4ad5e0b4f26d None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:58.281812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a67c3-ccc1-4659-97cc-4ad5e0b4f26d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:58.282101 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a67c3-ccc1-4659-97cc-4ad5e0b4f26d None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:58.283650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 175/360] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:38:58.288572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a67c3-ccc1-4659-97cc-4ad5e0b4f26d None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:58.309195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b52c77-a65d-4370-ae38-eebb21e015ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:58.310172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b52c77-a65d-4370-ae38-eebb21e015ff None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:58.310599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b52c77-a65d-4370-ae38-eebb21e015ff None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:58.311038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b52c77-a65d-4370-ae38-eebb21e015ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:58.327422 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:58.388766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b52c77-a65d-4370-ae38-eebb21e015ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:58.390278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b52c77-a65d-4370-ae38-eebb21e015ff None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:58.407971 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a67c3-ccc1-4659-97cc-4ad5e0b4f26d None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:58.449021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8429d-7bb5-43ed-8b3d-b68c906a250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:58.449724 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8429d-7bb5-43ed-8b3d-b68c906a250d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:58.450145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8429d-7bb5-43ed-8b3d-b68c906a250d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:58.450425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8429d-7bb5-43ed-8b3d-b68c906a250d None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:58.451738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8429d-7bb5-43ed-8b3d-b68c906a250d None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:58.453822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8429d-7bb5-43ed-8b3d-b68c906a250d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:58.456074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 176/361] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:58 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:58.458323 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11beb-513c-4322-bec9-2b69f8519ced None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:58.458608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11beb-513c-4322-bec9-2b69f8519ced None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:58.458882 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11beb-513c-4322-bec9-2b69f8519ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:58.487841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-45d11beb-513c-4322-bec9-2b69f8519ced None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:38:58.489270 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-45d11beb-513c-4322-bec9-2b69f8519ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:38:58.560083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 186/362] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:58.562173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b52c77-a65d-4370-ae38-eebb21e015ff None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:58.573778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:58.589053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 177/363] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:38:58.589053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d11beb-513c-4322-bec9-2b69f8519ced None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:58.619213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:58.710104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b52c77-a65d-4370-ae38-eebb21e015ff None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:58.711754 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d11beb-513c-4322-bec9-2b69f8519ced None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:58.748741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7c997-960c-462f-a714-7bd171c6e888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:58.749517 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7c997-960c-462f-a714-7bd171c6e888 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:58.749866 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7c997-960c-462f-a714-7bd171c6e888 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:58.750261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7c997-960c-462f-a714-7bd171c6e888 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:58.762285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2ca92-06f9-430a-bcda-e7456ceadfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:58.763013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2ca92-06f9-430a-bcda-e7456ceadfed None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:58.763836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2ca92-06f9-430a-bcda-e7456ceadfed None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:58.764111 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2ca92-06f9-430a-bcda-e7456ceadfed None admin] PATH_INFO: `/v3/groups/be91e75b94bf4a8293fa3ae975757738` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:58.765270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2ca92-06f9-430a-bcda-e7456ceadfed None admin] RBAC: Authorizing `identity:get_group(group_id=be91e75b94bf4a8293fa3ae975757738)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:58.765687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7c997-960c-462f-a714-7bd171c6e888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:58.766771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2ca92-06f9-430a-bcda-e7456ceadfed None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:58.769869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 187/364] 10.222.0.76 () {56 vars in 1180 bytes} [Fri Aug 26 08:38:58 2022] GET /identity/v3/groups/be91e75b94bf4a8293fa3ae975757738 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-55d7c997-960c-462f-a714-7bd171c6e888 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:58.770608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:58.772110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:58.773648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:58.773648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:58.773648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:58.773648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:58.773648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:58.773648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:58.773648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:58.773648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:58.773648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:58.773648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:58.773648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:38:58.773648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:58.774645 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2ca92-06f9-430a-bcda-e7456ceadfed None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:58.774730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 178/365] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:38:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:58.778323 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7c997-960c-462f-a714-7bd171c6e888 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:58.845293 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:58.883280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2ca92-06f9-430a-bcda-e7456ceadfed None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:58.890313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7c997-960c-462f-a714-7bd171c6e888 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:58.893595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:58.924929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde8012-f08e-443d-b987-73e615eaefb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:58.925661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde8012-f08e-443d-b987-73e615eaefb8 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:58.925983 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde8012-f08e-443d-b987-73e615eaefb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:58.926262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde8012-f08e-443d-b987-73e615eaefb8 None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:58.927386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde8012-f08e-443d-b987-73e615eaefb8 None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:58.927484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3df81-06eb-4ae7-a608-870acd109abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:58.928004 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3df81-06eb-4ae7-a608-870acd109abf None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:58.928289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3df81-06eb-4ae7-a608-870acd109abf None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:58.928563 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3df81-06eb-4ae7-a608-870acd109abf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:58.928813 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde8012-f08e-443d-b987-73e615eaefb8 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:58.930020 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3df81-06eb-4ae7-a608-870acd109abf None admin] RBAC: Adding query filter params (group.id=be91e75b94bf4a8293fa3ae975757738, role.id=222316862a15450198a3b454c14558c4, scope.project.id=599592d0cae949b8a93e951a0a615729) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:58.930020 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3df81-06eb-4ae7-a608-870acd109abf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:58.930762 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 188/366] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:58 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:58.935568 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3df81-06eb-4ae7-a608-870acd109abf None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:58.935718 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde8012-f08e-443d-b987-73e615eaefb8 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:58.942944 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 179/367] 10.222.0.76 () {56 vars in 1376 bytes} [Fri Aug 26 08:38:58 2022] GET /identity/v3/role_assignments?group.id=be91e75b94bf4a8293fa3ae975757738&scope.project.id=599592d0cae949b8a93e951a0a615729&role.id=222316862a15450198a3b454c14558c4 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:58.943621 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3df81-06eb-4ae7-a608-870acd109abf None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:59.064016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde8012-f08e-443d-b987-73e615eaefb8 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:59.068766 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3df81-06eb-4ae7-a608-870acd109abf None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:59.095269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:59.106400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f394a1-bb12-4f23-a092-d2f4694014c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:59.107026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f394a1-bb12-4f23-a092-d2f4694014c8 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:59.107308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f394a1-bb12-4f23-a092-d2f4694014c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:59.107587 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f394a1-bb12-4f23-a092-d2f4694014c8 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:59.108264 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f394a1-bb12-4f23-a092-d2f4694014c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:59.108572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f394a1-bb12-4f23-a092-d2f4694014c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:59.110104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f394a1-bb12-4f23-a092-d2f4694014c8 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:59.113280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bd86b-e245-4268-b8ce-1a8ae991457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:59.114016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bd86b-e245-4268-b8ce-1a8ae991457a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:59.114300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bd86b-e245-4268-b8ce-1a8ae991457a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:59.114578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bd86b-e245-4268-b8ce-1a8ae991457a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:59.119972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 189/368] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:38:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:59.120869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f394a1-bb12-4f23-a092-d2f4694014c8 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:59.126970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bd86b-e245-4268-b8ce-1a8ae991457a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-9c8bd86b-e245-4268-b8ce-1a8ae991457a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:38:59.132344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:38:59.133272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:38:59.134122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:38:59.134122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:38:59.134122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:38:59.134122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:38:59.134122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:38:59.134122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:38:59.134122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:38:59.134122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:38:59.134122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:38:59.134122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:38:59.134122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:38:59.134122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:38:59.134745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 180/369] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:38:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:38:59.135883 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bd86b-e245-4268-b8ce-1a8ae991457a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:59.172508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:59.243053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f394a1-bb12-4f23-a092-d2f4694014c8 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:59.274470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bd86b-e245-4268-b8ce-1a8ae991457a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:59.290274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a107c-4771-42a6-af50-c8c22f812d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:59.290932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a107c-4771-42a6-af50-c8c22f812d6d None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:59.291216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a107c-4771-42a6-af50-c8c22f812d6d None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:59.291492 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a107c-4771-42a6-af50-c8c22f812d6d None admin] PATH_INFO: `/v3/groups/be91e75b94bf4a8293fa3ae975757738` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:59.292770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a107c-4771-42a6-af50-c8c22f812d6d None admin] RBAC: Authorizing `identity:get_group(group_id=be91e75b94bf4a8293fa3ae975757738)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:59.294309 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a107c-4771-42a6-af50-c8c22f812d6d None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:59.296230 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 190/370] 10.222.0.76 () {56 vars in 1180 bytes} [Fri Aug 26 08:38:59 2022] GET /identity/v3/groups/be91e75b94bf4a8293fa3ae975757738 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:59.297158 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a107c-4771-42a6-af50-c8c22f812d6d None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:59.318130 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9c372-5a19-4d9c-9480-74f4670d0c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:59.318765 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9c372-5a19-4d9c-9480-74f4670d0c02 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:59.318948 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9c372-5a19-4d9c-9480-74f4670d0c02 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:59.319225 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9c372-5a19-4d9c-9480-74f4670d0c02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:59.391838 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:59.418215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9c372-5a19-4d9c-9480-74f4670d0c02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:59.420386 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9c372-5a19-4d9c-9480-74f4670d0c02 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:59.442145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a107c-4771-42a6-af50-c8c22f812d6d None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:59.453337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:59.484724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2edc13-b693-45c2-a707-2db168121662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:59.485369 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2edc13-b693-45c2-a707-2db168121662 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:59.485651 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2edc13-b693-45c2-a707-2db168121662 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:59.486033 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2edc13-b693-45c2-a707-2db168121662 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:59.486886 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2edc13-b693-45c2-a707-2db168121662 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:59.487291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2edc13-b693-45c2-a707-2db168121662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:59.488833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2edc13-b693-45c2-a707-2db168121662 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:59.498712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 191/371] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:38:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:59.499728 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2edc13-b693-45c2-a707-2db168121662 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:59.535472 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 181/372] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:59.536542 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9c372-5a19-4d9c-9480-74f4670d0c02 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:59.647858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:59.650273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2edc13-b693-45c2-a707-2db168121662 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:59.674938 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9c372-5a19-4d9c-9480-74f4670d0c02 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:59.697131 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753a620-b3da-4cfb-b4e3-61fc52487518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:59.697752 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753a620-b3da-4cfb-b4e3-61fc52487518 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:59.698059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753a620-b3da-4cfb-b4e3-61fc52487518 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:59.698331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753a620-b3da-4cfb-b4e3-61fc52487518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:59.699425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753a620-b3da-4cfb-b4e3-61fc52487518 None admin] RBAC: Adding query filter params (group.id=be91e75b94bf4a8293fa3ae975757738, role.id=6a5e7cb9300845e4b60b696aa66f4219, scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:38:59.699730 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753a620-b3da-4cfb-b4e3-61fc52487518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:59.702282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753a620-b3da-4cfb-b4e3-61fc52487518 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:59.710376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 192/373] 10.222.0.76 () {56 vars in 1376 bytes} [Fri Aug 26 08:38:59 2022] GET /identity/v3/role_assignments?group.id=be91e75b94bf4a8293fa3ae975757738&scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2&role.id=6a5e7cb9300845e4b60b696aa66f4219 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:59.711540 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753a620-b3da-4cfb-b4e3-61fc52487518 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:59.722343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66065e-a8bb-4aed-9af4-bfc9d46dcbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:59.722974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66065e-a8bb-4aed-9af4-bfc9d46dcbc9 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:59.723258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66065e-a8bb-4aed-9af4-bfc9d46dcbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:59.723584 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66065e-a8bb-4aed-9af4-bfc9d46dcbc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:59.754443 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:59.816816 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66065e-a8bb-4aed-9af4-bfc9d46dcbc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:59.818670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66065e-a8bb-4aed-9af4-bfc9d46dcbc9 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:59.848750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753a620-b3da-4cfb-b4e3-61fc52487518 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:38:59.895411 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c39f1-fc17-45e0-9bdd-961c57604a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:38:59.896330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c39f1-fc17-45e0-9bdd-961c57604a19 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:38:59.896608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c39f1-fc17-45e0-9bdd-961c57604a19 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:38:59.896879 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c39f1-fc17-45e0-9bdd-961c57604a19 None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:38:59.898971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c39f1-fc17-45e0-9bdd-961c57604a19 None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:38:59.901020 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c39f1-fc17-45e0-9bdd-961c57604a19 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:38:59.903043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 193/374] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:59 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:38:59.909649 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c39f1-fc17-45e0-9bdd-961c57604a19 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:38:59.938514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:38:59.965352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 182/375] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:38:59.971325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66065e-a8bb-4aed-9af4-bfc9d46dcbc9 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:00.025608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:00.029386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c39f1-fc17-45e0-9bdd-961c57604a19 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:00.066685 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0144d-ac59-41c4-b59b-31ae5ba3e4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:00.067321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0144d-ac59-41c4-b59b-31ae5ba3e4a5 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:00.067608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0144d-ac59-41c4-b59b-31ae5ba3e4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:00.067883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0144d-ac59-41c4-b59b-31ae5ba3e4a5 None admin] PATH_INFO: `/v3/groups/be91e75b94bf4a8293fa3ae975757738` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:00.069011 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0144d-ac59-41c4-b59b-31ae5ba3e4a5 None admin] RBAC: Authorizing `identity:get_group(group_id=be91e75b94bf4a8293fa3ae975757738)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:00.070471 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0144d-ac59-41c4-b59b-31ae5ba3e4a5 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:00.077102 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 194/376] 10.222.0.76 () {56 vars in 1180 bytes} [Fri Aug 26 08:38:59 2022] GET /identity/v3/groups/be91e75b94bf4a8293fa3ae975757738 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:00.078753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0144d-ac59-41c4-b59b-31ae5ba3e4a5 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:00.079541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66065e-a8bb-4aed-9af4-bfc9d46dcbc9 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:00.123691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b549f82-b505-405a-aad3-ddbd831e0135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:00.124252 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b549f82-b505-405a-aad3-ddbd831e0135 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:00.124532 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b549f82-b505-405a-aad3-ddbd831e0135 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:00.124801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b549f82-b505-405a-aad3-ddbd831e0135 None admin] PATH_INFO: `/v3/projects/643957365e294b92aa340cb2a3f5aab3` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:00.129760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b549f82-b505-405a-aad3-ddbd831e0135 None admin] RBAC: Authorizing `identity:get_project(project_id=643957365e294b92aa340cb2a3f5aab3)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:00.131328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b549f82-b505-405a-aad3-ddbd831e0135 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:00.133555 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 183/377] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:38:59 2022] GET /identity/v3/projects/643957365e294b92aa340cb2a3f5aab3 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:00.139493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b549f82-b505-405a-aad3-ddbd831e0135 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:00.191935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0144d-ac59-41c4-b59b-31ae5ba3e4a5 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:00.225362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:00.236438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5c110-d541-4c74-ae91-99c1764d474e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:00.237090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5c110-d541-4c74-ae91-99c1764d474e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:00.237373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5c110-d541-4c74-ae91-99c1764d474e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:00.237645 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5c110-d541-4c74-ae91-99c1764d474e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:00.238661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5c110-d541-4c74-ae91-99c1764d474e None admin] RBAC: Adding query filter params (group.id=be91e75b94bf4a8293fa3ae975757738, role.id=222316862a15450198a3b454c14558c4, scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:00.238971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5c110-d541-4c74-ae91-99c1764d474e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:00.240883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5c110-d541-4c74-ae91-99c1764d474e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:00.251969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 195/378] 10.222.0.76 () {56 vars in 1376 bytes} [Fri Aug 26 08:39:00 2022] GET /identity/v3/role_assignments?group.id=be91e75b94bf4a8293fa3ae975757738&scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2&role.id=222316862a15450198a3b454c14558c4 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:00.251969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79b698-0305-4b3f-ba83-ebbc494bb9d5 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:00.251969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79b698-0305-4b3f-ba83-ebbc494bb9d5 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:00.251969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79b698-0305-4b3f-ba83-ebbc494bb9d5 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:00.251969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 196/379] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:00.257521 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc295c-59ff-4550-9fb6-3579ecd9a5fd None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:00.257957 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc295c-59ff-4550-9fb6-3579ecd9a5fd None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:00.258343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc295c-59ff-4550-9fb6-3579ecd9a5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:00.285533 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-f2dc295c-59ff-4550-9fb6-3579ecd9a5fd None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:00.286764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f2dc295c-59ff-4550-9fb6-3579ecd9a5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:00.321441 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:00.346887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b549f82-b505-405a-aad3-ddbd831e0135 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:00.414800 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 197/380] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:00.427858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89973b56-d021-4bce-a09e-c8e05cf26e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:00.428873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89973b56-d021-4bce-a09e-c8e05cf26e45 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:00.429387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89973b56-d021-4bce-a09e-c8e05cf26e45 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:00.429861 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89973b56-d021-4bce-a09e-c8e05cf26e45 None admin] PATH_INFO: `/v3/groups/075dce19538a4731a43c8f658af6b239` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:00.440085 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89973b56-d021-4bce-a09e-c8e05cf26e45 None admin] RBAC: Authorizing `identity:get_group(group_id=075dce19538a4731a43c8f658af6b239)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:00.441929 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89973b56-d021-4bce-a09e-c8e05cf26e45 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:00.444157 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 184/381] 10.222.0.76 () {56 vars in 1180 bytes} [Fri Aug 26 08:39:00 2022] GET /identity/v3/groups/075dce19538a4731a43c8f658af6b239 => generated 229 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:00.449746 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc295c-59ff-4550-9fb6-3579ecd9a5fd None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:00.580183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc295c-59ff-4550-9fb6-3579ecd9a5fd None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:00.633876 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5acc5-ea7f-45c6-8741-305d9dc79ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:00.634494 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5acc5-ea7f-45c6-8741-305d9dc79ac5 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:00.634780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5acc5-ea7f-45c6-8741-305d9dc79ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:00.635056 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5acc5-ea7f-45c6-8741-305d9dc79ac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:00.635792 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5acc5-ea7f-45c6-8741-305d9dc79ac5 None admin] RBAC: Adding query filter params (group.id=075dce19538a4731a43c8f658af6b239, role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=643957365e294b92aa340cb2a3f5aab3) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:00.636103 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5acc5-ea7f-45c6-8741-305d9dc79ac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:00.637563 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5acc5-ea7f-45c6-8741-305d9dc79ac5 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:00.644473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 198/382] 10.222.0.76 () {56 vars in 1376 bytes} [Fri Aug 26 08:39:00 2022] GET /identity/v3/role_assignments?group.id=075dce19538a4731a43c8f658af6b239&scope.project.id=643957365e294b92aa340cb2a3f5aab3&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:00.815891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89973b56-d021-4bce-a09e-c8e05cf26e45 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:00.932538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89973b56-d021-4bce-a09e-c8e05cf26e45 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:00.951625 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:00.980592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef90f71-5f4e-4933-8830-f065b02e4768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:00.981253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef90f71-5f4e-4933-8830-f065b02e4768 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:00.981539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef90f71-5f4e-4933-8830-f065b02e4768 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:00.982334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef90f71-5f4e-4933-8830-f065b02e4768 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:00.996028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef90f71-5f4e-4933-8830-f065b02e4768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-7ef90f71-5f4e-4933-8830-f065b02e4768 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:01.001937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:01.002850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:01.004342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:01.004342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:01.004342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:01.004342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:01.004342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:01.004342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:01.004342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:01.004342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:01.004342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:01.004342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:01.004342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:39:01.004342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:01.004342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 185/383] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:01.008732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5acc5-ea7f-45c6-8741-305d9dc79ac5 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:01.044112 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:01.133742 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5acc5-ea7f-45c6-8741-305d9dc79ac5 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:01.175471 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29fa37-b4e4-4b70-b082-7ac790a071c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:01.176082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29fa37-b4e4-4b70-b082-7ac790a071c1 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:01.176364 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29fa37-b4e4-4b70-b082-7ac790a071c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:01.176637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29fa37-b4e4-4b70-b082-7ac790a071c1 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:01.177333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29fa37-b4e4-4b70-b082-7ac790a071c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:01.177639 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29fa37-b4e4-4b70-b082-7ac790a071c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:01.179004 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29fa37-b4e4-4b70-b082-7ac790a071c1 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:01.193541 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 199/384] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:39:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:01.199126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef90f71-5f4e-4933-8830-f065b02e4768 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:01.303796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1df58-f01b-4bb3-909d-2c7d82d9b36e None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:01.304089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1df58-f01b-4bb3-909d-2c7d82d9b36e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:01.304370 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1df58-f01b-4bb3-909d-2c7d82d9b36e None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:01.305754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 200/385] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:01.311391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c5a36-e859-4eac-8b98-d655e60f0309 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:01.312514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c5a36-e859-4eac-8b98-d655e60f0309 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:01.313144 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c5a36-e859-4eac-8b98-d655e60f0309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:01.351694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-426c5a36-e859-4eac-8b98-d655e60f0309 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:01.354896 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-426c5a36-e859-4eac-8b98-d655e60f0309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:01.369575 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef90f71-5f4e-4933-8830-f065b02e4768 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:01.435516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1ec10-6e69-442e-9e9a-0341f91530fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:01.436543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1ec10-6e69-442e-9e9a-0341f91530fa None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:01.437050 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1ec10-6e69-442e-9e9a-0341f91530fa None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:01.437527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1ec10-6e69-442e-9e9a-0341f91530fa None admin] PATH_INFO: `/v3/groups/be91e75b94bf4a8293fa3ae975757738` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:01.439506 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1ec10-6e69-442e-9e9a-0341f91530fa None admin] RBAC: Authorizing `identity:get_group(group_id=be91e75b94bf4a8293fa3ae975757738)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:01.441283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1ec10-6e69-442e-9e9a-0341f91530fa None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:01.444723 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 186/386] 10.222.0.76 () {56 vars in 1180 bytes} [Fri Aug 26 08:39:01 2022] GET /identity/v3/groups/be91e75b94bf4a8293fa3ae975757738 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:01.448716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1ec10-6e69-442e-9e9a-0341f91530fa None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:01.463319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 201/387] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 26 08:39:01.503522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:01.564015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1ec10-6e69-442e-9e9a-0341f91530fa None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:01.600348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1204dbb-69e0-488c-8fb4-7693d3ac4bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:01.601071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1204dbb-69e0-488c-8fb4-7693d3ac4bc9 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:01.601358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1204dbb-69e0-488c-8fb4-7693d3ac4bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:01.601638 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1204dbb-69e0-488c-8fb4-7693d3ac4bc9 None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:01.602837 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1204dbb-69e0-488c-8fb4-7693d3ac4bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:01.604274 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1204dbb-69e0-488c-8fb4-7693d3ac4bc9 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:01.606425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 187/388] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:39:01 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:01.612392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c5a36-e859-4eac-8b98-d655e60f0309 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:01.632848 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:01.723442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c5a36-e859-4eac-8b98-d655e60f0309 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:01.770106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712f704-32b6-4ff4-aad0-51a2cd48abf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:01.770771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712f704-32b6-4ff4-aad0-51a2cd48abf6 None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:01.771056 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712f704-32b6-4ff4-aad0-51a2cd48abf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:01.771339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712f704-32b6-4ff4-aad0-51a2cd48abf6 None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729/groups/be91e75b94bf4a8293fa3ae975757738/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:01.774379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712f704-32b6-4ff4-aad0-51a2cd48abf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=599592d0cae949b8a93e951a0a615729, group_id=be91e75b94bf4a8293fa3ae975757738, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:01.775821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712f704-32b6-4ff4-aad0-51a2cd48abf6 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:01.801728 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 202/389] 10.222.0.76 () {58 vars in 1442 bytes} [Fri Aug 26 08:39:01 2022] PUT /identity/v3/projects/599592d0cae949b8a93e951a0a615729/groups/be91e75b94bf4a8293fa3ae975757738/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:39:01.976492 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1204dbb-69e0-488c-8fb4-7693d3ac4bc9 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:02.101219 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1204dbb-69e0-488c-8fb4-7693d3ac4bc9 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:02.118743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:02.142349 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f337a0-ff0d-468b-bbd4-c92019531c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:02.143006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f337a0-ff0d-468b-bbd4-c92019531c73 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:02.143296 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f337a0-ff0d-468b-bbd4-c92019531c73 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:02.143573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f337a0-ff0d-468b-bbd4-c92019531c73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:02.156423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f337a0-ff0d-468b-bbd4-c92019531c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-34f337a0-ff0d-468b-bbd4-c92019531c73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:02.171755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:02.172768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:02.174065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:02.174065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:02.174065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:02.174065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:02.174065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:02.174065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:02.174065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:02.174065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:02.174065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:02.174065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:02.174065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:39:02.174065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:02.174065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 188/390] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:39:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:02.181694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712f704-32b6-4ff4-aad0-51a2cd48abf6 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:02.295580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:02.318591 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712f704-32b6-4ff4-aad0-51a2cd48abf6 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:02.355040 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb79123-5077-419d-be14-12e97f73bffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:02.355647 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb79123-5077-419d-be14-12e97f73bffc None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:02.355929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb79123-5077-419d-be14-12e97f73bffc None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:02.356204 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb79123-5077-419d-be14-12e97f73bffc None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:02.357512 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb79123-5077-419d-be14-12e97f73bffc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:02.357824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb79123-5077-419d-be14-12e97f73bffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:02.359183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb79123-5077-419d-be14-12e97f73bffc None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:02.369437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 203/391] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:02.375063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f337a0-ff0d-468b-bbd4-c92019531c73 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:02.523056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f337a0-ff0d-468b-bbd4-c92019531c73 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:02.566320 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eded47e-0b40-45c8-ba88-4c95ea79c505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:02.566873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eded47e-0b40-45c8-ba88-4c95ea79c505 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:02.567150 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eded47e-0b40-45c8-ba88-4c95ea79c505 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:02.567420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eded47e-0b40-45c8-ba88-4c95ea79c505 None admin] PATH_INFO: `/v3/groups/be91e75b94bf4a8293fa3ae975757738` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:02.574976 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eded47e-0b40-45c8-ba88-4c95ea79c505 None admin] RBAC: Authorizing `identity:get_group(group_id=be91e75b94bf4a8293fa3ae975757738)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:02.575154 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eded47e-0b40-45c8-ba88-4c95ea79c505 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:02.577639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 189/392] 10.222.0.76 () {56 vars in 1180 bytes} [Fri Aug 26 08:39:02 2022] GET /identity/v3/groups/be91e75b94bf4a8293fa3ae975757738 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:02.584920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb79123-5077-419d-be14-12e97f73bffc None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:02.705773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3cdeb-c458-4df7-9e0e-c4a97c8f9150 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:02.706154 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3cdeb-c458-4df7-9e0e-c4a97c8f9150 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:02.706336 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3cdeb-c458-4df7-9e0e-c4a97c8f9150 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:02.707952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 190/393] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:02.718833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb79123-5077-419d-be14-12e97f73bffc None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:02.723031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314237a-d367-4843-931d-2b30a7b85d00 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:02.723324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314237a-d367-4843-931d-2b30a7b85d00 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:02.723599 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314237a-d367-4843-931d-2b30a7b85d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:02.758509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78772bbd-d493-4aba-b8b9-fe05ca5f76fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:02.759220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78772bbd-d493-4aba-b8b9-fe05ca5f76fb None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:02.759509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78772bbd-d493-4aba-b8b9-fe05ca5f76fb None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:02.759785 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78772bbd-d493-4aba-b8b9-fe05ca5f76fb None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:02.760919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78772bbd-d493-4aba-b8b9-fe05ca5f76fb None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:02.762381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78772bbd-d493-4aba-b8b9-fe05ca5f76fb None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:02.764844 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 204/394] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:39:02 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:02.766012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-3314237a-d367-4843-931d-2b30a7b85d00 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:02.767229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3314237a-d367-4843-931d-2b30a7b85d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:02.771500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78772bbd-d493-4aba-b8b9-fe05ca5f76fb None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:02.796198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:02.820009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:02.874948 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 191/395] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:02.876621 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c8a90-51bd-457c-8622-96739848199c None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:02.876912 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c8a90-51bd-457c-8622-96739848199c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:02.877209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c8a90-51bd-457c-8622-96739848199c None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:02.878681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 192/396] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:02.884683 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d34023-82ca-4c75-9820-b921797892d4 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:02.884983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d34023-82ca-4c75-9820-b921797892d4 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:02.885286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d34023-82ca-4c75-9820-b921797892d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:02.906198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-08d34023-82ca-4c75-9820-b921797892d4 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:02.907443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-08d34023-82ca-4c75-9820-b921797892d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:02.954722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78772bbd-d493-4aba-b8b9-fe05ca5f76fb None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:02.989191 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 193/397] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:39:03.019098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3e82e-f601-4280-8445-254583ba4add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:03.019772 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3e82e-f601-4280-8445-254583ba4add None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:03.020058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3e82e-f601-4280-8445-254583ba4add None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:03.020336 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3e82e-f601-4280-8445-254583ba4add None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729/groups/be91e75b94bf4a8293fa3ae975757738/roles/222316862a15450198a3b454c14558c4` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:03.026765 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3e82e-f601-4280-8445-254583ba4add None admin] RBAC: Authorizing `identity:create_grant(project_id=599592d0cae949b8a93e951a0a615729, group_id=be91e75b94bf4a8293fa3ae975757738, role_id=222316862a15450198a3b454c14558c4)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:03.028216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3e82e-f601-4280-8445-254583ba4add None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:03.064090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 205/398] 10.222.0.76 () {58 vars in 1442 bytes} [Fri Aug 26 08:39:02 2022] PUT /identity/v3/projects/599592d0cae949b8a93e951a0a615729/groups/be91e75b94bf4a8293fa3ae975757738/roles/222316862a15450198a3b454c14558c4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:39:03.245401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d34023-82ca-4c75-9820-b921797892d4 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:03.266404 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eb4d4-578a-449b-8fbb-639564cb8b60 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:03.267441 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eb4d4-578a-449b-8fbb-639564cb8b60 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:03.267963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eb4d4-578a-449b-8fbb-639564cb8b60 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:03.269913 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 206/399] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:03.275396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49259a-1c1b-475f-b205-1a30c538f41f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:03.276454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49259a-1c1b-475f-b205-1a30c538f41f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:03.278417 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49259a-1c1b-475f-b205-1a30c538f41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:03.311574 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-1d49259a-1c1b-475f-b205-1a30c538f41f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:03.313166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1d49259a-1c1b-475f-b205-1a30c538f41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:03.376021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:03.380397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d34023-82ca-4c75-9820-b921797892d4 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:03.412740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:03.420846 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 207/400] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:03.422649 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49259a-1c1b-475f-b205-1a30c538f41f None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:03.432474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c164a2-3164-4167-b817-6055e6cfc7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:03.433442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c164a2-3164-4167-b817-6055e6cfc7f3 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:03.433928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c164a2-3164-4167-b817-6055e6cfc7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:03.434413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c164a2-3164-4167-b817-6055e6cfc7f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:03.455896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c164a2-3164-4167-b817-6055e6cfc7f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-14c164a2-3164-4167-b817-6055e6cfc7f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:03.460981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:03.461921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:03.462792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:03.462792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:03.462792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:03.462792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:03.462792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:03.462792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:03.462792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:03.462792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:03.462792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:03.462792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:03.462792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:39:03.462792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:03.471289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 194/401] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:39:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:03.475918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c164a2-3164-4167-b817-6055e6cfc7f3 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:03.599904 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49259a-1c1b-475f-b205-1a30c538f41f None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:03.624494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c164a2-3164-4167-b817-6055e6cfc7f3 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:03.658592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cbbd4-bdfa-4fdc-9e83-7e6522dc13d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:03.659590 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cbbd4-bdfa-4fdc-9e83-7e6522dc13d1 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:03.660019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cbbd4-bdfa-4fdc-9e83-7e6522dc13d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:03.660442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cbbd4-bdfa-4fdc-9e83-7e6522dc13d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:03.671550 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cbbd4-bdfa-4fdc-9e83-7e6522dc13d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:03.672597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfca4e-94cd-432b-86ca-97f5da08c3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:03.673246 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfca4e-94cd-432b-86ca-97f5da08c3c8 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:03.673534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfca4e-94cd-432b-86ca-97f5da08c3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:03.673810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfca4e-94cd-432b-86ca-97f5da08c3c8 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:03.674486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfca4e-94cd-432b-86ca-97f5da08c3c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:03.674847 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfca4e-94cd-432b-86ca-97f5da08c3c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:03.676237 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfca4e-94cd-432b-86ca-97f5da08c3c8 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-bc8cbbd4-bdfa-4fdc-9e83-7e6522dc13d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:03.680023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:03.680938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:03.681768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:03.681768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:03.681768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:03.681768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:03.681768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:03.681768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:03.681768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:03.681768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:03.681768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:03.681768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:03.681768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:39:03.681768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:03.684307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 208/402] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:03.690120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 195/403] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:03.690855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cbbd4-bdfa-4fdc-9e83-7e6522dc13d1 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:03.695984 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfca4e-94cd-432b-86ca-97f5da08c3c8 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:03.736769 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:03.753666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:03.795732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cbbd4-bdfa-4fdc-9e83-7e6522dc13d1 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:03.836002 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35ee0e-19d3-4b76-91e5-4518c6b57611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:03.836629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35ee0e-19d3-4b76-91e5-4518c6b57611 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:03.836918 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35ee0e-19d3-4b76-91e5-4518c6b57611 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:03.837237 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35ee0e-19d3-4b76-91e5-4518c6b57611 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:03.837909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35ee0e-19d3-4b76-91e5-4518c6b57611 None admin] RBAC: Adding query filter params (name=member) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:03.838214 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35ee0e-19d3-4b76-91e5-4518c6b57611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:03.839960 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35ee0e-19d3-4b76-91e5-4518c6b57611 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:03.847437 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfca4e-94cd-432b-86ca-97f5da08c3c8 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:03.849242 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 209/404] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:39:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:03.854352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35ee0e-19d3-4b76-91e5-4518c6b57611 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:03.887536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3865475-fd97-4ba7-b85e-5435165cc793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:03.888721 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3865475-fd97-4ba7-b85e-5435165cc793 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:03.889025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3865475-fd97-4ba7-b85e-5435165cc793 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:03.889304 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3865475-fd97-4ba7-b85e-5435165cc793 None admin] PATH_INFO: `/v3/groups/be91e75b94bf4a8293fa3ae975757738` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:03.890519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3865475-fd97-4ba7-b85e-5435165cc793 None admin] RBAC: Authorizing `identity:get_group(group_id=be91e75b94bf4a8293fa3ae975757738)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:03.892115 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3865475-fd97-4ba7-b85e-5435165cc793 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:03.893996 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 196/405] 10.222.0.76 () {56 vars in 1180 bytes} [Fri Aug 26 08:39:03 2022] GET /identity/v3/groups/be91e75b94bf4a8293fa3ae975757738 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:03.894942 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3865475-fd97-4ba7-b85e-5435165cc793 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:03.964321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35ee0e-19d3-4b76-91e5-4518c6b57611 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:03.985921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:03.995572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:04.002120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ac3f2-10a4-4ca6-bb3e-1c83ae80f711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:04.003076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ac3f2-10a4-4ca6-bb3e-1c83ae80f711 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:04.003572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ac3f2-10a4-4ca6-bb3e-1c83ae80f711 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:04.004070 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ac3f2-10a4-4ca6-bb3e-1c83ae80f711 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:04.012094 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3865475-fd97-4ba7-b85e-5435165cc793 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:04.016564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ac3f2-10a4-4ca6-bb3e-1c83ae80f711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-b75ac3f2-10a4-4ca6-bb3e-1c83ae80f711 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:04.022580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:04.023648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:04.024548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:04.024548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:04.024548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:04.024548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:04.024548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:04.024548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:04.024548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:04.024548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:04.024548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:04.024548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:04.024548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:04.024548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:04.030168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 210/406] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:04.030168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ac3f2-10a4-4ca6-bb3e-1c83ae80f711 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:04.058591 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6640a1-5764-474e-aafb-82e5e1008949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:04.059603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6640a1-5764-474e-aafb-82e5e1008949 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:04.060834 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6640a1-5764-474e-aafb-82e5e1008949 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:04.061335 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6640a1-5764-474e-aafb-82e5e1008949 None admin] PATH_INFO: `/v3/groups/be91e75b94bf4a8293fa3ae975757738` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:04.062653 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6640a1-5764-474e-aafb-82e5e1008949 None admin] RBAC: Authorizing `identity:get_group(group_id=be91e75b94bf4a8293fa3ae975757738)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:04.064358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6640a1-5764-474e-aafb-82e5e1008949 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:04.066242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 197/407] 10.222.0.76 () {56 vars in 1180 bytes} [Fri Aug 26 08:39:03 2022] GET /identity/v3/groups/be91e75b94bf4a8293fa3ae975757738 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:04.067201 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6640a1-5764-474e-aafb-82e5e1008949 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:04.139911 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ac3f2-10a4-4ca6-bb3e-1c83ae80f711 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:04.175916 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb818b-9c4d-406a-8631-d56ec87e15e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:04.176489 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6640a1-5764-474e-aafb-82e5e1008949 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:04.176647 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb818b-9c4d-406a-8631-d56ec87e15e7 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:04.177145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb818b-9c4d-406a-8631-d56ec87e15e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:04.177595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb818b-9c4d-406a-8631-d56ec87e15e7 None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:04.178930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb818b-9c4d-406a-8631-d56ec87e15e7 None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:04.180626 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb818b-9c4d-406a-8631-d56ec87e15e7 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:04.182454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 211/408] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:39:04 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:04.183367 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb818b-9c4d-406a-8631-d56ec87e15e7 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:04.214956 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4e814-30ca-4dcc-818e-03f415869082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:04.215942 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e814-30ca-4dcc-818e-03f415869082 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:04.216434 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e814-30ca-4dcc-818e-03f415869082 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:04.216897 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e814-30ca-4dcc-818e-03f415869082 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:04.217882 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4e814-30ca-4dcc-818e-03f415869082 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:04.218489 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4e814-30ca-4dcc-818e-03f415869082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:04.220102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4e814-30ca-4dcc-818e-03f415869082 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:04.234418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 198/409] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:04.235676 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4e814-30ca-4dcc-818e-03f415869082 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:04.237709 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:04.259499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:04.302213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb818b-9c4d-406a-8631-d56ec87e15e7 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:04.338903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39396be-b317-462c-8911-b1e190dff48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:04.339543 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39396be-b317-462c-8911-b1e190dff48b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:04.339827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39396be-b317-462c-8911-b1e190dff48b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:04.340102 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39396be-b317-462c-8911-b1e190dff48b None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:04.341782 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39396be-b317-462c-8911-b1e190dff48b None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:04.343220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39396be-b317-462c-8911-b1e190dff48b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:04.344848 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 212/410] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:39:04 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:04.345631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39396be-b317-462c-8911-b1e190dff48b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:04.360661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4e814-30ca-4dcc-818e-03f415869082 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:04.394659 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069e4e6-0723-4465-97c1-4619a597268c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:04.395266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e4e6-0723-4465-97c1-4619a597268c None admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:04.395804 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e4e6-0723-4465-97c1-4619a597268c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:04.395804 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e4e6-0723-4465-97c1-4619a597268c None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2/groups/be91e75b94bf4a8293fa3ae975757738/roles/222316862a15450198a3b454c14558c4` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:04.397993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e4e6-0723-4465-97c1-4619a597268c None admin] RBAC: Authorizing `identity:create_grant(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2, group_id=be91e75b94bf4a8293fa3ae975757738, role_id=222316862a15450198a3b454c14558c4)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:04.399424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e4e6-0723-4465-97c1-4619a597268c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:04.413622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 199/411] 10.222.0.76 () {58 vars in 1442 bytes} [Fri Aug 26 08:39:04 2022] PUT /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2/groups/be91e75b94bf4a8293fa3ae975757738/roles/222316862a15450198a3b454c14558c4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:39:04.414662 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cbf8e-c2fb-4436-8071-dbaba663e688 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:04.414959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cbf8e-c2fb-4436-8071-dbaba663e688 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:04.415237 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cbf8e-c2fb-4436-8071-dbaba663e688 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:04.421414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 200/412] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:04.421414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cbf8e-c2fb-4436-8071-dbaba663e688 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:04.483396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39396be-b317-462c-8911-b1e190dff48b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:04.525398 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:04.533757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68bbdf-8cea-48c2-ac67-39adc4d1be84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:04.534495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68bbdf-8cea-48c2-ac67-39adc4d1be84 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:04.534787 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68bbdf-8cea-48c2-ac67-39adc4d1be84 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:04.535072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68bbdf-8cea-48c2-ac67-39adc4d1be84 None admin] PATH_INFO: `/v3/groups/075dce19538a4731a43c8f658af6b239` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:04.538325 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68bbdf-8cea-48c2-ac67-39adc4d1be84 None admin] RBAC: Authorizing `identity:get_group(group_id=075dce19538a4731a43c8f658af6b239)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:04.539782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:04.542106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68bbdf-8cea-48c2-ac67-39adc4d1be84 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:04.546670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 213/413] 10.222.0.76 () {56 vars in 1180 bytes} [Fri Aug 26 08:39:04 2022] GET /identity/v3/groups/075dce19538a4731a43c8f658af6b239 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:04.548736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb7a5a-53ee-43c6-95fa-b3aa7357b2b2 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:04.549285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb7a5a-53ee-43c6-95fa-b3aa7357b2b2 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:04.550248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb7a5a-53ee-43c6-95fa-b3aa7357b2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:04.571766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-35cb7a5a-53ee-43c6-95fa-b3aa7357b2b2 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:04.573813 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-35cb7a5a-53ee-43c6-95fa-b3aa7357b2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:04.577774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cbf8e-c2fb-4436-8071-dbaba663e688 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:04.624500 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82a30a-1535-4cb7-b4cb-64a1b2b3ab0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:04.625194 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82a30a-1535-4cb7-b4cb-64a1b2b3ab0a None admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:04.625545 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82a30a-1535-4cb7-b4cb-64a1b2b3ab0a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:04.625834 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82a30a-1535-4cb7-b4cb-64a1b2b3ab0a None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2/groups/be91e75b94bf4a8293fa3ae975757738/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:04.627786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82a30a-1535-4cb7-b4cb-64a1b2b3ab0a None admin] RBAC: Authorizing `identity:create_grant(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2, group_id=be91e75b94bf4a8293fa3ae975757738, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:04.629706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82a30a-1535-4cb7-b4cb-64a1b2b3ab0a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:04.645827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 201/414] 10.222.0.76 () {58 vars in 1442 bytes} [Fri Aug 26 08:39:04 2022] PUT /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2/groups/be91e75b94bf4a8293fa3ae975757738/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:39:04.646623 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82a30a-1535-4cb7-b4cb-64a1b2b3ab0a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:04.673986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 214/415] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:04.779441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82a30a-1535-4cb7-b4cb-64a1b2b3ab0a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:04.835325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ebd1f-5d1c-4ed0-87a6-7e993b44cbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:04.835988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ebd1f-5d1c-4ed0-87a6-7e993b44cbe4 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:04.836273 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ebd1f-5d1c-4ed0-87a6-7e993b44cbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:04.836551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ebd1f-5d1c-4ed0-87a6-7e993b44cbe4 None admin] PATH_INFO: `/v3/projects/643957365e294b92aa340cb2a3f5aab3` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:04.837745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ebd1f-5d1c-4ed0-87a6-7e993b44cbe4 None admin] RBAC: Authorizing `identity:get_project(project_id=643957365e294b92aa340cb2a3f5aab3)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:04.839664 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ebd1f-5d1c-4ed0-87a6-7e993b44cbe4 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:04.841965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 202/416] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:39:04 2022] GET /identity/v3/projects/643957365e294b92aa340cb2a3f5aab3 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:04.848107 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb7a5a-53ee-43c6-95fa-b3aa7357b2b2 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:04.957052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb7a5a-53ee-43c6-95fa-b3aa7357b2b2 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:04.972623 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:04.997177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bbf95-aa4f-4470-8663-0d4d34e74aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:04.997876 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bbf95-aa4f-4470-8663-0d4d34e74aac None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:04.998160 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bbf95-aa4f-4470-8663-0d4d34e74aac None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:04.998439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bbf95-aa4f-4470-8663-0d4d34e74aac None admin] PATH_INFO: `/v3/projects/643957365e294b92aa340cb2a3f5aab3/groups/075dce19538a4731a43c8f658af6b239/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:05.000339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bbf95-aa4f-4470-8663-0d4d34e74aac None admin] RBAC: Authorizing `identity:create_grant(project_id=643957365e294b92aa340cb2a3f5aab3, group_id=075dce19538a4731a43c8f658af6b239, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:05.001797 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bbf95-aa4f-4470-8663-0d4d34e74aac None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:05.012678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ebd1f-5d1c-4ed0-87a6-7e993b44cbe4 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:05.026133 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:05.026845 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 215/417] 10.222.0.76 () {58 vars in 1442 bytes} [Fri Aug 26 08:39:04 2022] PUT /identity/v3/projects/643957365e294b92aa340cb2a3f5aab3/groups/075dce19538a4731a43c8f658af6b239/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:39:05.149494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ebd1f-5d1c-4ed0-87a6-7e993b44cbe4 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:05.197935 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a85882-e672-4a58-ab18-6c5baaae1b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:05.198596 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a85882-e672-4a58-ab18-6c5baaae1b58 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:05.198879 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a85882-e672-4a58-ab18-6c5baaae1b58 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:05.199156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a85882-e672-4a58-ab18-6c5baaae1b58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:05.218227 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a85882-e672-4a58-ab18-6c5baaae1b58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-71a85882-e672-4a58-ab18-6c5baaae1b58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:05.223785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:05.226012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:05.227964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:05.227964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:05.227964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:05.227964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:05.227964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:05.227964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:05.227964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:05.227964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:05.227964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:05.227964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:05.227964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:39:05.227964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:05.227964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 203/418] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:05.231307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bbf95-aa4f-4470-8663-0d4d34e74aac None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:05.347906 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bbf95-aa4f-4470-8663-0d4d34e74aac None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:05.385745 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96880df-c52f-426f-895b-ce06ba812526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:05.386785 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96880df-c52f-426f-895b-ce06ba812526 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:05.387245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96880df-c52f-426f-895b-ce06ba812526 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:05.387737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96880df-c52f-426f-895b-ce06ba812526 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:05.389171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96880df-c52f-426f-895b-ce06ba812526 None admin] RBAC: Adding query filter params (name=member) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:05.389674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96880df-c52f-426f-895b-ce06ba812526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:05.391219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96880df-c52f-426f-895b-ce06ba812526 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:05.403456 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 216/419] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:39:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:05.406666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a85882-e672-4a58-ab18-6c5baaae1b58 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:05.417478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21450ca1-cda9-42dc-bfa0-8adf936e2505 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:05.417655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21450ca1-cda9-42dc-bfa0-8adf936e2505 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:05.417940 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21450ca1-cda9-42dc-bfa0-8adf936e2505 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:05.420710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 217/420] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:05.425151 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5d08a-cd57-480a-88b3-cdd2914b1659 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:05.425372 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5d08a-cd57-480a-88b3-cdd2914b1659 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:05.425647 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5d08a-cd57-480a-88b3-cdd2914b1659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:05.457027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-4ea5d08a-cd57-480a-88b3-cdd2914b1659 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:05.458150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4ea5d08a-cd57-480a-88b3-cdd2914b1659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:05.489274 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:05.532571 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a85882-e672-4a58-ab18-6c5baaae1b58 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:05.542832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:05.584975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af52d5-fec7-4daa-9112-408f7a665e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:05.586058 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af52d5-fec7-4daa-9112-408f7a665e76 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:05.586538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af52d5-fec7-4daa-9112-408f7a665e76 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:05.588072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af52d5-fec7-4daa-9112-408f7a665e76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:05.640650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 218/421] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:39:05.693053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af52d5-fec7-4daa-9112-408f7a665e76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:05.695084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af52d5-fec7-4daa-9112-408f7a665e76 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:05.762440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:05.806453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 204/422] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:39:05.808482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5d08a-cd57-480a-88b3-cdd2914b1659 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:05.915811 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5d08a-cd57-480a-88b3-cdd2914b1659 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:05.954264 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12559b8-ec4f-4ad8-bc16-5d846209a647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:05.955309 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12559b8-ec4f-4ad8-bc16-5d846209a647 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:05.955793 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12559b8-ec4f-4ad8-bc16-5d846209a647 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:05.956294 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12559b8-ec4f-4ad8-bc16-5d846209a647 None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:05.957666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12559b8-ec4f-4ad8-bc16-5d846209a647 None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:05.959377 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12559b8-ec4f-4ad8-bc16-5d846209a647 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:05.965087 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 219/423] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:39:05 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:05.967624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af52d5-fec7-4daa-9112-408f7a665e76 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:06.028136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12559b8-ec4f-4ad8-bc16-5d846209a647 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:06.073169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:06.092171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af52d5-fec7-4daa-9112-408f7a665e76 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:06.135804 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c3046-35e2-4ff1-86bf-c35e4475c3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:06.136507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3046-35e2-4ff1-86bf-c35e4475c3b5 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:06.136794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3046-35e2-4ff1-86bf-c35e4475c3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:06.137098 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3046-35e2-4ff1-86bf-c35e4475c3b5 None admin] PATH_INFO: `/v3/groups/be91e75b94bf4a8293fa3ae975757738` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:06.139452 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c3046-35e2-4ff1-86bf-c35e4475c3b5 None admin] RBAC: Authorizing `identity:get_group(group_id=be91e75b94bf4a8293fa3ae975757738)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:06.141257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c3046-35e2-4ff1-86bf-c35e4475c3b5 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:06.145612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 205/424] 10.222.0.76 () {56 vars in 1180 bytes} [Fri Aug 26 08:39:05 2022] GET /identity/v3/groups/be91e75b94bf4a8293fa3ae975757738 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:06.152747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c3046-35e2-4ff1-86bf-c35e4475c3b5 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:06.194962 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:06.234880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12559b8-ec4f-4ad8-bc16-5d846209a647 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:06.275079 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c3046-35e2-4ff1-86bf-c35e4475c3b5 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:06.314921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378ef8e-5a41-4d03-8974-cc4522752001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:06.315427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378ef8e-5a41-4d03-8974-cc4522752001 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:06.315765 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378ef8e-5a41-4d03-8974-cc4522752001 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:06.316045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378ef8e-5a41-4d03-8974-cc4522752001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:06.316742 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7718a7-8776-496c-b342-766e7c4aa7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:06.316928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378ef8e-5a41-4d03-8974-cc4522752001 None admin] RBAC: Adding query filter params (group.id=be91e75b94bf4a8293fa3ae975757738, role.id=6a5e7cb9300845e4b60b696aa66f4219, scope.project.id=599592d0cae949b8a93e951a0a615729) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:06.317117 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378ef8e-5a41-4d03-8974-cc4522752001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:06.317392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7718a7-8776-496c-b342-766e7c4aa7e9 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:06.317683 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7718a7-8776-496c-b342-766e7c4aa7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:06.317954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7718a7-8776-496c-b342-766e7c4aa7e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:06.318554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378ef8e-5a41-4d03-8974-cc4522752001 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:06.325428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 206/425] 10.222.0.76 () {56 vars in 1376 bytes} [Fri Aug 26 08:39:06 2022] GET /identity/v3/role_assignments?group.id=be91e75b94bf4a8293fa3ae975757738&scope.project.id=599592d0cae949b8a93e951a0a615729&role.id=6a5e7cb9300845e4b60b696aa66f4219 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:06.340081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7718a7-8776-496c-b342-766e7c4aa7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-5b7718a7-8776-496c-b342-766e7c4aa7e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:06.345251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:06.346195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:06.347023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:06.347023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:06.347023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:06.347023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:06.347023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:06.347023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:06.347023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:06.347023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:06.347023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:06.347023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:06.347023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:39:06.347023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:06.347023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 220/426] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:39:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:06.354345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378ef8e-5a41-4d03-8974-cc4522752001 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:06.480327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:06.489343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378ef8e-5a41-4d03-8974-cc4522752001 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:06.509448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6817933-4044-493f-8e87-479be91212ff None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:06.510066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6817933-4044-493f-8e87-479be91212ff None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:06.510066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6817933-4044-493f-8e87-479be91212ff None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:06.511665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 221/427] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:39:06.521959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0feb14f-ca8d-4aaf-9b53-2914827195d8 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:06.522541 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0feb14f-ca8d-4aaf-9b53-2914827195d8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:06.523315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0feb14f-ca8d-4aaf-9b53-2914827195d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:06.530891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef10f27-e23d-499e-b9dc-831e0e98b36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:06.531507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef10f27-e23d-499e-b9dc-831e0e98b36c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:06.531792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef10f27-e23d-499e-b9dc-831e0e98b36c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:06.532068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef10f27-e23d-499e-b9dc-831e0e98b36c None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:06.532743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef10f27-e23d-499e-b9dc-831e0e98b36c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:06.534832 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef10f27-e23d-499e-b9dc-831e0e98b36c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:06.534832 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef10f27-e23d-499e-b9dc-831e0e98b36c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:06.545736 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 207/428] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:06.552498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef10f27-e23d-499e-b9dc-831e0e98b36c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:06.552797 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-f0feb14f-ca8d-4aaf-9b53-2914827195d8 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:06.554169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f0feb14f-ca8d-4aaf-9b53-2914827195d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:06.647578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 222/429] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:39:06.675031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef10f27-e23d-499e-b9dc-831e0e98b36c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:06.712321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11a03c-aec5-49e2-8c0f-9f90dd013323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:06.713231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11a03c-aec5-49e2-8c0f-9f90dd013323 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:06.713913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11a03c-aec5-49e2-8c0f-9f90dd013323 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:06.714326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11a03c-aec5-49e2-8c0f-9f90dd013323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:06.748805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:06.792932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11a03c-aec5-49e2-8c0f-9f90dd013323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:06.794965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11a03c-aec5-49e2-8c0f-9f90dd013323 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:06.911341 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 208/430] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 08:39:06.917060 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0feb14f-ca8d-4aaf-9b53-2914827195d8 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:06.945992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:06.956897 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11a03c-aec5-49e2-8c0f-9f90dd013323 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:07.036776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0feb14f-ca8d-4aaf-9b53-2914827195d8 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:07.037154 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:07.080240 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1ba3-1c96-4808-b13f-fceec911c68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:07.080872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1ba3-1c96-4808-b13f-fceec911c68b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:07.081210 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1ba3-1c96-4808-b13f-fceec911c68b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:07.081486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1ba3-1c96-4808-b13f-fceec911c68b None admin] PATH_INFO: `/v3/projects/599592d0cae949b8a93e951a0a615729` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:07.082592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f1ba3-1c96-4808-b13f-fceec911c68b None admin] RBAC: Authorizing `identity:get_project(project_id=599592d0cae949b8a93e951a0a615729)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:07.084012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f1ba3-1c96-4808-b13f-fceec911c68b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:07.086827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 223/431] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:39:06 2022] GET /identity/v3/projects/599592d0cae949b8a93e951a0a615729 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:07.087071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f966ce9-0a8f-4de9-b363-2d4e3308023b None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:07.087353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f966ce9-0a8f-4de9-b363-2d4e3308023b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:07.087622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f966ce9-0a8f-4de9-b363-2d4e3308023b None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:07.093152 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 224/432] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:07.095063 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f966ce9-0a8f-4de9-b363-2d4e3308023b None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:07.095767 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11a03c-aec5-49e2-8c0f-9f90dd013323 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:07.142664 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b229a6-dfd1-436b-a9c9-4dca97c53f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:07.143301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b229a6-dfd1-436b-a9c9-4dca97c53f65 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:07.143584 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b229a6-dfd1-436b-a9c9-4dca97c53f65 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:07.143862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b229a6-dfd1-436b-a9c9-4dca97c53f65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:07.157911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b229a6-dfd1-436b-a9c9-4dca97c53f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-00b229a6-dfd1-436b-a9c9-4dca97c53f65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:07.164299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:07.165264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:07.170128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:07.170128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:07.170128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:07.170128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:07.170128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:07.170128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:07.170128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:07.170128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:07.170128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:07.170128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:07.170128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:39:07.170128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:07.170128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 209/433] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:39:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:07.170128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10eefee-45ba-4e7c-ad00-e8fe11d16933 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:07.170854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10eefee-45ba-4e7c-ad00-e8fe11d16933 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:07.170854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10eefee-45ba-4e7c-ad00-e8fe11d16933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:07.186547 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-d10eefee-45ba-4e7c-ad00-e8fe11d16933 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:07.187778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d10eefee-45ba-4e7c-ad00-e8fe11d16933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:07.215040 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:07.227346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f966ce9-0a8f-4de9-b363-2d4e3308023b None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:07.262533 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 210/434] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:07.264316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10eefee-45ba-4e7c-ad00-e8fe11d16933 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:07.266390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc9bb8-57c0-41c8-b8fc-bb6a3886b8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:07.267089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc9bb8-57c0-41c8-b8fc-bb6a3886b8ee None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:07.267442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc9bb8-57c0-41c8-b8fc-bb6a3886b8ee None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:07.267789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc9bb8-57c0-41c8-b8fc-bb6a3886b8ee None admin] PATH_INFO: `/v3/groups/be91e75b94bf4a8293fa3ae975757738` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:07.269042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc9bb8-57c0-41c8-b8fc-bb6a3886b8ee None admin] RBAC: Authorizing `identity:get_group(group_id=be91e75b94bf4a8293fa3ae975757738)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:07.270556 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc9bb8-57c0-41c8-b8fc-bb6a3886b8ee None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:07.276886 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 225/435] 10.222.0.76 () {56 vars in 1180 bytes} [Fri Aug 26 08:39:07 2022] GET /identity/v3/groups/be91e75b94bf4a8293fa3ae975757738 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:07.277825 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc9bb8-57c0-41c8-b8fc-bb6a3886b8ee None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:07.339737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:07.389541 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc9bb8-57c0-41c8-b8fc-bb6a3886b8ee None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:07.413476 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10eefee-45ba-4e7c-ad00-e8fe11d16933 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:07.425075 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89f5c9-b273-4e5f-b002-9d1dcb5bc128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:07.425621 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89f5c9-b273-4e5f-b002-9d1dcb5bc128 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:07.425905 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89f5c9-b273-4e5f-b002-9d1dcb5bc128 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:07.426179 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89f5c9-b273-4e5f-b002-9d1dcb5bc128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:07.426897 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89f5c9-b273-4e5f-b002-9d1dcb5bc128 None admin] RBAC: Adding query filter params (group.id=be91e75b94bf4a8293fa3ae975757738, role.id=222316862a15450198a3b454c14558c4, scope.project.id=599592d0cae949b8a93e951a0a615729) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:07.427264 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89f5c9-b273-4e5f-b002-9d1dcb5bc128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:07.428748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89f5c9-b273-4e5f-b002-9d1dcb5bc128 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:07.445025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 226/436] 10.222.0.76 () {56 vars in 1376 bytes} [Fri Aug 26 08:39:07 2022] GET /identity/v3/role_assignments?group.id=be91e75b94bf4a8293fa3ae975757738&scope.project.id=599592d0cae949b8a93e951a0a615729&role.id=222316862a15450198a3b454c14558c4 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:07.468261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34151a-4ff8-4818-84ad-b054699380fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:07.468940 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34151a-4ff8-4818-84ad-b054699380fd None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:07.469269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34151a-4ff8-4818-84ad-b054699380fd None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:07.469545 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34151a-4ff8-4818-84ad-b054699380fd None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:07.470228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34151a-4ff8-4818-84ad-b054699380fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:07.470535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34151a-4ff8-4818-84ad-b054699380fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:07.471985 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34151a-4ff8-4818-84ad-b054699380fd None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:07.481904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 211/437] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:07.490741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89f5c9-b273-4e5f-b002-9d1dcb5bc128 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:07.521681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:07.544300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34151a-4ff8-4818-84ad-b054699380fd None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:07.623024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89f5c9-b273-4e5f-b002-9d1dcb5bc128 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:07.666433 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3f76d-5895-4174-8b3d-a3f1bb71f12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:07.667041 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3f76d-5895-4174-8b3d-a3f1bb71f12e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:07.667321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3f76d-5895-4174-8b3d-a3f1bb71f12e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:07.667594 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3f76d-5895-4174-8b3d-a3f1bb71f12e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:07.678999 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34151a-4ff8-4818-84ad-b054699380fd None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:07.695064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:07.719568 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852818c-e49f-4003-9a5a-2c716eac9829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:07.720209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852818c-e49f-4003-9a5a-2c716eac9829 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:07.720487 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852818c-e49f-4003-9a5a-2c716eac9829 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:07.720813 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852818c-e49f-4003-9a5a-2c716eac9829 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:07.733402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852818c-e49f-4003-9a5a-2c716eac9829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-e852818c-e49f-4003-9a5a-2c716eac9829 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:07.739784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:07.740730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:07.741595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:07.741595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:07.741595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:07.741595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:07.741595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:07.741595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:07.741595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:07.741595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:07.741595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:07.741595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:07.741595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 08:39:07.741595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:07.741595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 212/438] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:07.746566 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852818c-e49f-4003-9a5a-2c716eac9829 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:07.764118 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3f76d-5895-4174-8b3d-a3f1bb71f12e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:07.765621 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3f76d-5895-4174-8b3d-a3f1bb71f12e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:07.796486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:07.871243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852818c-e49f-4003-9a5a-2c716eac9829 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:07.886594 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 227/439] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:39:07.887866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6743630-50e0-426b-a9a8-8a3057094ec0 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:07.888152 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6743630-50e0-426b-a9a8-8a3057094ec0 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:07.888424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6743630-50e0-426b-a9a8-8a3057094ec0 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:07.889768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 228/440] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:07.893043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6743630-50e0-426b-a9a8-8a3057094ec0 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:07.906788 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c167d-69d7-4271-a7aa-253edcb5219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:07.907394 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c167d-69d7-4271-a7aa-253edcb5219e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:07.907671 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c167d-69d7-4271-a7aa-253edcb5219e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:07.907946 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c167d-69d7-4271-a7aa-253edcb5219e None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:07.908606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c167d-69d7-4271-a7aa-253edcb5219e None admin] RBAC: Adding query filter params (name=member) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:07.908913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c167d-69d7-4271-a7aa-253edcb5219e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:07.910299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c167d-69d7-4271-a7aa-253edcb5219e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:07.918478 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 213/441] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:39:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:07.920038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4797c96-acf5-4ede-98a2-bdedc3d9e1f3 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:07.920326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4797c96-acf5-4ede-98a2-bdedc3d9e1f3 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:07.920598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4797c96-acf5-4ede-98a2-bdedc3d9e1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:07.938005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-b4797c96-acf5-4ede-98a2-bdedc3d9e1f3 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:07.939112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b4797c96-acf5-4ede-98a2-bdedc3d9e1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:07.965560 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:07.997874 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6743630-50e0-426b-a9a8-8a3057094ec0 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:08.006472 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 214/442] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:08.007295 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4797c96-acf5-4ede-98a2-bdedc3d9e1f3 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:08.030300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:08.042969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073b807-ad12-4331-8682-378f5b7469a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:08.043602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073b807-ad12-4331-8682-378f5b7469a6 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:08.043881 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073b807-ad12-4331-8682-378f5b7469a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:08.044732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073b807-ad12-4331-8682-378f5b7469a6 None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:08.045936 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073b807-ad12-4331-8682-378f5b7469a6 None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:08.047538 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073b807-ad12-4331-8682-378f5b7469a6 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:08.053884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 229/443] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:39:07 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:08.054646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073b807-ad12-4331-8682-378f5b7469a6 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:08.109817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4797c96-acf5-4ede-98a2-bdedc3d9e1f3 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:08.144516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51413c3f-18a7-488e-8914-936fa2af5ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:08.145142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51413c3f-18a7-488e-8914-936fa2af5ffc None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:08.145426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51413c3f-18a7-488e-8914-936fa2af5ffc None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:08.145700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51413c3f-18a7-488e-8914-936fa2af5ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:08.158177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073b807-ad12-4331-8682-378f5b7469a6 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:08.176896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:08.195238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa77097-99f1-4df5-9ffb-7fafd514c1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:08.196116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa77097-99f1-4df5-9ffb-7fafd514c1da None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:08.196538 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa77097-99f1-4df5-9ffb-7fafd514c1da None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:08.196952 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa77097-99f1-4df5-9ffb-7fafd514c1da None admin] PATH_INFO: `/v3/groups/be91e75b94bf4a8293fa3ae975757738` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:08.198354 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa77097-99f1-4df5-9ffb-7fafd514c1da None admin] RBAC: Authorizing `identity:get_group(group_id=be91e75b94bf4a8293fa3ae975757738)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:08.199926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa77097-99f1-4df5-9ffb-7fafd514c1da None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:08.201934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 230/444] 10.222.0.76 () {56 vars in 1180 bytes} [Fri Aug 26 08:39:08 2022] GET /identity/v3/groups/be91e75b94bf4a8293fa3ae975757738 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:08.207558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa77097-99f1-4df5-9ffb-7fafd514c1da None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:08.219856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51413c3f-18a7-488e-8914-936fa2af5ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:08.221336 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51413c3f-18a7-488e-8914-936fa2af5ffc None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:08.275774 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:08.316664 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa77097-99f1-4df5-9ffb-7fafd514c1da None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:08.328040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 215/445] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:39:08.328040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51413c3f-18a7-488e-8914-936fa2af5ffc None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:08.350714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95432180-f290-46b9-8986-91c35fff7d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:08.351320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95432180-f290-46b9-8986-91c35fff7d10 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:08.351606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95432180-f290-46b9-8986-91c35fff7d10 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:08.351883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95432180-f290-46b9-8986-91c35fff7d10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:08.352604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95432180-f290-46b9-8986-91c35fff7d10 None admin] RBAC: Adding query filter params (group.id=be91e75b94bf4a8293fa3ae975757738, role.id=222316862a15450198a3b454c14558c4, scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:08.352914 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95432180-f290-46b9-8986-91c35fff7d10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:08.354374 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95432180-f290-46b9-8986-91c35fff7d10 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:08.360853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 231/446] 10.222.0.76 () {56 vars in 1376 bytes} [Fri Aug 26 08:39:08 2022] GET /identity/v3/role_assignments?group.id=be91e75b94bf4a8293fa3ae975757738&scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2&role.id=222316862a15450198a3b454c14558c4 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:08.361553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95432180-f290-46b9-8986-91c35fff7d10 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:08.388231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:08.431180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51413c3f-18a7-488e-8914-936fa2af5ffc None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:08.469963 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0057e-68a8-42d7-ad05-f56d4f6a2e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:08.470515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0057e-68a8-42d7-ad05-f56d4f6a2e35 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:08.470800 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0057e-68a8-42d7-ad05-f56d4f6a2e35 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:08.471075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0057e-68a8-42d7-ad05-f56d4f6a2e35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:08.483907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0057e-68a8-42d7-ad05-f56d4f6a2e35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:08.488556 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95432180-f290-46b9-8986-91c35fff7d10 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-95a0057e-68a8-42d7-ad05-f56d4f6a2e35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:08.488812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:08.489735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:08.493853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:08.493853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:08.493853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:08.493853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:08.493853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:08.493853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:08.493853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:08.493853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:08.493853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:08.493853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:08.493853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:08.493853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:08.493853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 216/447] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:39:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:08.495817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0057e-68a8-42d7-ad05-f56d4f6a2e35 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:08.519216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:08.531511 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656dd72-380c-4020-ad0c-e5ac485eea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:08.532283 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656dd72-380c-4020-ad0c-e5ac485eea3b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:08.532572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656dd72-380c-4020-ad0c-e5ac485eea3b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:08.532849 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656dd72-380c-4020-ad0c-e5ac485eea3b None admin] PATH_INFO: `/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:08.534130 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656dd72-380c-4020-ad0c-e5ac485eea3b None admin] RBAC: Authorizing `identity:get_project(project_id=b8e6804f3ccf46e3927bbe34e1bdd4f2)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:08.535608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656dd72-380c-4020-ad0c-e5ac485eea3b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:08.537240 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 232/448] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:39:08 2022] GET /identity/v3/projects/b8e6804f3ccf46e3927bbe34e1bdd4f2 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:08.542807 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656dd72-380c-4020-ad0c-e5ac485eea3b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:08.610545 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0057e-68a8-42d7-ad05-f56d4f6a2e35 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:08.633108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:08.644910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926901b-2740-4da3-a880-1253dfad8311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:08.645544 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926901b-2740-4da3-a880-1253dfad8311 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:08.645831 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926901b-2740-4da3-a880-1253dfad8311 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:08.645920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656dd72-380c-4020-ad0c-e5ac485eea3b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:08.646107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926901b-2740-4da3-a880-1253dfad8311 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:08.646777 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926901b-2740-4da3-a880-1253dfad8311 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:08.647078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926901b-2740-4da3-a880-1253dfad8311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:08.648447 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926901b-2740-4da3-a880-1253dfad8311 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:08.657140 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 217/449] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:08.662517 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926901b-2740-4da3-a880-1253dfad8311 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:08.681922 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28146c41-fa6d-4f6f-aaae-c55bb1e73dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:08.682541 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28146c41-fa6d-4f6f-aaae-c55bb1e73dad None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:08.682819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28146c41-fa6d-4f6f-aaae-c55bb1e73dad None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:08.683089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28146c41-fa6d-4f6f-aaae-c55bb1e73dad None admin] PATH_INFO: `/v3/groups/be91e75b94bf4a8293fa3ae975757738` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:08.684173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28146c41-fa6d-4f6f-aaae-c55bb1e73dad None admin] RBAC: Authorizing `identity:get_group(group_id=be91e75b94bf4a8293fa3ae975757738)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:08.685654 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28146c41-fa6d-4f6f-aaae-c55bb1e73dad None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:08.687190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 233/450] 10.222.0.76 () {56 vars in 1180 bytes} [Fri Aug 26 08:39:08 2022] GET /identity/v3/groups/be91e75b94bf4a8293fa3ae975757738 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:08.692763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28146c41-fa6d-4f6f-aaae-c55bb1e73dad None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:08.749784 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:08.764959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926901b-2740-4da3-a880-1253dfad8311 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:08.790212 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28146c41-fa6d-4f6f-aaae-c55bb1e73dad None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:08.797912 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae05d-1ce6-4f2f-8aa3-00ffc18bc31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:08.798513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae05d-1ce6-4f2f-8aa3-00ffc18bc31a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:08.798797 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae05d-1ce6-4f2f-8aa3-00ffc18bc31a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:08.799075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae05d-1ce6-4f2f-8aa3-00ffc18bc31a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:08.823088 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc6a68-d0c8-4128-9cf3-7fc19c4dcd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:08.823671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc6a68-d0c8-4128-9cf3-7fc19c4dcd6e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:08.823952 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc6a68-d0c8-4128-9cf3-7fc19c4dcd6e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:08.824224 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc6a68-d0c8-4128-9cf3-7fc19c4dcd6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:08.824930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc6a68-d0c8-4128-9cf3-7fc19c4dcd6e None admin] RBAC: Adding query filter params (group.id=be91e75b94bf4a8293fa3ae975757738, role.id=6a5e7cb9300845e4b60b696aa66f4219, scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:08.825265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc6a68-d0c8-4128-9cf3-7fc19c4dcd6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:08.827222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc6a68-d0c8-4128-9cf3-7fc19c4dcd6e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:08.832738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 234/451] 10.222.0.76 () {56 vars in 1376 bytes} [Fri Aug 26 08:39:08 2022] GET /identity/v3/role_assignments?group.id=be91e75b94bf4a8293fa3ae975757738&scope.project.id=b8e6804f3ccf46e3927bbe34e1bdd4f2&role.id=6a5e7cb9300845e4b60b696aa66f4219 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:08.859764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:08.874847 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecae05d-1ce6-4f2f-8aa3-00ffc18bc31a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:08.876340 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecae05d-1ce6-4f2f-8aa3-00ffc18bc31a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:08.980239 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 218/452] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 08:39:08.986369 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc6a68-d0c8-4128-9cf3-7fc19c4dcd6e None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:09.088562 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc6a68-d0c8-4128-9cf3-7fc19c4dcd6e None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:09.111491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:09.123286 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f93c15-3ded-4df7-99d7-65d4106011bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:09.123921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f93c15-3ded-4df7-99d7-65d4106011bd None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:09.124204 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f93c15-3ded-4df7-99d7-65d4106011bd None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:09.124481 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f93c15-3ded-4df7-99d7-65d4106011bd None admin] PATH_INFO: `/v3/projects/643957365e294b92aa340cb2a3f5aab3` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:09.125623 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f93c15-3ded-4df7-99d7-65d4106011bd None admin] RBAC: Authorizing `identity:get_project(project_id=643957365e294b92aa340cb2a3f5aab3)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:09.127053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f93c15-3ded-4df7-99d7-65d4106011bd None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:09.128673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 235/453] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:39:08 2022] GET /identity/v3/projects/643957365e294b92aa340cb2a3f5aab3 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:09.134399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae05d-1ce6-4f2f-8aa3-00ffc18bc31a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:09.220002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:09.236146 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae05d-1ce6-4f2f-8aa3-00ffc18bc31a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:09.270949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec6675-1870-4a21-a125-690d23bc7cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:09.271578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec6675-1870-4a21-a125-690d23bc7cd6 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:09.271864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec6675-1870-4a21-a125-690d23bc7cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:09.272139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec6675-1870-4a21-a125-690d23bc7cd6 None admin] PATH_INFO: `/v3/groups/075dce19538a4731a43c8f658af6b239` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:09.273312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec6675-1870-4a21-a125-690d23bc7cd6 None admin] RBAC: Authorizing `identity:get_group(group_id=075dce19538a4731a43c8f658af6b239)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:09.274749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec6675-1870-4a21-a125-690d23bc7cd6 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:09.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 219/454] 10.222.0.76 () {56 vars in 1180 bytes} [Fri Aug 26 08:39:09 2022] GET /identity/v3/groups/075dce19538a4731a43c8f658af6b239 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:09.282268 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f93c15-3ded-4df7-99d7-65d4106011bd None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:09.384461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f93c15-3ded-4df7-99d7-65d4106011bd None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:09.415821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55045c6-e796-41cc-8e9a-0e28ab847e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:09.416416 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55045c6-e796-41cc-8e9a-0e28ab847e86 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:09.416698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55045c6-e796-41cc-8e9a-0e28ab847e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:09.416972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55045c6-e796-41cc-8e9a-0e28ab847e86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:09.417719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55045c6-e796-41cc-8e9a-0e28ab847e86 None admin] RBAC: Adding query filter params (group.id=075dce19538a4731a43c8f658af6b239, role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=643957365e294b92aa340cb2a3f5aab3) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:09.418028 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55045c6-e796-41cc-8e9a-0e28ab847e86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:09.419956 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55045c6-e796-41cc-8e9a-0e28ab847e86 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:09.425544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 236/455] 10.222.0.76 () {56 vars in 1376 bytes} [Fri Aug 26 08:39:09 2022] GET /identity/v3/role_assignments?group.id=075dce19538a4731a43c8f658af6b239&scope.project.id=643957365e294b92aa340cb2a3f5aab3&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:11.637586 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8b62c-5a01-46a6-b214-ee59f2b43ced None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:11.638661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8b62c-5a01-46a6-b214-ee59f2b43ced None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:11.638661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8b62c-5a01-46a6-b214-ee59f2b43ced None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:11.640251 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 220/456] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:11.645967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004f1a4-87ba-42e1-92c5-23ea871643a7 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:11.646769 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004f1a4-87ba-42e1-92c5-23ea871643a7 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:11.647226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004f1a4-87ba-42e1-92c5-23ea871643a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:11.673479 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-b004f1a4-87ba-42e1-92c5-23ea871643a7 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:11.674963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b004f1a4-87ba-42e1-92c5-23ea871643a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:11.745694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:11.763646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 237/457] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:39:12.107435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5247c-5520-4e91-ab54-a2b19da33d32 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:12.107962 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5247c-5520-4e91-ab54-a2b19da33d32 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:12.108405 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5247c-5520-4e91-ab54-a2b19da33d32 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:12.110185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 221/458] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:12.115026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ff349-0129-4aef-9340-a445d2133ff8 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:12.115499 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ff349-0129-4aef-9340-a445d2133ff8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:12.115927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ff349-0129-4aef-9340-a445d2133ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:12.141932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-6c4ff349-0129-4aef-9340-a445d2133ff8 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:12.143363 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6c4ff349-0129-4aef-9340-a445d2133ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:12.154756 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5247c-5520-4e91-ab54-a2b19da33d32 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:12.230751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 238/459] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:12.232759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe843ae-cbee-44e6-a711-769360f2f835 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:12.234445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe843ae-cbee-44e6-a711-769360f2f835 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:12.234884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe843ae-cbee-44e6-a711-769360f2f835 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:12.236253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 239/460] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:12.242041 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a38d9-b5a9-448a-bea9-2265f84d0287 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:12.243900 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a38d9-b5a9-448a-bea9-2265f84d0287 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:12.244329 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a38d9-b5a9-448a-bea9-2265f84d0287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:12.275117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-927a38d9-b5a9-448a-bea9-2265f84d0287 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:12.277238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-927a38d9-b5a9-448a-bea9-2265f84d0287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:12.342235 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5247c-5520-4e91-ab54-a2b19da33d32 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:12.401942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 240/461] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:12.404928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26492b-5d6c-43cb-ad7d-955fc2a18948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:12.405826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26492b-5d6c-43cb-ad7d-955fc2a18948 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:12.406304 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26492b-5d6c-43cb-ad7d-955fc2a18948 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:12.406798 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26492b-5d6c-43cb-ad7d-955fc2a18948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:12.417380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26492b-5d6c-43cb-ad7d-955fc2a18948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:12.419114 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26492b-5d6c-43cb-ad7d-955fc2a18948 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-6c26492b-5d6c-43cb-ad7d-955fc2a18948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:12.434969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:12.435917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:12.436778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:12.436778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:12.436778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:12.436958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9fe29-14f5-4252-975e-c76fb9c431a5 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:12.436958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9fe29-14f5-4252-975e-c76fb9c431a5 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:12.436958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9fe29-14f5-4252-975e-c76fb9c431a5 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:12.439093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 222/463] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:12.439792 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 241/463] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:39:12.445872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9fe29-14f5-4252-975e-c76fb9c431a5 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:12.449726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8ee1a-7655-436c-9ad3-6740b2c87bfb None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:12.450011 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8ee1a-7655-436c-9ad3-6740b2c87bfb None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:12.450794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8ee1a-7655-436c-9ad3-6740b2c87bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:12.480009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:12.490118 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-1ca8ee1a-7655-436c-9ad3-6740b2c87bfb None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:12.491344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1ca8ee1a-7655-436c-9ad3-6740b2c87bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:12.532076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:12.606877 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 223/464] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:12.607734 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8ee1a-7655-436c-9ad3-6740b2c87bfb None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:12.615204 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9fe29-14f5-4252-975e-c76fb9c431a5 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:12.685733 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e76816-cd74-4cfe-b25f-efa1f3a215b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:12.686730 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e76816-cd74-4cfe-b25f-efa1f3a215b4 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:12.687286 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e76816-cd74-4cfe-b25f-efa1f3a215b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:12.687566 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e76816-cd74-4cfe-b25f-efa1f3a215b4 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:12.688457 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e76816-cd74-4cfe-b25f-efa1f3a215b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:12.688770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e76816-cd74-4cfe-b25f-efa1f3a215b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:12.694200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e76816-cd74-4cfe-b25f-efa1f3a215b4 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:12.714355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 242/465] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:12.715621 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e76816-cd74-4cfe-b25f-efa1f3a215b4 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:12.764040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8ee1a-7655-436c-9ad3-6740b2c87bfb None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:12.808354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42639d35-bcc7-4f77-9254-40c2ce388d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:12.808986 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42639d35-bcc7-4f77-9254-40c2ce388d28 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:12.809294 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42639d35-bcc7-4f77-9254-40c2ce388d28 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:12.810267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42639d35-bcc7-4f77-9254-40c2ce388d28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:12.813617 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:12.824322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42639d35-bcc7-4f77-9254-40c2ce388d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:12.827742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42639d35-bcc7-4f77-9254-40c2ce388d28 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-42639d35-bcc7-4f77-9254-40c2ce388d28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:12.848175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:12.849161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:12.850027 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:12.850027 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:12.850027 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:12.850203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e76816-cd74-4cfe-b25f-efa1f3a215b4 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:12.857815 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 224/466] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:12.858289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42639d35-bcc7-4f77-9254-40c2ce388d28 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:12.858553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:12.897738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad533d2-93c6-4fa5-b0d4-2a8649b4afff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:12.898535 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad533d2-93c6-4fa5-b0d4-2a8649b4afff None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:12.898959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad533d2-93c6-4fa5-b0d4-2a8649b4afff None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:12.899241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad533d2-93c6-4fa5-b0d4-2a8649b4afff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:12.913656 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad533d2-93c6-4fa5-b0d4-2a8649b4afff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:12.915498 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad533d2-93c6-4fa5-b0d4-2a8649b4afff None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-bad533d2-93c6-4fa5-b0d4-2a8649b4afff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:12.934168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:12.935732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:12.936672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:12.936672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:12.936672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:12.936672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 243/467] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:12.936910 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad533d2-93c6-4fa5-b0d4-2a8649b4afff None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:12.984532 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42639d35-bcc7-4f77-9254-40c2ce388d28 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:13.022324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ed6d6-711d-49f9-a696-a9d18b01b5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:13.022932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ed6d6-711d-49f9-a696-a9d18b01b5b8 None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:13.023216 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ed6d6-711d-49f9-a696-a9d18b01b5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:13.023492 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ed6d6-711d-49f9-a696-a9d18b01b5b8 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:13.024132 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ed6d6-711d-49f9-a696-a9d18b01b5b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:13.025592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ed6d6-711d-49f9-a696-a9d18b01b5b8 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:13.043477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad533d2-93c6-4fa5-b0d4-2a8649b4afff None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:13.048135 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 225/468] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:39:12 2022] POST /identity/v3/users => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:39:13.048759 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ed6d6-711d-49f9-a696-a9d18b01b5b8 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:13.105603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:13.116762 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fc837-5cfb-4842-888c-48e33d39438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:13.118504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fc837-5cfb-4842-888c-48e33d39438b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:13.119018 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fc837-5cfb-4842-888c-48e33d39438b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:13.119547 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fc837-5cfb-4842-888c-48e33d39438b None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:13.120711 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fc837-5cfb-4842-888c-48e33d39438b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:13.121557 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fc837-5cfb-4842-888c-48e33d39438b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:13.124683 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fc837-5cfb-4842-888c-48e33d39438b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:13.143379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 244/469] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:13.145347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fc837-5cfb-4842-888c-48e33d39438b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:13.175504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:13.182891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ed6d6-711d-49f9-a696-a9d18b01b5b8 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:13.232739 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3189a-dd7e-48b8-9a8d-340e68827594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:13.233346 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3189a-dd7e-48b8-9a8d-340e68827594 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:13.233628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3189a-dd7e-48b8-9a8d-340e68827594 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:13.233905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3189a-dd7e-48b8-9a8d-340e68827594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:13.248470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3189a-dd7e-48b8-9a8d-340e68827594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:13.249383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3189a-dd7e-48b8-9a8d-340e68827594 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-01a3189a-dd7e-48b8-9a8d-340e68827594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:13.267778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:13.268755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:13.269669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:13.269669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:13.269669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:13.269669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 226/470] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:13.269669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3189a-dd7e-48b8-9a8d-340e68827594 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:13.295626 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fc837-5cfb-4842-888c-48e33d39438b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:13.337088 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630848f-0e6b-4690-bb9a-c0b2e3fe0a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:13.337701 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630848f-0e6b-4690-bb9a-c0b2e3fe0a93 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:13.337985 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630848f-0e6b-4690-bb9a-c0b2e3fe0a93 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:13.338257 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630848f-0e6b-4690-bb9a-c0b2e3fe0a93 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:13.339157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630848f-0e6b-4690-bb9a-c0b2e3fe0a93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:13.339460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630848f-0e6b-4690-bb9a-c0b2e3fe0a93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:13.341575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630848f-0e6b-4690-bb9a-c0b2e3fe0a93 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:13.352917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 245/471] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:13.357872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630848f-0e6b-4690-bb9a-c0b2e3fe0a93 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:13.382641 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:13.389792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3189a-dd7e-48b8-9a8d-340e68827594 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:13.425426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf5912-fe04-4fdc-918b-a2d6e7d18e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:13.426035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf5912-fe04-4fdc-918b-a2d6e7d18e31 None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:13.426319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf5912-fe04-4fdc-918b-a2d6e7d18e31 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:13.426595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf5912-fe04-4fdc-918b-a2d6e7d18e31 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:13.427229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf5912-fe04-4fdc-918b-a2d6e7d18e31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:13.428661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf5912-fe04-4fdc-918b-a2d6e7d18e31 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:13.450805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 227/472] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:39:13 2022] POST /identity/v3/users => generated 248 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:39:13.452049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d6d37-d1eb-4d32-ae47-4677f4742011 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:13.452338 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d6d37-d1eb-4d32-ae47-4677f4742011 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:13.452618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d6d37-d1eb-4d32-ae47-4677f4742011 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:13.458414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 228/473] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:13.458414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d6d37-d1eb-4d32-ae47-4677f4742011 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:13.462079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:13.490015 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630848f-0e6b-4690-bb9a-c0b2e3fe0a93 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:13.542208 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c47858-f9d9-4b14-a245-c485ad5126a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:13.543786 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c47858-f9d9-4b14-a245-c485ad5126a7 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:13.545177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c47858-f9d9-4b14-a245-c485ad5126a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:13.545672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c47858-f9d9-4b14-a245-c485ad5126a7 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:13.546842 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c47858-f9d9-4b14-a245-c485ad5126a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:13.547801 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c47858-f9d9-4b14-a245-c485ad5126a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:13.549723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c47858-f9d9-4b14-a245-c485ad5126a7 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:13.566881 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 246/474] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:13.569155 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6ccd-612c-4871-ab47-bd62d01a1d43 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:13.569624 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6ccd-612c-4871-ab47-bd62d01a1d43 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:13.570071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6ccd-612c-4871-ab47-bd62d01a1d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:13.600002 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-665d6ccd-612c-4871-ab47-bd62d01a1d43 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:13.601547 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-665d6ccd-612c-4871-ab47-bd62d01a1d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:13.602437 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d6d37-d1eb-4d32-ae47-4677f4742011 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:13.645094 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d345e4-1d93-4117-a897-73009173f409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:13.645812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d345e4-1d93-4117-a897-73009173f409 None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:13.646102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d345e4-1d93-4117-a897-73009173f409 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:13.646375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d345e4-1d93-4117-a897-73009173f409 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:13.647021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d345e4-1d93-4117-a897-73009173f409 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:13.648454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d345e4-1d93-4117-a897-73009173f409 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:13.676013 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 229/475] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:39:13 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:39:13.676828 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d345e4-1d93-4117-a897-73009173f409 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:13.693020 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 247/476] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:13.693546 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:13.799065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d345e4-1d93-4117-a897-73009173f409 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:13.838335 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c8451-ccbf-4731-bb8d-5002bdf83f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:13.839227 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c8451-ccbf-4731-bb8d-5002bdf83f0c None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:13.839512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c8451-ccbf-4731-bb8d-5002bdf83f0c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:13.839792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c8451-ccbf-4731-bb8d-5002bdf83f0c None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:13.840451 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c8451-ccbf-4731-bb8d-5002bdf83f0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:13.842579 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c8451-ccbf-4731-bb8d-5002bdf83f0c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:13.866491 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 230/477] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:39:13 2022] POST /identity/v3/users => generated 249 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:39:13.986006 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d6ccd-612c-4871-ab47-bd62d01a1d43 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:14.060587 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:14.097414 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d6ccd-612c-4871-ab47-bd62d01a1d43 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:14.139034 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8f87a-8528-493e-a789-5a75696a3888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:14.140035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8f87a-8528-493e-a789-5a75696a3888 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:14.140534 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8f87a-8528-493e-a789-5a75696a3888 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:14.141039 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8f87a-8528-493e-a789-5a75696a3888 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:14.141926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8f87a-8528-493e-a789-5a75696a3888 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:14.143510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8f87a-8528-493e-a789-5a75696a3888 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:14.153970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.sql.core [None req-51b8f87a-8528-493e-a789-5a75696a3888 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 08:39:14.153970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 26 08:39:14.153970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [parameters: {'id': 'db638e88bf3b461db705abe9f7e50c3b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 26 08:39:14.153970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87893) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 08:39:14.171399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-51b8f87a-8528-493e-a789-5a75696a3888 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 26 08:39:14.171399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:14.171399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 08:39:14.171399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 08:39:14.171399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 08:39:14.171399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 08:39:14.171399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 08:39:14.171399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 08:39:14.171399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 08:39:14.171399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application conn.query(q) Aug 26 08:39:14.171399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 08:39:14.171399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 08:39:14.171399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 08:39:14.171399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application result.read() Aug 26 08:39:14.171399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return ref.to_dict() Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 08:39:14.172301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application next(self.gen) Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application yield resource Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application next(self.gen) Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise self.value Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application session.commit() Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 08:39:14.173320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self.session.flush() Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application compat.raise_( Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 08:39:14.174221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 08:39:14.175129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application conn.query(q) Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application result.read() Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 08:39:14.175962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [parameters: {'id': 'db638e88bf3b461db705abe9f7e50c3b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:14.176776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 26 08:39:14.179643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:14.183588 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 248/478] 10.222.0.76 () {60 vars in 1131 bytes} [Fri Aug 26 08:39:13 2022] POST /identity/v3/roles => generated 144 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:14.190144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c8451-ccbf-4731-bb8d-5002bdf83f0c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:14.263771 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:14.331651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c8451-ccbf-4731-bb8d-5002bdf83f0c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:14.384386 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffe0a5-6cc5-4ed3-80a2-67b80e922337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:14.385090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffe0a5-6cc5-4ed3-80a2-67b80e922337 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:14.385371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffe0a5-6cc5-4ed3-80a2-67b80e922337 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:14.385686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffe0a5-6cc5-4ed3-80a2-67b80e922337 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:14.403951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffe0a5-6cc5-4ed3-80a2-67b80e922337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-c0ffe0a5-6cc5-4ed3-80a2-67b80e922337 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:14.409160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:14.410056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:14.411427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:14.411427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:14.411427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:14.411427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:14.411427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:14.411427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:14.411427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:14.411427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:14.411427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:14.411427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:14.411427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 08:39:14.411427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:14.411427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 231/479] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:39:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:14.417697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8f87a-8528-493e-a789-5a75696a3888 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:14.554878 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8f87a-8528-493e-a789-5a75696a3888 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:14.589194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:14.597090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95671c91-2b33-48cc-abb8-a4342041e3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:14.597703 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95671c91-2b33-48cc-abb8-a4342041e3a2 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:14.597985 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95671c91-2b33-48cc-abb8-a4342041e3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:14.598258 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95671c91-2b33-48cc-abb8-a4342041e3a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:14.598991 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95671c91-2b33-48cc-abb8-a4342041e3a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:14.599302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95671c91-2b33-48cc-abb8-a4342041e3a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:14.600675 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95671c91-2b33-48cc-abb8-a4342041e3a2 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:14.615813 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 249/480] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:15.375557 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb3c9a-1681-46a5-a5e2-d405c3dba6f1 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:15.376582 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb3c9a-1681-46a5-a5e2-d405c3dba6f1 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:15.377123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb3c9a-1681-46a5-a5e2-d405c3dba6f1 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:15.378935 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 232/481] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:15.384580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44460bf-8d62-4217-9ee3-47d5c2e456a3 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:15.385391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44460bf-8d62-4217-9ee3-47d5c2e456a3 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:15.385899 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44460bf-8d62-4217-9ee3-47d5c2e456a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:15.409886 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-f44460bf-8d62-4217-9ee3-47d5c2e456a3 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:15.414805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f44460bf-8d62-4217-9ee3-47d5c2e456a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:15.504124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 250/482] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:39:15.853888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb3c9a-1681-46a5-a5e2-d405c3dba6f1 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:15.994296 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb3c9a-1681-46a5-a5e2-d405c3dba6f1 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:16.029090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:16.034129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c07b4e-f9c9-4c9e-a660-e9a03a9fb4ab None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:16.034423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c07b4e-f9c9-4c9e-a660-e9a03a9fb4ab None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:16.034702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c07b4e-f9c9-4c9e-a660-e9a03a9fb4ab None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:16.036286 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 251/483] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:16.042877 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab90cad-5329-436a-8af4-2dc9fce1a560 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:16.043189 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab90cad-5329-436a-8af4-2dc9fce1a560 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:16.043438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab90cad-5329-436a-8af4-2dc9fce1a560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:16.050193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb720d5-a059-4b58-a94e-2ed834d5689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:16.051200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb720d5-a059-4b58-a94e-2ed834d5689f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:16.051681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb720d5-a059-4b58-a94e-2ed834d5689f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:16.052168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb720d5-a059-4b58-a94e-2ed834d5689f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:16.062005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-bab90cad-5329-436a-8af4-2dc9fce1a560 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:16.063202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-bab90cad-5329-436a-8af4-2dc9fce1a560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:16.069929 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb720d5-a059-4b58-a94e-2ed834d5689f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-ebb720d5-a059-4b58-a94e-2ed834d5689f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:16.074825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:16.076342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:16.077619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:16.077619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:16.077619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:16.077619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:16.077619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:16.077619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:16.077619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:16.077619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:16.077619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:16.077619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:16.077619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:16.077619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:16.077619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 233/484] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:16.084685 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb720d5-a059-4b58-a94e-2ed834d5689f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:16.169360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 252/485] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:39:16.217260 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb720d5-a059-4b58-a94e-2ed834d5689f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:16.251722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a4c2a-7f07-4673-bca0-08778fc9425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:16.252327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a4c2a-7f07-4673-bca0-08778fc9425e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:16.252609 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a4c2a-7f07-4673-bca0-08778fc9425e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:16.252880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a4c2a-7f07-4673-bca0-08778fc9425e None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:16.253576 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a4c2a-7f07-4673-bca0-08778fc9425e None admin] RBAC: Adding query filter params (name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:16.253880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a4c2a-7f07-4673-bca0-08778fc9425e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:16.255252 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a4c2a-7f07-4673-bca0-08778fc9425e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:16.264230 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 234/486] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:16.270034 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab90cad-5329-436a-8af4-2dc9fce1a560 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:16.355774 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:16.384266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e542e2-f95c-4df4-b9cd-4c2ba366a8c5 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:16.384776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e542e2-f95c-4df4-b9cd-4c2ba366a8c5 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:16.384880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e542e2-f95c-4df4-b9cd-4c2ba366a8c5 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:16.386606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 235/487] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:16.399411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e9f3d-224b-43ea-962d-17a049f073e0 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:16.400222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e9f3d-224b-43ea-962d-17a049f073e0 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:16.400502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e9f3d-224b-43ea-962d-17a049f073e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:16.409885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab90cad-5329-436a-8af4-2dc9fce1a560 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:16.432708 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-0f6e9f3d-224b-43ea-962d-17a049f073e0 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:16.435368 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0f6e9f3d-224b-43ea-962d-17a049f073e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:16.447289 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160a52e-446b-47cb-a9c8-6d42301cd9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:16.447912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160a52e-446b-47cb-a9c8-6d42301cd9c2 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:16.448445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160a52e-446b-47cb-a9c8-6d42301cd9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:16.448445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160a52e-446b-47cb-a9c8-6d42301cd9c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:16.459715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160a52e-446b-47cb-a9c8-6d42301cd9c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:16.461183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160a52e-446b-47cb-a9c8-6d42301cd9c2 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-c160a52e-446b-47cb-a9c8-6d42301cd9c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:16.476055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:16.476968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:16.477884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:16.477884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:16.477884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:16.477884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 253/488] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:16.478799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c97cf-9fbf-4858-b785-2f16bb133098 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:16.479100 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c97cf-9fbf-4858-b785-2f16bb133098 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:16.479371 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c97cf-9fbf-4858-b785-2f16bb133098 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:16.481096 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 254/489] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:16.485081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c97cf-9fbf-4858-b785-2f16bb133098 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:16.500914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:16.528112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 236/490] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:16.529575 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec558422-cfd5-4841-ba26-905b3c0bb630 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:16.529960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec558422-cfd5-4841-ba26-905b3c0bb630 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:16.531013 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec558422-cfd5-4841-ba26-905b3c0bb630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:16.560775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ec558422-cfd5-4841-ba26-905b3c0bb630 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:16.562105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ec558422-cfd5-4841-ba26-905b3c0bb630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:16.607086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c97cf-9fbf-4858-b785-2f16bb133098 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:16.615207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:16.646504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c1466-b1cf-4d10-be1d-49c256f2904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:16.647738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c1466-b1cf-4d10-be1d-49c256f2904f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:16.648495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c1466-b1cf-4d10-be1d-49c256f2904f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:16.649060 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c1466-b1cf-4d10-be1d-49c256f2904f None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:16.650562 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c1466-b1cf-4d10-be1d-49c256f2904f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:16.651049 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c1466-b1cf-4d10-be1d-49c256f2904f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:16.653342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c1466-b1cf-4d10-be1d-49c256f2904f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:16.660577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 237/491] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:16.661620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec558422-cfd5-4841-ba26-905b3c0bb630 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:16.673499 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 255/492] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:16.675751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c1466-b1cf-4d10-be1d-49c256f2904f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:16.796369 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c1466-b1cf-4d10-be1d-49c256f2904f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:16.836632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1937cee-ac26-43aa-83cc-96560bc8dc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:16.837860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1937cee-ac26-43aa-83cc-96560bc8dc87 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:16.838291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1937cee-ac26-43aa-83cc-96560bc8dc87 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:16.839090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1937cee-ac26-43aa-83cc-96560bc8dc87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:16.849256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1937cee-ac26-43aa-83cc-96560bc8dc87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:16.851027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1937cee-ac26-43aa-83cc-96560bc8dc87 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:16.851473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec558422-cfd5-4841-ba26-905b3c0bb630 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:16.861554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-d1937cee-ac26-43aa-83cc-96560bc8dc87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:16.870142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:16.871250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:16.872953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:16.872953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:16.872953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:16.872953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:16.872953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:16.872953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:16.872953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:16.872953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:16.872953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:39:16.872953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:16.880232 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 256/493] 10.222.0.76 () {56 vars in 1093 bytes} [Fri Aug 26 08:39:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:16.880232 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1937cee-ac26-43aa-83cc-96560bc8dc87 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:16.902032 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b94dd-4aa3-4fd1-992b-88fcc3d76f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:16.902979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b94dd-4aa3-4fd1-992b-88fcc3d76f83 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:16.903530 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b94dd-4aa3-4fd1-992b-88fcc3d76f83 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:16.904096 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b94dd-4aa3-4fd1-992b-88fcc3d76f83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:16.912842 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:16.916203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b94dd-4aa3-4fd1-992b-88fcc3d76f83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-cd6b94dd-4aa3-4fd1-992b-88fcc3d76f83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:16.922770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:16.923660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:16.924554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:16.924554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:16.924554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:16.924554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:16.924554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:16.924554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:16.924554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:16.924554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:16.924554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:16.924554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:16.924554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:16.924554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:16.927671 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 238/494] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:16.928883 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b94dd-4aa3-4fd1-992b-88fcc3d76f83 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:16.990875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1937cee-ac26-43aa-83cc-96560bc8dc87 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:17.026239 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d383b-247a-4976-a604-1fb00cafd86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:17.026857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d383b-247a-4976-a604-1fb00cafd86a None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:17.027137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d383b-247a-4976-a604-1fb00cafd86a None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:17.027407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d383b-247a-4976-a604-1fb00cafd86a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:17.036226 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b94dd-4aa3-4fd1-992b-88fcc3d76f83 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:17.038330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d383b-247a-4976-a604-1fb00cafd86a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-b28d383b-247a-4976-a604-1fb00cafd86a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:17.045072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:17.046019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:17.046898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:17.046898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:17.046898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:17.046898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:17.046898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:17.046898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:17.046898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:17.046898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:17.046898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:17.046898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:17.046898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:17.046898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:17.046898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 257/495] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:17.047609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d383b-247a-4976-a604-1fb00cafd86a None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:17.070889 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae90223-4d72-4905-98fd-9e7b81ebe752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:17.071484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae90223-4d72-4905-98fd-9e7b81ebe752 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:17.071761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae90223-4d72-4905-98fd-9e7b81ebe752 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:17.072032 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae90223-4d72-4905-98fd-9e7b81ebe752 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:17.072752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae90223-4d72-4905-98fd-9e7b81ebe752 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:17.073085 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae90223-4d72-4905-98fd-9e7b81ebe752 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:17.074512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae90223-4d72-4905-98fd-9e7b81ebe752 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:17.110417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 239/496] 10.222.0.76 () {56 vars in 1133 bytes} [Fri Aug 26 08:39:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:17.111620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57177606-602c-4d26-b088-24056debba17 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:17.111905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57177606-602c-4d26-b088-24056debba17 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:17.112175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57177606-602c-4d26-b088-24056debba17 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:17.113399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 240/497] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:17.114076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57177606-602c-4d26-b088-24056debba17 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:17.135348 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:17.139031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:17.151396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d383b-247a-4976-a604-1fb00cafd86a None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:17.184983 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0693c4c-91cf-461f-822e-65a89080b311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:17.185597 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0693c4c-91cf-461f-822e-65a89080b311 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:17.185876 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0693c4c-91cf-461f-822e-65a89080b311 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:17.186147 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0693c4c-91cf-461f-822e-65a89080b311 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:17.186800 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0693c4c-91cf-461f-822e-65a89080b311 None admin] RBAC: Adding query filter params (name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:17.187101 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0693c4c-91cf-461f-822e-65a89080b311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:17.188486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0693c4c-91cf-461f-822e-65a89080b311 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:17.196458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 258/498] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:17.197070 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0693c4c-91cf-461f-822e-65a89080b311 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:17.219276 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57177606-602c-4d26-b088-24056debba17 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:17.253981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386eee9-d1e2-446c-b466-711be78da92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:17.256128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386eee9-d1e2-446c-b466-711be78da92a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:17.256128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386eee9-d1e2-446c-b466-711be78da92a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:17.256128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386eee9-d1e2-446c-b466-711be78da92a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:17.265551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386eee9-d1e2-446c-b466-711be78da92a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-1386eee9-d1e2-446c-b466-711be78da92a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:17.270217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:17.271156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:17.272005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:17.272005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:17.272005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:17.272005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:17.272005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:17.272005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:17.272005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:17.272005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:17.272005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:17.272005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:17.272005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:17.272005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:17.272005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 241/499] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:17.272681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386eee9-d1e2-446c-b466-711be78da92a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:17.299379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0693c4c-91cf-461f-822e-65a89080b311 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:17.332231 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55f252-a5be-4adf-afea-b77b8f7509ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:17.332838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55f252-a5be-4adf-afea-b77b8f7509ee None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:17.333178 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55f252-a5be-4adf-afea-b77b8f7509ee None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:17.333455 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55f252-a5be-4adf-afea-b77b8f7509ee None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:17.334124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55f252-a5be-4adf-afea-b77b8f7509ee None admin] RBAC: Adding query filter params (name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:17.334431 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55f252-a5be-4adf-afea-b77b8f7509ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:17.335793 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55f252-a5be-4adf-afea-b77b8f7509ee None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:17.345217 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 259/500] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:17.346196 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8402ac8-0488-431e-bb22-c9f18575d5ad None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:17.346484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8402ac8-0488-431e-bb22-c9f18575d5ad None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:17.346757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8402ac8-0488-431e-bb22-c9f18575d5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:17.355688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:17.364377 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-b8402ac8-0488-431e-bb22-c9f18575d5ad None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:17.365615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b8402ac8-0488-431e-bb22-c9f18575d5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:17.368348 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:17.373530 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386eee9-d1e2-446c-b466-711be78da92a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:17.406593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847a6d6-8346-40f5-bb2c-47c030517c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:17.407290 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847a6d6-8346-40f5-bb2c-47c030517c55 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:17.407582 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847a6d6-8346-40f5-bb2c-47c030517c55 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:17.407860 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847a6d6-8346-40f5-bb2c-47c030517c55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:17.431084 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 260/501] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:17.431963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8402ac8-0488-431e-bb22-c9f18575d5ad None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:17.478770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847a6d6-8346-40f5-bb2c-47c030517c55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:17.480315 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847a6d6-8346-40f5-bb2c-47c030517c55 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:17.531243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8402ac8-0488-431e-bb22-c9f18575d5ad None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:17.565983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:17.566352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d669c-fa05-490c-a012-82e8c6de532a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:17.566987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d669c-fa05-490c-a012-82e8c6de532a None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:17.567275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d669c-fa05-490c-a012-82e8c6de532a None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:17.567581 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d669c-fa05-490c-a012-82e8c6de532a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:17.577923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:17.581775 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d669c-fa05-490c-a012-82e8c6de532a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:17.583689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d669c-fa05-490c-a012-82e8c6de532a None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:17.596180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 242/502] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:39:17.597279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847a6d6-8346-40f5-bb2c-47c030517c55 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-fb7d669c-fa05-490c-a012-82e8c6de532a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:17.606078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:17.606995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:17.607841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:17.607841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:17.607841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:17.607841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 261/503] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:17.608068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d669c-fa05-490c-a012-82e8c6de532a None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:17.703994 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847a6d6-8346-40f5-bb2c-47c030517c55 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:17.717586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d669c-fa05-490c-a012-82e8c6de532a None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:17.737168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb040a8-46e1-4da7-8765-694523fa3a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:17.737764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb040a8-46e1-4da7-8765-694523fa3a33 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:17.738042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb040a8-46e1-4da7-8765-694523fa3a33 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:17.738311 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb040a8-46e1-4da7-8765-694523fa3a33 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:17.738960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb040a8-46e1-4da7-8765-694523fa3a33 None admin] RBAC: Adding query filter params (name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:17.739255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb040a8-46e1-4da7-8765-694523fa3a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:17.740619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb040a8-46e1-4da7-8765-694523fa3a33 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:17.748221 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 243/504] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:17.748960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb040a8-46e1-4da7-8765-694523fa3a33 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:17.753358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c27a34-c251-4529-83ff-f9330bc2464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:17.753978 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c27a34-c251-4529-83ff-f9330bc2464d None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:17.754260 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c27a34-c251-4529-83ff-f9330bc2464d None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:17.754533 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c27a34-c251-4529-83ff-f9330bc2464d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:17.766329 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c27a34-c251-4529-83ff-f9330bc2464d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:17.767787 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c27a34-c251-4529-83ff-f9330bc2464d None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-20c27a34-c251-4529-83ff-f9330bc2464d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:17.782391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:17.783375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:17.784234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:17.784234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:17.784234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:17.784234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 262/505] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:17.784234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c27a34-c251-4529-83ff-f9330bc2464d None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:17.803552 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:17.833271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:17.856598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb040a8-46e1-4da7-8765-694523fa3a33 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:17.885532 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c27a34-c251-4529-83ff-f9330bc2464d None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:17.890096 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a441c86-245b-4caf-b67d-014e315706e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:17.890713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a441c86-245b-4caf-b67d-014e315706e8 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:17.890994 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a441c86-245b-4caf-b67d-014e315706e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:17.891267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a441c86-245b-4caf-b67d-014e315706e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:17.901411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a441c86-245b-4caf-b67d-014e315706e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:17.902840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a441c86-245b-4caf-b67d-014e315706e8 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-1a441c86-245b-4caf-b67d-014e315706e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:17.916232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:17.917209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:17.918090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:17.918090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:17.918090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:17.918090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 244/506] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:17.918090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a441c86-245b-4caf-b67d-014e315706e8 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:17.922595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e9e8a-5c8f-4e5e-a442-4cee63ee156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:17.923193 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e9e8a-5c8f-4e5e-a442-4cee63ee156f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:17.923476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e9e8a-5c8f-4e5e-a442-4cee63ee156f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:17.923748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e9e8a-5c8f-4e5e-a442-4cee63ee156f None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:17.924382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e9e8a-5c8f-4e5e-a442-4cee63ee156f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:17.924673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e9e8a-5c8f-4e5e-a442-4cee63ee156f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:17.926073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e9e8a-5c8f-4e5e-a442-4cee63ee156f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:17.937980 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 263/507] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:17.938755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e9e8a-5c8f-4e5e-a442-4cee63ee156f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:18.017673 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:18.021254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a441c86-245b-4caf-b67d-014e315706e8 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:18.039296 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e9e8a-5c8f-4e5e-a442-4cee63ee156f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:18.041615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:18.054289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e34b6-df3b-43f5-8f0d-d119463a4ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:18.054911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e34b6-df3b-43f5-8f0d-d119463a4ad1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:18.055197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e34b6-df3b-43f5-8f0d-d119463a4ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:18.055474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e34b6-df3b-43f5-8f0d-d119463a4ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:18.066436 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e34b6-df3b-43f5-8f0d-d119463a4ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:18.067903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e34b6-df3b-43f5-8f0d-d119463a4ad1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:18.072966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198ead2-328e-43b9-b827-d05e9022adec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:18.073608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198ead2-328e-43b9-b827-d05e9022adec None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:18.073895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198ead2-328e-43b9-b827-d05e9022adec None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:18.074170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198ead2-328e-43b9-b827-d05e9022adec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-bc5e34b6-df3b-43f5-8f0d-d119463a4ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:18.082392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:18.083267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:18.084180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:18.084180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:18.084180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:18.084180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 245/508] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:18.084407 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e34b6-df3b-43f5-8f0d-d119463a4ad1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:18.085734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198ead2-328e-43b9-b827-d05e9022adec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:18.087177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198ead2-328e-43b9-b827-d05e9022adec None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-d198ead2-328e-43b9-b827-d05e9022adec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:18.102024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:18.102964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:18.103851 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:18.103851 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:18.103851 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:18.103851 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 264/509] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:18.104089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198ead2-328e-43b9-b827-d05e9022adec None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:18.185993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e34b6-df3b-43f5-8f0d-d119463a4ad1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:18.201976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198ead2-328e-43b9-b827-d05e9022adec None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:18.218432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0431f-d49a-4360-9ec7-24dd086fbf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:18.219033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0431f-d49a-4360-9ec7-24dd086fbf67 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:18.219311 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0431f-d49a-4360-9ec7-24dd086fbf67 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:18.219580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0431f-d49a-4360-9ec7-24dd086fbf67 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:18.220210 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0431f-d49a-4360-9ec7-24dd086fbf67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:18.220512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0431f-d49a-4360-9ec7-24dd086fbf67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:18.221893 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0431f-d49a-4360-9ec7-24dd086fbf67 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:18.234712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d99734-248c-4f1a-ac7b-2fbe09c0dd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:18.235302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d99734-248c-4f1a-ac7b-2fbe09c0dd87 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:18.235581 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d99734-248c-4f1a-ac7b-2fbe09c0dd87 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:18.235857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d99734-248c-4f1a-ac7b-2fbe09c0dd87 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:18.236488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d99734-248c-4f1a-ac7b-2fbe09c0dd87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:18.236791 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d99734-248c-4f1a-ac7b-2fbe09c0dd87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:18.238416 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d99734-248c-4f1a-ac7b-2fbe09c0dd87 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:18.238880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 246/510] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:18.239671 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0431f-d49a-4360-9ec7-24dd086fbf67 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:18.255136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 265/511] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:18.255136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d99734-248c-4f1a-ac7b-2fbe09c0dd87 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:18.260588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:18.269552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:18.348653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d99734-248c-4f1a-ac7b-2fbe09c0dd87 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:18.358239 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0431f-d49a-4360-9ec7-24dd086fbf67 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:18.382796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d457a-c2be-49c9-8f58-5819024ae695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:18.383391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d457a-c2be-49c9-8f58-5819024ae695 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:18.383672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d457a-c2be-49c9-8f58-5819024ae695 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:18.383949 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d457a-c2be-49c9-8f58-5819024ae695 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:18.384584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d457a-c2be-49c9-8f58-5819024ae695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:18.384888 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d457a-c2be-49c9-8f58-5819024ae695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:18.386282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d457a-c2be-49c9-8f58-5819024ae695 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:18.391285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312b9ba-6ad6-4d48-8a24-ba3d0eff2e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:18.391907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312b9ba-6ad6-4d48-8a24-ba3d0eff2e92 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:18.392191 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312b9ba-6ad6-4d48-8a24-ba3d0eff2e92 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:18.392469 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312b9ba-6ad6-4d48-8a24-ba3d0eff2e92 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:18.397341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 266/512] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:18.398118 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d457a-c2be-49c9-8f58-5819024ae695 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:18.399710 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312b9ba-6ad6-4d48-8a24-ba3d0eff2e92 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:18.401209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312b9ba-6ad6-4d48-8a24-ba3d0eff2e92 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-a312b9ba-6ad6-4d48-8a24-ba3d0eff2e92 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:18.413418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:18.414779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:18.415672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:18.415672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:18.415672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:18.415672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:18.415672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:18.415672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:18.415672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:18.415672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:18.415672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 08:39:18.415672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:18.415672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 247/513] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:18.415672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312b9ba-6ad6-4d48-8a24-ba3d0eff2e92 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:18.484136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:18.485839 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:18.507275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d457a-c2be-49c9-8f58-5819024ae695 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:18.516959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312b9ba-6ad6-4d48-8a24-ba3d0eff2e92 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:18.540100 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14776300-7384-4529-8235-84da17f5fbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:18.540699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14776300-7384-4529-8235-84da17f5fbfc None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:18.540978 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14776300-7384-4529-8235-84da17f5fbfc None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:18.541282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14776300-7384-4529-8235-84da17f5fbfc None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:18.541912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14776300-7384-4529-8235-84da17f5fbfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:18.542207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14776300-7384-4529-8235-84da17f5fbfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:18.543573 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14776300-7384-4529-8235-84da17f5fbfc None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:18.550202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4892637-ebcf-4772-9560-76a9a52cf778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:18.550825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4892637-ebcf-4772-9560-76a9a52cf778 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:18.551109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4892637-ebcf-4772-9560-76a9a52cf778 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:18.551384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4892637-ebcf-4772-9560-76a9a52cf778 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:18.555492 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 267/514] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:18.557367 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14776300-7384-4529-8235-84da17f5fbfc None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:18.558715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4892637-ebcf-4772-9560-76a9a52cf778 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:18.560186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4892637-ebcf-4772-9560-76a9a52cf778 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-b4892637-ebcf-4772-9560-76a9a52cf778 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:18.571105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:18.572034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:18.572959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:18.572959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:18.572959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:18.572959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:18.572959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:18.572959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:18.572959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:18.572959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:18.572959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 08:39:18.572959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:18.572959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 248/515] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:18.572959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4892637-ebcf-4772-9560-76a9a52cf778 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:18.661551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14776300-7384-4529-8235-84da17f5fbfc None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:18.671886 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4892637-ebcf-4772-9560-76a9a52cf778 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:18.695359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275445e-b03f-4da6-8f9f-5e0556500fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:18.695972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275445e-b03f-4da6-8f9f-5e0556500fcd None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:18.696269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275445e-b03f-4da6-8f9f-5e0556500fcd None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:18.696542 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275445e-b03f-4da6-8f9f-5e0556500fcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:18.699140 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:18.699369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:18.704491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275445e-b03f-4da6-8f9f-5e0556500fcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:18.705884 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02411bc9-8769-4be7-b75e-b66d28e442d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:18.706145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275445e-b03f-4da6-8f9f-5e0556500fcd None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:18.706491 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02411bc9-8769-4be7-b75e-b66d28e442d1 None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:18.706776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02411bc9-8769-4be7-b75e-b66d28e442d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:18.707054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02411bc9-8769-4be7-b75e-b66d28e442d1 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:18.707697 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02411bc9-8769-4be7-b75e-b66d28e442d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:18.709151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02411bc9-8769-4be7-b75e-b66d28e442d1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:18.718577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-3275445e-b03f-4da6-8f9f-5e0556500fcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:18.718577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:18.718577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:18.718577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:18.718577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:18.718577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:18.718577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:18.718577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:18.718577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:18.718577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:18.718577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:18.718577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:18.718577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:18.718577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:18.718577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:18.719609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:18.720508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:18.720508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:18.720508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:18.720508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:18.720508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:18.720508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:18.720508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:18.720508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:18.721228 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 268/516] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:18.722302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275445e-b03f-4da6-8f9f-5e0556500fcd None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:18.730957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 249/517] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:39:18 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:39:18.732544 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02411bc9-8769-4be7-b75e-b66d28e442d1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:18.835278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275445e-b03f-4da6-8f9f-5e0556500fcd None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:18.860774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02411bc9-8769-4be7-b75e-b66d28e442d1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:18.876166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524c125-dc2f-4c88-ad5f-2421202bb6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:18.877315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524c125-dc2f-4c88-ad5f-2421202bb6a9 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:18.877315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524c125-dc2f-4c88-ad5f-2421202bb6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:18.877510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524c125-dc2f-4c88-ad5f-2421202bb6a9 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:18.878126 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524c125-dc2f-4c88-ad5f-2421202bb6a9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:18.878437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524c125-dc2f-4c88-ad5f-2421202bb6a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:18.879950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524c125-dc2f-4c88-ad5f-2421202bb6a9 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:18.903895 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eba6d-4686-4dae-9a25-e3e26c924b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:18.904114 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eba6d-4686-4dae-9a25-e3e26c924b47 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:18.904399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eba6d-4686-4dae-9a25-e3e26c924b47 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:18.904683 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eba6d-4686-4dae-9a25-e3e26c924b47 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:18.916413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3eba6d-4686-4dae-9a25-e3e26c924b47 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:18.917910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3eba6d-4686-4dae-9a25-e3e26c924b47 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:18.921811 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 269/518] 10.222.0.76 () {56 vars in 1137 bytes} [Fri Aug 26 08:39:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:18.922668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524c125-dc2f-4c88-ad5f-2421202bb6a9 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-fb3eba6d-4686-4dae-9a25-e3e26c924b47 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:18.932316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:18.933428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:18.934380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:18.934380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:18.934380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:18.934380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:18.934380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:18.934380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:18.934380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:18.934380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:18.934380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 08:39:18.934380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:18.938103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 250/519] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:18.938830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eba6d-4686-4dae-9a25-e3e26c924b47 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:18.984057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:18.985949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:19.033306 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524c125-dc2f-4c88-ad5f-2421202bb6a9 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:19.042888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eba6d-4686-4dae-9a25-e3e26c924b47 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:19.069773 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7976bc-93a4-4498-87e3-3911924ba836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:19.070803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7976bc-93a4-4498-87e3-3911924ba836 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:19.071308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7976bc-93a4-4498-87e3-3911924ba836 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:19.071785 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7976bc-93a4-4498-87e3-3911924ba836 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:19.072579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7976bc-93a4-4498-87e3-3911924ba836 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:19.072964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7976bc-93a4-4498-87e3-3911924ba836 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:19.074435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7976bc-93a4-4498-87e3-3911924ba836 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:19.076626 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd627bc-1830-4f8c-b211-9f6b9a9d330a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:19.077251 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd627bc-1830-4f8c-b211-9f6b9a9d330a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:19.077537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd627bc-1830-4f8c-b211-9f6b9a9d330a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:19.077812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd627bc-1830-4f8c-b211-9f6b9a9d330a None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:19.078499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd627bc-1830-4f8c-b211-9f6b9a9d330a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:19.078803 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd627bc-1830-4f8c-b211-9f6b9a9d330a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:19.080215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd627bc-1830-4f8c-b211-9f6b9a9d330a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:19.095502 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 270/520] 10.222.0.76 () {56 vars in 1137 bytes} [Fri Aug 26 08:39:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:19.096600 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7976bc-93a4-4498-87e3-3911924ba836 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:19.102519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 251/521] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:19.103531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd627bc-1830-4f8c-b211-9f6b9a9d330a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:19.201274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7976bc-93a4-4498-87e3-3911924ba836 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:19.210979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd627bc-1830-4f8c-b211-9f6b9a9d330a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:19.221400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:19.222897 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:19.253485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57d5cd-26f7-47bd-85e8-7faf87cc0084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:19.254103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57d5cd-26f7-47bd-85e8-7faf87cc0084 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:19.254383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57d5cd-26f7-47bd-85e8-7faf87cc0084 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:19.254656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57d5cd-26f7-47bd-85e8-7faf87cc0084 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:19.255220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcc411-9b9e-4959-9570-1541879ed22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:19.255401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57d5cd-26f7-47bd-85e8-7faf87cc0084 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:19.255681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57d5cd-26f7-47bd-85e8-7faf87cc0084 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:19.255837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcc411-9b9e-4959-9570-1541879ed22c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:19.256088 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcc411-9b9e-4959-9570-1541879ed22c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:19.256359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcc411-9b9e-4959-9570-1541879ed22c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:19.257277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57d5cd-26f7-47bd-85e8-7faf87cc0084 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:19.274978 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 252/522] 10.222.0.76 () {56 vars in 1139 bytes} [Fri Aug 26 08:39:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:19.275908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57d5cd-26f7-47bd-85e8-7faf87cc0084 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:19.333677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcc411-9b9e-4959-9570-1541879ed22c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:19.335257 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcc411-9b9e-4959-9570-1541879ed22c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:19.382918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57d5cd-26f7-47bd-85e8-7faf87cc0084 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:19.422681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de1cd2-8c66-4a1c-91b0-69d4d1e17aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:19.423660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de1cd2-8c66-4a1c-91b0-69d4d1e17aac None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:19.423948 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de1cd2-8c66-4a1c-91b0-69d4d1e17aac None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:19.424385 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de1cd2-8c66-4a1c-91b0-69d4d1e17aac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:19.439072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 271/523] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:39:19.439072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcc411-9b9e-4959-9570-1541879ed22c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:19.449761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:19.461725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:19.500852 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de1cd2-8c66-4a1c-91b0-69d4d1e17aac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:19.502355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de1cd2-8c66-4a1c-91b0-69d4d1e17aac None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:19.542941 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcc411-9b9e-4959-9570-1541879ed22c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:19.582176 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01184e52-608e-42c5-b5e5-13efa14cba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:19.582880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01184e52-608e-42c5-b5e5-13efa14cba1f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:19.583262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01184e52-608e-42c5-b5e5-13efa14cba1f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:19.584195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01184e52-608e-42c5-b5e5-13efa14cba1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:19.584441 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01184e52-608e-42c5-b5e5-13efa14cba1f None admin] RBAC: Adding query filter params (role.id=7aef270090c546a0aff3f62f1fcf517a, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=b63d6e588f6e4b598b75a2ec13bea25d) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:19.587252 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01184e52-608e-42c5-b5e5-13efa14cba1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:19.587252 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01184e52-608e-42c5-b5e5-13efa14cba1f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:19.592313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 272/524] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:19 2022] GET /identity/v3/role_assignments?user.id=b63d6e588f6e4b598b75a2ec13bea25d&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=7aef270090c546a0aff3f62f1fcf517a => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:19.593078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01184e52-608e-42c5-b5e5-13efa14cba1f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:19.631241 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 253/525] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:39:19.632560 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de1cd2-8c66-4a1c-91b0-69d4d1e17aac None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:19.686035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:19.713470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:19.718900 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01184e52-608e-42c5-b5e5-13efa14cba1f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:19.758343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ec163-6b96-4814-9dba-d9385c5361e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:19.759300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ec163-6b96-4814-9dba-d9385c5361e7 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:19.759767 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ec163-6b96-4814-9dba-d9385c5361e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:19.760108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ec163-6b96-4814-9dba-d9385c5361e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:19.764886 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de1cd2-8c66-4a1c-91b0-69d4d1e17aac None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:19.809304 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a8d01-de8d-441d-a9b6-418ca9bbc6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:19.810514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a8d01-de8d-441d-a9b6-418ca9bbc6af None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:19.810885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a8d01-de8d-441d-a9b6-418ca9bbc6af None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:19.811264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a8d01-de8d-441d-a9b6-418ca9bbc6af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:19.822131 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a8d01-de8d-441d-a9b6-418ca9bbc6af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:19.823892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a8d01-de8d-441d-a9b6-418ca9bbc6af None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-375a8d01-de8d-441d-a9b6-418ca9bbc6af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:19.839717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:19.840870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:19.841950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:19.841950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:19.841950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:19.846420 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ec163-6b96-4814-9dba-d9385c5361e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:19.847754 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 254/526] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:19.848229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ec163-6b96-4814-9dba-d9385c5361e7 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:19.848824 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a8d01-de8d-441d-a9b6-418ca9bbc6af None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:19.955738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 273/527] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:39:19.955738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:19.956569 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ec163-6b96-4814-9dba-d9385c5361e7 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:19.983997 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a8d01-de8d-441d-a9b6-418ca9bbc6af None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:20.002387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:20.022810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150e542-44cb-4095-aa8c-fa50109a0152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:20.023772 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150e542-44cb-4095-aa8c-fa50109a0152 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:20.024248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150e542-44cb-4095-aa8c-fa50109a0152 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:20.024786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150e542-44cb-4095-aa8c-fa50109a0152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:20.036888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150e542-44cb-4095-aa8c-fa50109a0152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:20.038752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150e542-44cb-4095-aa8c-fa50109a0152 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-9150e542-44cb-4095-aa8c-fa50109a0152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:20.054138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:20.055093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:20.055950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:20.055950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:20.055950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:20.058088 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 255/528] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:20.059140 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150e542-44cb-4095-aa8c-fa50109a0152 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:20.060599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ec163-6b96-4814-9dba-d9385c5361e7 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:20.096583 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53a043-f780-4c28-a712-6fce994f2419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:20.097278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53a043-f780-4c28-a712-6fce994f2419 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:20.097486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53a043-f780-4c28-a712-6fce994f2419 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:20.097728 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53a043-f780-4c28-a712-6fce994f2419 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:20.098365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53a043-f780-4c28-a712-6fce994f2419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:20.098654 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53a043-f780-4c28-a712-6fce994f2419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:20.100091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53a043-f780-4c28-a712-6fce994f2419 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:20.116742 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 274/529] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:20.117669 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53a043-f780-4c28-a712-6fce994f2419 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:20.154677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:20.171841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150e542-44cb-4095-aa8c-fa50109a0152 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:20.209904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae665d47-b1c5-4094-ae88-8c930135b7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:20.210919 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae665d47-b1c5-4094-ae88-8c930135b7d2 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:20.211426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae665d47-b1c5-4094-ae88-8c930135b7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:20.211896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae665d47-b1c5-4094-ae88-8c930135b7d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:20.222718 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53a043-f780-4c28-a712-6fce994f2419 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:20.224697 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae665d47-b1c5-4094-ae88-8c930135b7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:20.226421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae665d47-b1c5-4094-ae88-8c930135b7d2 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-ae665d47-b1c5-4094-ae88-8c930135b7d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:20.242193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:20.243106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:20.243962 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:20.243962 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:20.243962 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:20.251019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 256/530] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:20.252267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae665d47-b1c5-4094-ae88-8c930135b7d2 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:20.257720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11875c24-73b7-4a97-807e-d43185955867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:20.258389 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875c24-73b7-4a97-807e-d43185955867 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:20.258679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875c24-73b7-4a97-807e-d43185955867 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:20.258966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875c24-73b7-4a97-807e-d43185955867 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:20.259595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11875c24-73b7-4a97-807e-d43185955867 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:20.259969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11875c24-73b7-4a97-807e-d43185955867 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:20.261349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11875c24-73b7-4a97-807e-d43185955867 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:20.274835 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 275/531] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:20.275859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11875c24-73b7-4a97-807e-d43185955867 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:20.279066 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:20.365350 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae665d47-b1c5-4094-ae88-8c930135b7d2 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:20.377350 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:20.383599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11875c24-73b7-4a97-807e-d43185955867 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:20.405162 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf9448-87b4-489e-869a-602c302a86b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:20.406321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf9448-87b4-489e-869a-602c302a86b9 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:20.406810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf9448-87b4-489e-869a-602c302a86b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:20.407321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf9448-87b4-489e-869a-602c302a86b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:20.415162 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf9448-87b4-489e-869a-602c302a86b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:20.416880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf9448-87b4-489e-869a-602c302a86b9 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:20.420750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0dd58-65e4-4b67-9f1a-79145a3e7713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:20.421425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0dd58-65e4-4b67-9f1a-79145a3e7713 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:20.421715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0dd58-65e4-4b67-9f1a-79145a3e7713 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:20.421989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0dd58-65e4-4b67-9f1a-79145a3e7713 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:20.422618 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0dd58-65e4-4b67-9f1a-79145a3e7713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:20.422920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0dd58-65e4-4b67-9f1a-79145a3e7713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:20.424256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0dd58-65e4-4b67-9f1a-79145a3e7713 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:20.431578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-6abf9448-87b4-489e-869a-602c302a86b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:20.431578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:20.431578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:20.431578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:20.431578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:20.431578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:20.431578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:20.431578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:20.431578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:20.431578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:20.431578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:20.431578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:20.431578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:20.431578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:20.431578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:20.432757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:20.433666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:20.433666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:20.433666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:20.433666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:20.433666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:20.433666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:20.433666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:20.433666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:20.436584 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 257/532] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:20.437640 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf9448-87b4-489e-869a-602c302a86b9 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:20.452209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 276/533] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:20.452209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0dd58-65e4-4b67-9f1a-79145a3e7713 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:20.538541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:20.549800 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0dd58-65e4-4b67-9f1a-79145a3e7713 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:20.560883 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf9448-87b4-489e-869a-602c302a86b9 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:20.588328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1a9ea-1b8f-4f01-8ced-03deff0cbc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:20.589203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1a9ea-1b8f-4f01-8ced-03deff0cbc2c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:20.589496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1a9ea-1b8f-4f01-8ced-03deff0cbc2c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:20.589773 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1a9ea-1b8f-4f01-8ced-03deff0cbc2c None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:20.590474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1a9ea-1b8f-4f01-8ced-03deff0cbc2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:20.590817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1a9ea-1b8f-4f01-8ced-03deff0cbc2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:20.592249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1a9ea-1b8f-4f01-8ced-03deff0cbc2c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:20.608582 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4522be-2e44-47e4-8502-87b65250cda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:20.609568 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4522be-2e44-47e4-8502-87b65250cda2 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:20.610049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4522be-2e44-47e4-8502-87b65250cda2 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:20.610551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4522be-2e44-47e4-8502-87b65250cda2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:20.616661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 277/534] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:20.617707 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1a9ea-1b8f-4f01-8ced-03deff0cbc2c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:20.618327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4522be-2e44-47e4-8502-87b65250cda2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:20.619985 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4522be-2e44-47e4-8502-87b65250cda2 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:20.633119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-5c4522be-2e44-47e4-8502-87b65250cda2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:20.633119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:20.633119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:20.633119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:20.633119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:20.633119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:20.633119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:20.633119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:20.633119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:20.633119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:20.633119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:20.633119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:20.633119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:20.633119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:20.633119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:20.634016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:20.634872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:20.634872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:20.634872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:20.634872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:20.634872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:20.634872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:20.634872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:20.634872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:20.637293 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 258/535] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:20.637802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:20.639496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4522be-2e44-47e4-8502-87b65250cda2 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:20.728243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1a9ea-1b8f-4f01-8ced-03deff0cbc2c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:20.751951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4522be-2e44-47e4-8502-87b65250cda2 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:20.761734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e1ba4-9a44-41b9-874e-b8639c0bece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:20.762360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e1ba4-9a44-41b9-874e-b8639c0bece7 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:20.762686 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e1ba4-9a44-41b9-874e-b8639c0bece7 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:20.762961 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e1ba4-9a44-41b9-874e-b8639c0bece7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:20.769450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e1ba4-9a44-41b9-874e-b8639c0bece7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:20.770888 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e1ba4-9a44-41b9-874e-b8639c0bece7 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:20.782358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-304e1ba4-9a44-41b9-874e-b8639c0bece7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:20.782358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:20.782358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:20.782358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:20.782358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:20.782358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:20.782358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:20.782358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:20.782358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:20.782358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:20.782358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:20.782358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:20.782358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:20.782358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:20.782358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:20.783213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:20.784062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:20.784062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:20.784062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:20.784062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:20.784062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:20.784062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:20.784062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:20.784062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:20.784062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 278/536] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:20.784523 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e1ba4-9a44-41b9-874e-b8639c0bece7 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:20.794557 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db6761-9246-4fba-8622-7457e8954bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:20.795380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db6761-9246-4fba-8622-7457e8954bcf None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:20.795855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db6761-9246-4fba-8622-7457e8954bcf None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:20.796307 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db6761-9246-4fba-8622-7457e8954bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:20.797334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db6761-9246-4fba-8622-7457e8954bcf None admin] RBAC: Adding query filter params (role.id=7aef270090c546a0aff3f62f1fcf517a, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=0f3147e5695240afa9eaf42d2343b7c9) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:20.797836 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db6761-9246-4fba-8622-7457e8954bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:20.799440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db6761-9246-4fba-8622-7457e8954bcf None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:20.805336 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 259/537] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:20 2022] GET /identity/v3/role_assignments?user.id=0f3147e5695240afa9eaf42d2343b7c9&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=7aef270090c546a0aff3f62f1fcf517a => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:20.806713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362823c7-8d6a-448c-9be8-06517950735e None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:20.806998 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362823c7-8d6a-448c-9be8-06517950735e None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:20.807272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362823c7-8d6a-448c-9be8-06517950735e None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:20.808616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 260/538] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:20.817070 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362823c7-8d6a-448c-9be8-06517950735e None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:20.817070 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:20.892748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:20.922614 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e1ba4-9a44-41b9-874e-b8639c0bece7 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:20.957462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362823c7-8d6a-448c-9be8-06517950735e None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:20.963445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ec6f4-3f74-47e1-94fe-029fe1227ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:20.964315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ec6f4-3f74-47e1-94fe-029fe1227ab1 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:20.964593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ec6f4-3f74-47e1-94fe-029fe1227ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:20.964863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ec6f4-3f74-47e1-94fe-029fe1227ab1 None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:20.966130 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ec6f4-3f74-47e1-94fe-029fe1227ab1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:20.966714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ec6f4-3f74-47e1-94fe-029fe1227ab1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:20.967988 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ec6f4-3f74-47e1-94fe-029fe1227ab1 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:20.982919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 279/539] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:20.984132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c9e82-03aa-4007-9d0a-4da6b61c2815 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:20.984413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c9e82-03aa-4007-9d0a-4da6b61c2815 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:20.984685 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c9e82-03aa-4007-9d0a-4da6b61c2815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:21.003826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a42d5-3a1a-4432-8c68-66fccad10dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:21.004159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-150c9e82-03aa-4007-9d0a-4da6b61c2815 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:21.004426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a42d5-3a1a-4432-8c68-66fccad10dd1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:21.004703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a42d5-3a1a-4432-8c68-66fccad10dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:21.005051 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a42d5-3a1a-4432-8c68-66fccad10dd1 None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:21.005377 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-150c9e82-03aa-4007-9d0a-4da6b61c2815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:21.005758 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a42d5-3a1a-4432-8c68-66fccad10dd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:21.006113 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a42d5-3a1a-4432-8c68-66fccad10dd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:21.007877 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a42d5-3a1a-4432-8c68-66fccad10dd1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:21.029099 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 261/540] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:21.029977 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a42d5-3a1a-4432-8c68-66fccad10dd1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:21.080137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 280/541] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:21.080740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c9e82-03aa-4007-9d0a-4da6b61c2815 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:21.129637 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:21.193411 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:21.194864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a42d5-3a1a-4432-8c68-66fccad10dd1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:21.254420 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c9e82-03aa-4007-9d0a-4da6b61c2815 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:21.285728 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fab23-4767-48d7-9c8a-b10e67cd9907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:21.286345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fab23-4767-48d7-9c8a-b10e67cd9907 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:21.286626 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fab23-4767-48d7-9c8a-b10e67cd9907 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:21.286901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fab23-4767-48d7-9c8a-b10e67cd9907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:21.287635 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0fab23-4767-48d7-9c8a-b10e67cd9907 None admin] RBAC: Adding query filter params (role.id=7aef270090c546a0aff3f62f1fcf517a, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=9fde38c1a2a844368acd3e1b9aa10151) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:21.287929 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0fab23-4767-48d7-9c8a-b10e67cd9907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:21.289397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0fab23-4767-48d7-9c8a-b10e67cd9907 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:21.294479 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e962c-2fdd-43a7-8931-60c1a78b45bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:21.295343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e962c-2fdd-43a7-8931-60c1a78b45bf None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:21.295829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e962c-2fdd-43a7-8931-60c1a78b45bf None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:21.296320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e962c-2fdd-43a7-8931-60c1a78b45bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:21.297279 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e962c-2fdd-43a7-8931-60c1a78b45bf None admin] RBAC: Adding query filter params (role.id=7aef270090c546a0aff3f62f1fcf517a, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=e8a867070e974a918a906148bbfd1fd0) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:21.297977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e962c-2fdd-43a7-8931-60c1a78b45bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:21.299715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e962c-2fdd-43a7-8931-60c1a78b45bf None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:21.300021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 262/542] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:21 2022] GET /identity/v3/role_assignments?user.id=9fde38c1a2a844368acd3e1b9aa10151&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=7aef270090c546a0aff3f62f1fcf517a => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:21.306662 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 281/543] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:21 2022] GET /identity/v3/role_assignments?user.id=e8a867070e974a918a906148bbfd1fd0&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=7aef270090c546a0aff3f62f1fcf517a => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:21.382862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fab23-4767-48d7-9c8a-b10e67cd9907 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:21.537908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fab23-4767-48d7-9c8a-b10e67cd9907 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:21.566400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd467207-1b21-4335-9760-d9db29158162 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:21.566910 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd467207-1b21-4335-9760-d9db29158162 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:21.567012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd467207-1b21-4335-9760-d9db29158162 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:21.568328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 282/544] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:39:21.571384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:21.578356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60c36d-8304-49e8-8f43-728142cebe08 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:21.578356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60c36d-8304-49e8-8f43-728142cebe08 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:21.578356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60c36d-8304-49e8-8f43-728142cebe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:21.587459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5250f15-c942-4e34-b819-757c5a923769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:21.588098 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5250f15-c942-4e34-b819-757c5a923769 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:21.588382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5250f15-c942-4e34-b819-757c5a923769 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:21.588656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5250f15-c942-4e34-b819-757c5a923769 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:21.599991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5250f15-c942-4e34-b819-757c5a923769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:21.604595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-9e60c36d-8304-49e8-8f43-728142cebe08 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-b5250f15-c942-4e34-b819-757c5a923769 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:21.605119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:21.606006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:21.606868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:21.606868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:21.606868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:21.606868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:21.606868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:21.606868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:21.606868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:21.606868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:21.606868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:21.606868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:21.606868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:21.606868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:21.607485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9e60c36d-8304-49e8-8f43-728142cebe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:21.607583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 263/545] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:21.612081 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5250f15-c942-4e34-b819-757c5a923769 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:21.691449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 283/546] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:21.771257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5250f15-c942-4e34-b819-757c5a923769 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:21.817906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd982a-6c75-474e-a9ad-94efe6e3ccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:21.818527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd982a-6c75-474e-a9ad-94efe6e3ccc6 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:21.818814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd982a-6c75-474e-a9ad-94efe6e3ccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:21.819095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd982a-6c75-474e-a9ad-94efe6e3ccc6 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:21.819779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd982a-6c75-474e-a9ad-94efe6e3ccc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:21.820088 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd982a-6c75-474e-a9ad-94efe6e3ccc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:21.821521 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd982a-6c75-474e-a9ad-94efe6e3ccc6 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:21.834233 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 264/547] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:21.839600 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60c36d-8304-49e8-8f43-728142cebe08 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:21.913556 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:21.958682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60c36d-8304-49e8-8f43-728142cebe08 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:22.007458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85f95a-31ce-4e04-9917-0eea8634c935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:22.008150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85f95a-31ce-4e04-9917-0eea8634c935 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:22.008529 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85f95a-31ce-4e04-9917-0eea8634c935 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:22.008811 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85f95a-31ce-4e04-9917-0eea8634c935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:22.027058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85f95a-31ce-4e04-9917-0eea8634c935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:22.028635 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85f95a-31ce-4e04-9917-0eea8634c935 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-8a85f95a-31ce-4e04-9917-0eea8634c935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:22.044330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:22.045282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:22.046150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:22.046150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:22.046150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:22.046150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 284/548] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:22.054101 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd982a-6c75-474e-a9ad-94efe6e3ccc6 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:22.109465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85f95a-31ce-4e04-9917-0eea8634c935 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:22.134940 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:22.210933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd982a-6c75-474e-a9ad-94efe6e3ccc6 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:22.246827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327bcd3-fb94-437c-80a6-f16f63788510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:22.247946 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327bcd3-fb94-437c-80a6-f16f63788510 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:22.248231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327bcd3-fb94-437c-80a6-f16f63788510 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:22.248511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327bcd3-fb94-437c-80a6-f16f63788510 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:22.249185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327bcd3-fb94-437c-80a6-f16f63788510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:22.249492 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327bcd3-fb94-437c-80a6-f16f63788510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:22.250863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327bcd3-fb94-437c-80a6-f16f63788510 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:22.263509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 265/549] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:22.269076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327bcd3-fb94-437c-80a6-f16f63788510 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:22.331027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85f95a-31ce-4e04-9917-0eea8634c935 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:22.363134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:22.376166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327bcd3-fb94-437c-80a6-f16f63788510 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:22.387957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:22.401999 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308415e-770e-4b56-8c51-08d25bb483d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:22.402626 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308415e-770e-4b56-8c51-08d25bb483d4 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:22.402905 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308415e-770e-4b56-8c51-08d25bb483d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:22.403705 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308415e-770e-4b56-8c51-08d25bb483d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:22.413967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308415e-770e-4b56-8c51-08d25bb483d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-e308415e-770e-4b56-8c51-08d25bb483d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:22.419736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:22.421281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:22.422265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:22.422265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:22.422265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:22.422265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:22.422265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:22.422265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:22.422265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:22.422265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:22.422265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:22.422265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:22.422265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:22.422265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:22.422265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 285/550] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:22.426705 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308415e-770e-4b56-8c51-08d25bb483d4 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:22.430535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9923c82-8bd2-4e38-89cf-06232d78139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:22.431166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9923c82-8bd2-4e38-89cf-06232d78139a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:22.431444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9923c82-8bd2-4e38-89cf-06232d78139a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:22.431710 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9923c82-8bd2-4e38-89cf-06232d78139a None admin] PATH_INFO: `/v3/users/swift` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:22.451357 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9923c82-8bd2-4e38-89cf-06232d78139a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:22.452858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9923c82-8bd2-4e38-89cf-06232d78139a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-b9923c82-8bd2-4e38-89cf-06232d78139a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:22.474048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:22.475002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:22.476084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:22.476084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:22.476084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:22.476084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:22.476084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:22.476084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:22.476084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:22.476084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:22.476084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 08:39:22.476084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:22.482328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 266/551] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:39:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:22.483220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9923c82-8bd2-4e38-89cf-06232d78139a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:22.588707 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308415e-770e-4b56-8c51-08d25bb483d4 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:22.658552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44366c1a-b614-4f65-a5bb-961bca8d0dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:22.659172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44366c1a-b614-4f65-a5bb-961bca8d0dca None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:22.659451 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44366c1a-b614-4f65-a5bb-961bca8d0dca None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:22.659721 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44366c1a-b614-4f65-a5bb-961bca8d0dca None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:22.660391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44366c1a-b614-4f65-a5bb-961bca8d0dca None admin] RBAC: Adding query filter params (name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:22.660693 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44366c1a-b614-4f65-a5bb-961bca8d0dca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:22.662136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44366c1a-b614-4f65-a5bb-961bca8d0dca None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:22.671490 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 286/552] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:22.676823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44366c1a-b614-4f65-a5bb-961bca8d0dca None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:22.679180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9923c82-8bd2-4e38-89cf-06232d78139a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:22.732153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:22.754177 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49833e-237a-4797-9c4a-6c60e37af1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:22.754781 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49833e-237a-4797-9c4a-6c60e37af1d7 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:22.755063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49833e-237a-4797-9c4a-6c60e37af1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:22.755337 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49833e-237a-4797-9c4a-6c60e37af1d7 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:22.756065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49833e-237a-4797-9c4a-6c60e37af1d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:22.756366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49833e-237a-4797-9c4a-6c60e37af1d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:22.757810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49833e-237a-4797-9c4a-6c60e37af1d7 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:22.796723 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 267/553] 10.222.0.76 () {56 vars in 1135 bytes} [Fri Aug 26 08:39:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:22.802913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49833e-237a-4797-9c4a-6c60e37af1d7 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:22.853352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:22.860770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44366c1a-b614-4f65-a5bb-961bca8d0dca None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:22.927416 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a358c3-aeb9-43b0-b308-3a686c9dc23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:22.928051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a358c3-aeb9-43b0-b308-3a686c9dc23f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:22.928328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a358c3-aeb9-43b0-b308-3a686c9dc23f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:22.928601 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a358c3-aeb9-43b0-b308-3a686c9dc23f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:22.946160 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a358c3-aeb9-43b0-b308-3a686c9dc23f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:22.947618 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a358c3-aeb9-43b0-b308-3a686c9dc23f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-18a358c3-aeb9-43b0-b308-3a686c9dc23f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:22.974333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:22.975310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:22.976190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:22.976190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:22.976190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:22.981738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 287/554] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:22.984861 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a358c3-aeb9-43b0-b308-3a686c9dc23f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:22.995254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49833e-237a-4797-9c4a-6c60e37af1d7 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:23.060075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cc1c9-ca07-4b4f-b85b-9a8db30ee06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:23.060688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cc1c9-ca07-4b4f-b85b-9a8db30ee06b None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:23.061033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cc1c9-ca07-4b4f-b85b-9a8db30ee06b None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:23.061316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cc1c9-ca07-4b4f-b85b-9a8db30ee06b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:23.137415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:23.154159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a358c3-aeb9-43b0-b308-3a686c9dc23f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:23.156908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cc1c9-ca07-4b4f-b85b-9a8db30ee06b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:23.158987 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cc1c9-ca07-4b4f-b85b-9a8db30ee06b None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:23.190269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:23.203859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a0ccb-f4d4-4c8c-9928-ce57c0f85979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:23.204471 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a0ccb-f4d4-4c8c-9928-ce57c0f85979 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:23.205371 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a0ccb-f4d4-4c8c-9928-ce57c0f85979 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:23.205657 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a0ccb-f4d4-4c8c-9928-ce57c0f85979 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:23.206311 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a0ccb-f4d4-4c8c-9928-ce57c0f85979 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:23.206623 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a0ccb-f4d4-4c8c-9928-ce57c0f85979 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:23.208868 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a0ccb-f4d4-4c8c-9928-ce57c0f85979 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:23.226159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 288/555] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:23.228014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763b5d-a516-4cca-a722-84f148f75057 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:23.228306 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763b5d-a516-4cca-a722-84f148f75057 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:23.229018 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763b5d-a516-4cca-a722-84f148f75057 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:23.230897 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 289/556] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:23.231832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89763b5d-a516-4cca-a722-84f148f75057 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:23.275413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 268/557] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:39:23.276874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e40085-a455-4bcb-b58c-5e9b232db170 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:23.277283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e40085-a455-4bcb-b58c-5e9b232db170 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:23.277700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e40085-a455-4bcb-b58c-5e9b232db170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:23.304910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-61e40085-a455-4bcb-b58c-5e9b232db170 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:23.306860 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-61e40085-a455-4bcb-b58c-5e9b232db170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:23.356175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89763b5d-a516-4cca-a722-84f148f75057 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:23.387279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 269/558] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:23.393915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e40085-a455-4bcb-b58c-5e9b232db170 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:23.407807 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5f350-c76b-450e-8136-fbd8f72a17df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:23.408528 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5f350-c76b-450e-8136-fbd8f72a17df None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:23.409085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5f350-c76b-450e-8136-fbd8f72a17df None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:23.409085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5f350-c76b-450e-8136-fbd8f72a17df None admin] PATH_INFO: `/v3/users/nova` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:23.427241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5f350-c76b-450e-8136-fbd8f72a17df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:23.428712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5f350-c76b-450e-8136-fbd8f72a17df None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-09c5f350-c76b-450e-8136-fbd8f72a17df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:23.453855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:23.455768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:23.457731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:23.457731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:23.457731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:23.457731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:23.457731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:23.457731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:23.457731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:23.457731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:23.457731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:39:23.457731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:23.461826 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 290/559] 10.222.0.76 () {56 vars in 1093 bytes} [Fri Aug 26 08:39:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:23.467651 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5f350-c76b-450e-8136-fbd8f72a17df None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:23.482528 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:23.508022 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:23.554888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e40085-a455-4bcb-b58c-5e9b232db170 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:23.588047 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5f350-c76b-450e-8136-fbd8f72a17df None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:23.598167 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0c127-2f15-41f5-ad83-b9dc1780d6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:23.598167 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c127-2f15-41f5-ad83-b9dc1780d6ca None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:23.598167 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c127-2f15-41f5-ad83-b9dc1780d6ca None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:23.598167 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c127-2f15-41f5-ad83-b9dc1780d6ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:23.609205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0c127-2f15-41f5-ad83-b9dc1780d6ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:23.610662 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0c127-2f15-41f5-ad83-b9dc1780d6ca None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:23.623189 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb17f4-991d-4b14-a8cc-b6111c3909a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:23.623804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb17f4-991d-4b14-a8cc-b6111c3909a6 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:23.624060 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb17f4-991d-4b14-a8cc-b6111c3909a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:23.624331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb17f4-991d-4b14-a8cc-b6111c3909a6 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:23.625073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb17f4-991d-4b14-a8cc-b6111c3909a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:23.625382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb17f4-991d-4b14-a8cc-b6111c3909a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:23.626795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb17f4-991d-4b14-a8cc-b6111c3909a6 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-22e0c127-2f15-41f5-ad83-b9dc1780d6ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:23.627514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:23.628423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:23.629950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:23.629950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:23.629950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:23.629950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 270/560] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:23.631656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c3a7e-c28c-4c11-91fe-180610c322d6 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:23.631656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c3a7e-c28c-4c11-91fe-180610c322d6 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:23.631656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c3a7e-c28c-4c11-91fe-180610c322d6 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:23.632682 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 271/561] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:23.634480 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c3a7e-c28c-4c11-91fe-180610c322d6 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:23.648787 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 291/562] 10.222.0.76 () {56 vars in 1133 bytes} [Fri Aug 26 08:39:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:23.650059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9ddb6-1856-49f2-947d-2e7dea6bc331 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:23.650345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9ddb6-1856-49f2-947d-2e7dea6bc331 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:23.650616 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9ddb6-1856-49f2-947d-2e7dea6bc331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:23.669785 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-f4a9ddb6-1856-49f2-947d-2e7dea6bc331 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:23.671110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f4a9ddb6-1856-49f2-947d-2e7dea6bc331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:23.730829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:23.740161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 292/563] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:23.740965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9ddb6-1856-49f2-947d-2e7dea6bc331 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:23.748888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c3a7e-c28c-4c11-91fe-180610c322d6 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:23.759693 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:23.785096 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8644b-b644-4e93-bc38-3fb1af9fc75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:23.785700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8644b-b644-4e93-bc38-3fb1af9fc75d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:23.785981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8644b-b644-4e93-bc38-3fb1af9fc75d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:23.786253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8644b-b644-4e93-bc38-3fb1af9fc75d None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:23.786891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8644b-b644-4e93-bc38-3fb1af9fc75d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:23.787191 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8644b-b644-4e93-bc38-3fb1af9fc75d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:23.788544 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8644b-b644-4e93-bc38-3fb1af9fc75d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:23.805285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 272/564] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:23.805285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e30f6-8ab0-4d24-8057-b1ec089d6111 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:23.805285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e30f6-8ab0-4d24-8057-b1ec089d6111 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:23.805285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e30f6-8ab0-4d24-8057-b1ec089d6111 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:23.805285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 273/565] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:23.805285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e30f6-8ab0-4d24-8057-b1ec089d6111 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:23.855499 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9ddb6-1856-49f2-947d-2e7dea6bc331 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:23.890948 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf6fa-7635-41ab-884a-c7337638406e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:23.891573 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf6fa-7635-41ab-884a-c7337638406e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:23.891852 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf6fa-7635-41ab-884a-c7337638406e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:23.892122 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf6fa-7635-41ab-884a-c7337638406e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:23.901759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cf6fa-7635-41ab-884a-c7337638406e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:23.903746 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cf6fa-7635-41ab-884a-c7337638406e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:23.913332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e30f6-8ab0-4d24-8057-b1ec089d6111 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-c67cf6fa-7635-41ab-884a-c7337638406e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:23.918671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:23.920261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:23.921207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:23.921207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:23.921207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:23.921207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 293/566] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:23.921207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf6fa-7635-41ab-884a-c7337638406e None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:23.954111 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e7281-2e33-444f-844e-ce9d84bae3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:23.954975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e7281-2e33-444f-844e-ce9d84bae3a2 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:23.955473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e7281-2e33-444f-844e-ce9d84bae3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:23.956017 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e7281-2e33-444f-844e-ce9d84bae3a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:23.967792 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:23.968375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e7281-2e33-444f-844e-ce9d84bae3a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-d98e7281-2e33-444f-844e-ce9d84bae3a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:23.973442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:23.974379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:23.975254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:23.975254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:23.975254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:23.975254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:23.975254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:23.975254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:23.975254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:23.975254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:23.975254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:23.975254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:23.975254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:23.975254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:23.975254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 274/567] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:23.975994 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1b632-fd29-4669-a273-93ea19aa3e4c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:23.976062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1b632-fd29-4669-a273-93ea19aa3e4c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:23.976693 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1b632-fd29-4669-a273-93ea19aa3e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:23.995532 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ebc1b632-fd29-4669-a273-93ea19aa3e4c None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:23.996759 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ebc1b632-fd29-4669-a273-93ea19aa3e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:24.021526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:24.031689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf6fa-7635-41ab-884a-c7337638406e None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:24.064527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 275/568] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:24.064949 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9946af-67f8-4b55-9f84-59721794f2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:24.065319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1b632-fd29-4669-a273-93ea19aa3e4c None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:24.065659 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9946af-67f8-4b55-9f84-59721794f2b1 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:24.065875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9946af-67f8-4b55-9f84-59721794f2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:24.066143 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9946af-67f8-4b55-9f84-59721794f2b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:24.072642 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9946af-67f8-4b55-9f84-59721794f2b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:24.074098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9946af-67f8-4b55-9f84-59721794f2b1 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:24.084921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-de9946af-67f8-4b55-9f84-59721794f2b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:24.084921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:24.084921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:24.084921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:24.084921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:24.084921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:24.084921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:24.084921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:24.084921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:24.084921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:24.084921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:24.084921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:24.084921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:24.084921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:24.084921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:24.085923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:24.086841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:24.086841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:24.086841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:24.086841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:24.086841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:24.086841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:24.086841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:24.086841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:24.087870 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 294/569] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:24.089168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9946af-67f8-4b55-9f84-59721794f2b1 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:24.189344 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9946af-67f8-4b55-9f84-59721794f2b1 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:24.190248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1b632-fd29-4669-a273-93ea19aa3e4c None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:24.196297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:24.225292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad1675-4321-4296-ae3e-e640edeacb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:24.225889 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad1675-4321-4296-ae3e-e640edeacb11 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:24.226168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad1675-4321-4296-ae3e-e640edeacb11 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:24.226441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad1675-4321-4296-ae3e-e640edeacb11 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:24.227077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad1675-4321-4296-ae3e-e640edeacb11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:24.227280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0437305-537b-4a62-b56a-193c772cbfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:24.227392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad1675-4321-4296-ae3e-e640edeacb11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:24.227888 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0437305-537b-4a62-b56a-193c772cbfc6 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:24.228171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0437305-537b-4a62-b56a-193c772cbfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:24.228446 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0437305-537b-4a62-b56a-193c772cbfc6 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:24.228714 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad1675-4321-4296-ae3e-e640edeacb11 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:24.229140 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0437305-537b-4a62-b56a-193c772cbfc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:24.229451 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0437305-537b-4a62-b56a-193c772cbfc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:24.230792 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0437305-537b-4a62-b56a-193c772cbfc6 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:24.238975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 295/570] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:24.239754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0437305-537b-4a62-b56a-193c772cbfc6 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:24.245648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 276/571] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:24.246595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad1675-4321-4296-ae3e-e640edeacb11 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:24.271211 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:24.344959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0437305-537b-4a62-b56a-193c772cbfc6 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:24.353355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad1675-4321-4296-ae3e-e640edeacb11 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:24.379399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcd68c-456c-4664-a4d9-99c657d077e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:24.380093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcd68c-456c-4664-a4d9-99c657d077e5 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:24.380449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcd68c-456c-4664-a4d9-99c657d077e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:24.380795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcd68c-456c-4664-a4d9-99c657d077e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:24.385961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f25512-7f7f-449b-b00d-9ff1692e79c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:24.386556 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f25512-7f7f-449b-b00d-9ff1692e79c6 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:24.386839 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f25512-7f7f-449b-b00d-9ff1692e79c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:24.387120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f25512-7f7f-449b-b00d-9ff1692e79c6 None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:24.388351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f25512-7f7f-449b-b00d-9ff1692e79c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:24.388659 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f25512-7f7f-449b-b00d-9ff1692e79c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:24.390122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f25512-7f7f-449b-b00d-9ff1692e79c6 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:24.391535 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcd68c-456c-4664-a4d9-99c657d077e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-5bdcd68c-456c-4664-a4d9-99c657d077e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:24.396831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:24.397939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:24.399030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:24.399030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:24.399030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:24.399030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:24.399030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:24.399030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:24.399030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:24.399030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:24.399030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:24.399030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:24.399030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:24.399030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:24.399030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 296/572] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:24.399030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcd68c-456c-4664-a4d9-99c657d077e5 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:24.412462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 277/573] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:24.413331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f25512-7f7f-449b-b00d-9ff1692e79c6 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:24.428380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:24.494080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:24.512504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcd68c-456c-4664-a4d9-99c657d077e5 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:24.514024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f25512-7f7f-449b-b00d-9ff1692e79c6 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:24.547266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45990269-2224-451f-8712-496f88490b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:24.547461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb08594-17c7-4370-8268-1be1ef839dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:24.547893 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45990269-2224-451f-8712-496f88490b5c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:24.548001 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb08594-17c7-4370-8268-1be1ef839dff None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:24.548174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb08594-17c7-4370-8268-1be1ef839dff None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:24.548264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45990269-2224-451f-8712-496f88490b5c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:24.548451 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45990269-2224-451f-8712-496f88490b5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:24.548539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb08594-17c7-4370-8268-1be1ef839dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:24.555055 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45990269-2224-451f-8712-496f88490b5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:24.556483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45990269-2224-451f-8712-496f88490b5c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:24.559880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb08594-17c7-4370-8268-1be1ef839dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:24.561356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb08594-17c7-4370-8268-1be1ef839dff None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:24.567215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-45990269-2224-451f-8712-496f88490b5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:24.567215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:24.567215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:24.567215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:24.567215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:24.567215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:24.567215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:24.567215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:24.567215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:24.567215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:24.567215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:24.567215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:24.567215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:24.567215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:24.567215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:24.568170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:24.569145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:24.569145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:24.569145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:24.569145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:24.569145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:24.569145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:24.569145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:24.569145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:24.569145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 278/574] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:24.569145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45990269-2224-451f-8712-496f88490b5c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-3bb08594-17c7-4370-8268-1be1ef839dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:24.580092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:24.581042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:24.581953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:24.581953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:24.581953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:24.581953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 297/575] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:24.582884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb08594-17c7-4370-8268-1be1ef839dff None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:24.663436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:24.669710 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45990269-2224-451f-8712-496f88490b5c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:24.683170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb08594-17c7-4370-8268-1be1ef839dff None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:24.703064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca57ec5-b794-46cd-b258-fb85eac4cb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:24.703762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca57ec5-b794-46cd-b258-fb85eac4cb6c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:24.704049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca57ec5-b794-46cd-b258-fb85eac4cb6c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:24.704332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca57ec5-b794-46cd-b258-fb85eac4cb6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:24.711706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:24.716136 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca57ec5-b794-46cd-b258-fb85eac4cb6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:24.717145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08fbc4-917d-4709-a611-0baa2f2da565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:24.717749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08fbc4-917d-4709-a611-0baa2f2da565 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:24.718035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08fbc4-917d-4709-a611-0baa2f2da565 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:24.718312 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08fbc4-917d-4709-a611-0baa2f2da565 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:24.718975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08fbc4-917d-4709-a611-0baa2f2da565 None admin] RBAC: Adding query filter params (name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:24.719283 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08fbc4-917d-4709-a611-0baa2f2da565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:24.720638 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08fbc4-917d-4709-a611-0baa2f2da565 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-8ca57ec5-b794-46cd-b258-fb85eac4cb6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:24.721123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:24.722173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:24.723025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:24.723025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:24.723025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:24.723025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:24.723025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:24.723025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:24.723025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:24.723025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:24.723025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:24.723025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:24.723025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:24.723025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:24.723025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 279/576] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:24.723871 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca57ec5-b794-46cd-b258-fb85eac4cb6c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:24.731990 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 298/577] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:24.732850 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08fbc4-917d-4709-a611-0baa2f2da565 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:24.825941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca57ec5-b794-46cd-b258-fb85eac4cb6c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:24.829985 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08fbc4-917d-4709-a611-0baa2f2da565 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:24.860686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd25ddf-749d-4e32-bb7f-f25e5e28e414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:24.861316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd25ddf-749d-4e32-bb7f-f25e5e28e414 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:24.861599 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd25ddf-749d-4e32-bb7f-f25e5e28e414 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:24.861872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd25ddf-749d-4e32-bb7f-f25e5e28e414 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:24.862594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd25ddf-749d-4e32-bb7f-f25e5e28e414 None admin] RBAC: Adding query filter params (role.id=7aef270090c546a0aff3f62f1fcf517a, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=f544d78f417844f68f3bd37863d24885) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:24.862901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd25ddf-749d-4e32-bb7f-f25e5e28e414 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:24.863404 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c570f89-c475-41a9-8b3c-244f08947953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:24.864009 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c570f89-c475-41a9-8b3c-244f08947953 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:24.864294 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c570f89-c475-41a9-8b3c-244f08947953 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:24.864381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd25ddf-749d-4e32-bb7f-f25e5e28e414 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:24.864573 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c570f89-c475-41a9-8b3c-244f08947953 None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:24.865290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c570f89-c475-41a9-8b3c-244f08947953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:24.865602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c570f89-c475-41a9-8b3c-244f08947953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:24.867045 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c570f89-c475-41a9-8b3c-244f08947953 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:24.869701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 280/578] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:24 2022] GET /identity/v3/role_assignments?user.id=f544d78f417844f68f3bd37863d24885&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=7aef270090c546a0aff3f62f1fcf517a => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:24.870461 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd25ddf-749d-4e32-bb7f-f25e5e28e414 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:24.881433 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 299/579] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:24.882443 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c570f89-c475-41a9-8b3c-244f08947953 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:24.885735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:24.947382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:25.002066 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd25ddf-749d-4e32-bb7f-f25e5e28e414 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:25.003332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c570f89-c475-41a9-8b3c-244f08947953 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:25.037667 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fa554-4f82-464c-88a0-286deb989e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:25.038611 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7b53e-1402-4483-9851-165915201e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:25.038797 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fa554-4f82-464c-88a0-286deb989e63 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:25.039207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7b53e-1402-4483-9851-165915201e52 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:25.039352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fa554-4f82-464c-88a0-286deb989e63 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:25.039485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7b53e-1402-4483-9851-165915201e52 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:25.039761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7b53e-1402-4483-9851-165915201e52 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:25.040028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fa554-4f82-464c-88a0-286deb989e63 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:25.040418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7b53e-1402-4483-9851-165915201e52 None admin] RBAC: Adding query filter params (name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:25.040725 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7b53e-1402-4483-9851-165915201e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:25.041209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fa554-4f82-464c-88a0-286deb989e63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:25.041650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fa554-4f82-464c-88a0-286deb989e63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:25.042101 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7b53e-1402-4483-9851-165915201e52 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:25.043364 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fa554-4f82-464c-88a0-286deb989e63 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:25.051017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 300/580] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:25.052023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7b53e-1402-4483-9851-165915201e52 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:25.056081 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 281/581] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:25.056887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fa554-4f82-464c-88a0-286deb989e63 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:25.127043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:25.166340 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7b53e-1402-4483-9851-165915201e52 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:25.170722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fa554-4f82-464c-88a0-286deb989e63 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:25.197917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:25.201981 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb19293-1056-419c-8f03-86064f2e0449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:25.202617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb19293-1056-419c-8f03-86064f2e0449 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:25.202895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb19293-1056-419c-8f03-86064f2e0449 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:25.203174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb19293-1056-419c-8f03-86064f2e0449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:25.211330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60400e89-62f4-4125-b33e-1725236d9332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:25.212387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60400e89-62f4-4125-b33e-1725236d9332 None admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:25.212677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60400e89-62f4-4125-b33e-1725236d9332 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:25.213263 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60400e89-62f4-4125-b33e-1725236d9332 None admin] PATH_INFO: `/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/b63d6e588f6e4b598b75a2ec13bea25d/roles/7aef270090c546a0aff3f62f1fcf517a` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:25.214073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb19293-1056-419c-8f03-86064f2e0449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:25.215541 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb19293-1056-419c-8f03-86064f2e0449 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:25.229760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60400e89-62f4-4125-b33e-1725236d9332 None admin] RBAC: Authorizing `identity:create_grant(project_id=35aafba89a1d47cd86cef1eb0a11e507, user_id=b63d6e588f6e4b598b75a2ec13bea25d, role_id=7aef270090c546a0aff3f62f1fcf517a)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-6eb19293-1056-419c-8f03-86064f2e0449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:25.229920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:25.230804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:25.232272 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:25.232272 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:25.232272 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:25.232442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60400e89-62f4-4125-b33e-1725236d9332 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:25.236022 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 301/582] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:25.236824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb19293-1056-419c-8f03-86064f2e0449 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:25.246531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 282/583] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:39:25 2022] PUT /identity/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/b63d6e588f6e4b598b75a2ec13bea25d/roles/7aef270090c546a0aff3f62f1fcf517a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:39:25.248124 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60400e89-62f4-4125-b33e-1725236d9332 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:25.370275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60400e89-62f4-4125-b33e-1725236d9332 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:25.380311 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb19293-1056-419c-8f03-86064f2e0449 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:25.398262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:25.413729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437bc1c-d940-43f2-8da5-408c05604c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:25.414658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437bc1c-d940-43f2-8da5-408c05604c7d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:25.415092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437bc1c-d940-43f2-8da5-408c05604c7d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:25.415369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437bc1c-d940-43f2-8da5-408c05604c7d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:25.420885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c358a-6380-4dd5-8ba4-78f4aa87955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:25.421559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c358a-6380-4dd5-8ba4-78f4aa87955f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:25.421847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c358a-6380-4dd5-8ba4-78f4aa87955f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:25.422123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c358a-6380-4dd5-8ba4-78f4aa87955f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:25.423829 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437bc1c-d940-43f2-8da5-408c05604c7d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:25.425306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437bc1c-d940-43f2-8da5-408c05604c7d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:25.434356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c358a-6380-4dd5-8ba4-78f4aa87955f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:25.435805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c358a-6380-4dd5-8ba4-78f4aa87955f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-0437bc1c-d940-43f2-8da5-408c05604c7d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:25.437592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:25.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:25.439778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:25.439778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:25.439778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:25.439778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:25.439778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:25.439778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:25.439778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:25.439778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:25.439778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 08:39:25.439778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:25.439778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 283/584] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:25.439778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437bc1c-d940-43f2-8da5-408c05604c7d None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-966c358a-6380-4dd5-8ba4-78f4aa87955f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:25.454073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:25.455219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:25.456313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:25.456313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:25.456313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:25.457563 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 302/585] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:25.458154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c358a-6380-4dd5-8ba4-78f4aa87955f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:25.485468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:25.570331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c358a-6380-4dd5-8ba4-78f4aa87955f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:25.579167 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437bc1c-d940-43f2-8da5-408c05604c7d None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:25.617667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d90fe3-1821-41c6-b110-85fc450f58c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:25.618271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d90fe3-1821-41c6-b110-85fc450f58c2 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:25.618554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d90fe3-1821-41c6-b110-85fc450f58c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:25.618829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d90fe3-1821-41c6-b110-85fc450f58c2 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:25.619559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d90fe3-1821-41c6-b110-85fc450f58c2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:25.619867 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d90fe3-1821-41c6-b110-85fc450f58c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:25.621330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d90fe3-1821-41c6-b110-85fc450f58c2 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:25.632899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547261d-4c83-49e1-af64-f48615c9f172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:25.633776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547261d-4c83-49e1-af64-f48615c9f172 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:25.634199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547261d-4c83-49e1-af64-f48615c9f172 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:25.634614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547261d-4c83-49e1-af64-f48615c9f172 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:25.635415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547261d-4c83-49e1-af64-f48615c9f172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:25.635876 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547261d-4c83-49e1-af64-f48615c9f172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:25.638001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547261d-4c83-49e1-af64-f48615c9f172 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:25.640653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 303/586] 10.222.0.76 () {56 vars in 1137 bytes} [Fri Aug 26 08:39:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:25.641613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d90fe3-1821-41c6-b110-85fc450f58c2 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:25.654063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 284/587] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:25.655352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547261d-4c83-49e1-af64-f48615c9f172 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:25.669693 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:25.755066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d90fe3-1821-41c6-b110-85fc450f58c2 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:25.766806 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:25.774748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547261d-4c83-49e1-af64-f48615c9f172 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:25.794551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b4604-9e51-4751-9f56-15bd853d1a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:25.795552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b4604-9e51-4751-9f56-15bd853d1a74 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:25.796094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b4604-9e51-4751-9f56-15bd853d1a74 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:25.796508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b4604-9e51-4751-9f56-15bd853d1a74 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:25.797408 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b4604-9e51-4751-9f56-15bd853d1a74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:25.797868 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b4604-9e51-4751-9f56-15bd853d1a74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:25.799487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b4604-9e51-4751-9f56-15bd853d1a74 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:25.812471 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 304/588] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:25.813688 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b4604-9e51-4751-9f56-15bd853d1a74 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:25.815415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f6c63-a6b8-46fa-904b-5cb763145ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:25.816125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f6c63-a6b8-46fa-904b-5cb763145ee3 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:25.816625 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f6c63-a6b8-46fa-904b-5cb763145ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:25.816821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f6c63-a6b8-46fa-904b-5cb763145ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:25.830238 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f6c63-a6b8-46fa-904b-5cb763145ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:25.832127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f6c63-a6b8-46fa-904b-5cb763145ee3 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-5f5f6c63-a6b8-46fa-904b-5cb763145ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:25.853389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:25.854527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:25.855688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:25.855688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:25.855688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:25.858199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 285/589] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:25.859317 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f6c63-a6b8-46fa-904b-5cb763145ee3 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:25.922119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:25.939371 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b4604-9e51-4751-9f56-15bd853d1a74 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:25.978865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88e8b2-2e7c-49a4-aa4b-9fbc6163ba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:25.979864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88e8b2-2e7c-49a4-aa4b-9fbc6163ba15 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:25.980339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88e8b2-2e7c-49a4-aa4b-9fbc6163ba15 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:25.980819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88e8b2-2e7c-49a4-aa4b-9fbc6163ba15 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:25.991425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88e8b2-2e7c-49a4-aa4b-9fbc6163ba15 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:25.993292 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88e8b2-2e7c-49a4-aa4b-9fbc6163ba15 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:25.998503 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f6c63-a6b8-46fa-904b-5cb763145ee3 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-ee88e8b2-2e7c-49a4-aa4b-9fbc6163ba15 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:26.006779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:26.007700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:26.008650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:26.008650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:26.008650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:26.008650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:26.008650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:26.008650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:26.008650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:26.008650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:26.008650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 08:39:26.008650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:26.011346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 305/590] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:26.012364 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88e8b2-2e7c-49a4-aa4b-9fbc6163ba15 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:26.035918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5220be-8c6a-46f8-9d0d-6aa143a37de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:26.036975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5220be-8c6a-46f8-9d0d-6aa143a37de9 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:26.037494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5220be-8c6a-46f8-9d0d-6aa143a37de9 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:26.037960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5220be-8c6a-46f8-9d0d-6aa143a37de9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:26.046605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5220be-8c6a-46f8-9d0d-6aa143a37de9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:26.048314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5220be-8c6a-46f8-9d0d-6aa143a37de9 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-9a5220be-8c6a-46f8-9d0d-6aa143a37de9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:26.059749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:26.060700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:26.061678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:26.061678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:26.061678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:26.061678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:26.061678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:26.061678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:26.061678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:26.061678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:26.061678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 08:39:26.061678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:26.064068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 286/591] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:26.065174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5220be-8c6a-46f8-9d0d-6aa143a37de9 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:26.076169 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:26.129301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88e8b2-2e7c-49a4-aa4b-9fbc6163ba15 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:26.166566 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49baa2d-a532-48be-a081-5b27fea21b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:26.167580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49baa2d-a532-48be-a081-5b27fea21b0b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:26.168229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49baa2d-a532-48be-a081-5b27fea21b0b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:26.168741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49baa2d-a532-48be-a081-5b27fea21b0b None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:26.169694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49baa2d-a532-48be-a081-5b27fea21b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:26.170195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49baa2d-a532-48be-a081-5b27fea21b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:26.171831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49baa2d-a532-48be-a081-5b27fea21b0b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:26.186237 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 306/592] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:26.187397 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49baa2d-a532-48be-a081-5b27fea21b0b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:26.198120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:26.201029 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5220be-8c6a-46f8-9d0d-6aa143a37de9 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:26.248128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf88da-cc6c-433e-8879-d5ad13a07b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:26.248778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf88da-cc6c-433e-8879-d5ad13a07b53 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:26.249100 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf88da-cc6c-433e-8879-d5ad13a07b53 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:26.249386 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf88da-cc6c-433e-8879-d5ad13a07b53 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:26.250124 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf88da-cc6c-433e-8879-d5ad13a07b53 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:26.250446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf88da-cc6c-433e-8879-d5ad13a07b53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:26.251901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf88da-cc6c-433e-8879-d5ad13a07b53 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:26.276297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 287/593] 10.222.0.76 () {56 vars in 1139 bytes} [Fri Aug 26 08:39:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:26.277158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf88da-cc6c-433e-8879-d5ad13a07b53 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:26.305523 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49baa2d-a532-48be-a081-5b27fea21b0b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:26.345219 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:26.348868 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4a7b1-45c7-4cd2-920d-33c4a15a1215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:26.349727 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4a7b1-45c7-4cd2-920d-33c4a15a1215 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:26.350190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4a7b1-45c7-4cd2-920d-33c4a15a1215 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:26.350600 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4a7b1-45c7-4cd2-920d-33c4a15a1215 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:26.351467 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4a7b1-45c7-4cd2-920d-33c4a15a1215 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:26.351974 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4a7b1-45c7-4cd2-920d-33c4a15a1215 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:26.353692 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4a7b1-45c7-4cd2-920d-33c4a15a1215 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:26.374012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 307/594] 10.222.0.76 () {56 vars in 1137 bytes} [Fri Aug 26 08:39:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:26.375226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4a7b1-45c7-4cd2-920d-33c4a15a1215 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:26.384334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf88da-cc6c-433e-8879-d5ad13a07b53 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:26.421891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55161aa-80e0-43cf-874c-741d4a0f719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:26.422545 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55161aa-80e0-43cf-874c-741d4a0f719c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:26.422828 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55161aa-80e0-43cf-874c-741d4a0f719c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:26.423106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55161aa-80e0-43cf-874c-741d4a0f719c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:26.430753 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55161aa-80e0-43cf-874c-741d4a0f719c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:26.432486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55161aa-80e0-43cf-874c-741d4a0f719c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:26.444046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-f55161aa-80e0-43cf-874c-741d4a0f719c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:26.444046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:26.444046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:26.444046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:26.444046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:26.444046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:26.444046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:26.444046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:26.444046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:26.444046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:26.444046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:26.444046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:26.444046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:26.444046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:26.444046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:26.445149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:26.446256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:26.446256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:26.446256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:26.446256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:26.446256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:26.446256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:26.446256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:26.446256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:26.450727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 288/595] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:26.451595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55161aa-80e0-43cf-874c-741d4a0f719c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:26.452304 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:26.495820 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4a7b1-45c7-4cd2-920d-33c4a15a1215 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:26.533861 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9679f-3592-4417-b32e-e683ac12c1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:26.534763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9679f-3592-4417-b32e-e683ac12c1cd None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:26.535186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9679f-3592-4417-b32e-e683ac12c1cd None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:26.535603 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9679f-3592-4417-b32e-e683ac12c1cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:26.546915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9679f-3592-4417-b32e-e683ac12c1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:26.548624 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9679f-3592-4417-b32e-e683ac12c1cd None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-5ea9679f-3592-4417-b32e-e683ac12c1cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:26.565253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:26.566388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:26.567439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:26.567439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:26.567439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:26.567621 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55161aa-80e0-43cf-874c-741d4a0f719c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:26.573808 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 308/596] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:26.575462 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9679f-3592-4417-b32e-e683ac12c1cd None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:26.593648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:26.604716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdd75a-88ee-4989-8b00-e857f8d4b374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:26.605785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdd75a-88ee-4989-8b00-e857f8d4b374 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:26.607483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdd75a-88ee-4989-8b00-e857f8d4b374 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:26.607763 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdd75a-88ee-4989-8b00-e857f8d4b374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:26.621543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdd75a-88ee-4989-8b00-e857f8d4b374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:26.623691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdd75a-88ee-4989-8b00-e857f8d4b374 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-2dfdd75a-88ee-4989-8b00-e857f8d4b374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:26.642074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:26.643206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:26.644289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:26.644289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:26.644289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:26.646469 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 289/597] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:26.647482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdd75a-88ee-4989-8b00-e857f8d4b374 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:26.701367 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9679f-3592-4417-b32e-e683ac12c1cd None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:26.719713 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:26.747422 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13849cb-7558-488c-a4a6-a3d8d691df40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:26.748034 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13849cb-7558-488c-a4a6-a3d8d691df40 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:26.748322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13849cb-7558-488c-a4a6-a3d8d691df40 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:26.748596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13849cb-7558-488c-a4a6-a3d8d691df40 None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:26.749406 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13849cb-7558-488c-a4a6-a3d8d691df40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:26.749716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13849cb-7558-488c-a4a6-a3d8d691df40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:26.751842 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13849cb-7558-488c-a4a6-a3d8d691df40 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:26.773080 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 309/598] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:26.774155 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13849cb-7558-488c-a4a6-a3d8d691df40 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:26.782629 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdd75a-88ee-4989-8b00-e857f8d4b374 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:26.820427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2598ebd-0572-4294-a941-5519133d29e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:26.821444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2598ebd-0572-4294-a941-5519133d29e9 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:26.821990 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2598ebd-0572-4294-a941-5519133d29e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:26.822522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2598ebd-0572-4294-a941-5519133d29e9 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:26.823390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2598ebd-0572-4294-a941-5519133d29e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:26.823914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2598ebd-0572-4294-a941-5519133d29e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:26.826129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2598ebd-0572-4294-a941-5519133d29e9 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:26.840234 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 290/599] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:26.844090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2598ebd-0572-4294-a941-5519133d29e9 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:26.882627 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:26.902678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13849cb-7558-488c-a4a6-a3d8d691df40 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:26.938821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eb66a-3929-450d-9760-16c1f9ed371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:26.939425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eb66a-3929-450d-9760-16c1f9ed371c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:26.939706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eb66a-3929-450d-9760-16c1f9ed371c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:26.939984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eb66a-3929-450d-9760-16c1f9ed371c None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:26.940637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0eb66a-3929-450d-9760-16c1f9ed371c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:26.941099 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0eb66a-3929-450d-9760-16c1f9ed371c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:26.942512 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0eb66a-3929-450d-9760-16c1f9ed371c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:26.950817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2598ebd-0572-4294-a941-5519133d29e9 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:26.959288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 310/600] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:26.959288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eb66a-3929-450d-9760-16c1f9ed371c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:26.987348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0d5ca-cd7b-450c-af00-fb9af3c9f4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:26.988000 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0d5ca-cd7b-450c-af00-fb9af3c9f4cb None admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:26.988423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0d5ca-cd7b-450c-af00-fb9af3c9f4cb None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:26.988630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0d5ca-cd7b-450c-af00-fb9af3c9f4cb None admin] PATH_INFO: `/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/0f3147e5695240afa9eaf42d2343b7c9/roles/7aef270090c546a0aff3f62f1fcf517a` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:26.996480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:27.007405 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0d5ca-cd7b-450c-af00-fb9af3c9f4cb None admin] RBAC: Authorizing `identity:create_grant(project_id=35aafba89a1d47cd86cef1eb0a11e507, user_id=0f3147e5695240afa9eaf42d2343b7c9, role_id=7aef270090c546a0aff3f62f1fcf517a)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:27.008847 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0d5ca-cd7b-450c-af00-fb9af3c9f4cb None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:27.028019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 291/601] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:39:26 2022] PUT /identity/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/0f3147e5695240afa9eaf42d2343b7c9/roles/7aef270090c546a0aff3f62f1fcf517a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:39:27.028019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247f159-ef8f-4823-a93d-25fa1b527c24 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:27.028019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247f159-ef8f-4823-a93d-25fa1b527c24 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:27.028019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247f159-ef8f-4823-a93d-25fa1b527c24 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:27.028429 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 292/602] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:27.029574 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247f159-ef8f-4823-a93d-25fa1b527c24 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:27.073527 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eb66a-3929-450d-9760-16c1f9ed371c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:27.117151 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ded16-8dc0-445c-a14e-8da4405b95db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:27.117808 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ded16-8dc0-445c-a14e-8da4405b95db None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:27.118088 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ded16-8dc0-445c-a14e-8da4405b95db None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:27.118366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ded16-8dc0-445c-a14e-8da4405b95db None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:27.127368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ded16-8dc0-445c-a14e-8da4405b95db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:27.128893 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ded16-8dc0-445c-a14e-8da4405b95db None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:27.142331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-762ded16-8dc0-445c-a14e-8da4405b95db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:27.142331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:27.142331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:27.142331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:27.142331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:27.142331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:27.142331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:27.142331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:27.142331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:27.142331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:27.142331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:27.142331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:27.142331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:27.142331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:27.142331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:27.143495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:27.144544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:27.144544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:27.144544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:27.144544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:27.144544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:27.144544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:27.144544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:27.144544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:27.144544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 311/603] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:27.145171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d31de5-1c33-403e-a0b0-f383869ea882 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:27.145461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d31de5-1c33-403e-a0b0-f383869ea882 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:27.145783 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d31de5-1c33-403e-a0b0-f383869ea882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:27.157337 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:27.169606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-38d31de5-1c33-403e-a0b0-f383869ea882 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:27.171734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-38d31de5-1c33-403e-a0b0-f383869ea882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:27.178375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247f159-ef8f-4823-a93d-25fa1b527c24 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:27.230837 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acc931-5158-40b3-bbc9-0e345cc194c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:27.232184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acc931-5158-40b3-bbc9-0e345cc194c6 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:27.232570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acc931-5158-40b3-bbc9-0e345cc194c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:27.232947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acc931-5158-40b3-bbc9-0e345cc194c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:27.240531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acc931-5158-40b3-bbc9-0e345cc194c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:27.242138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acc931-5158-40b3-bbc9-0e345cc194c6 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:27.253755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-e2acc931-5158-40b3-bbc9-0e345cc194c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:27.253755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:27.253755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:27.253755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:27.253755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:27.253755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:27.253755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:27.253755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:27.253755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:27.253755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:27.253755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:27.253755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:27.253755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:27.253755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:27.253755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:27.254854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:27.255969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:27.255969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:27.255969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:27.255969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:27.255969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:27.255969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:27.255969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:27.255969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:27.262158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 293/604] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:27.262328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 312/605] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:27.262428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acc931-5158-40b3-bbc9-0e345cc194c6 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:27.270585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d31de5-1c33-403e-a0b0-f383869ea882 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:27.312043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:27.382514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acc931-5158-40b3-bbc9-0e345cc194c6 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:27.402558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d31de5-1c33-403e-a0b0-f383869ea882 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:27.418096 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917a713-4257-4257-be7e-2f70a35f8412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:27.419402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917a713-4257-4257-be7e-2f70a35f8412 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:27.419751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917a713-4257-4257-be7e-2f70a35f8412 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:27.420085 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917a713-4257-4257-be7e-2f70a35f8412 None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:27.420838 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917a713-4257-4257-be7e-2f70a35f8412 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:27.421245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917a713-4257-4257-be7e-2f70a35f8412 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:27.422737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917a713-4257-4257-be7e-2f70a35f8412 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:27.435763 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 294/606] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:27.436978 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8de6d5-0c40-4047-b11a-6727155ea6a1 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:27.437303 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8de6d5-0c40-4047-b11a-6727155ea6a1 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:27.437584 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8de6d5-0c40-4047-b11a-6727155ea6a1 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:27.439089 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 295/607] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:27.440922 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8de6d5-0c40-4047-b11a-6727155ea6a1 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:27.452382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:27.453262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad9d90-2609-4107-afe1-5247825280a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:27.454081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad9d90-2609-4107-afe1-5247825280a7 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:27.454429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad9d90-2609-4107-afe1-5247825280a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:27.454759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad9d90-2609-4107-afe1-5247825280a7 None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:27.455994 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad9d90-2609-4107-afe1-5247825280a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:27.456376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad9d90-2609-4107-afe1-5247825280a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:27.458946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad9d90-2609-4107-afe1-5247825280a7 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:27.476040 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 313/608] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:27.477343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81f20d-6a05-4378-bd9b-b33d269cba47 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:27.477661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81f20d-6a05-4378-bd9b-b33d269cba47 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:27.477989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81f20d-6a05-4378-bd9b-b33d269cba47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:27.500068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-1d81f20d-6a05-4378-bd9b-b33d269cba47 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:27.501830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1d81f20d-6a05-4378-bd9b-b33d269cba47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:27.559519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8de6d5-0c40-4047-b11a-6727155ea6a1 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:27.592524 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 314/609] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:27.593583 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81f20d-6a05-4378-bd9b-b33d269cba47 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:27.601190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d6ff0-3c03-4a7e-8508-9b236446adee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:27.601958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d6ff0-3c03-4a7e-8508-9b236446adee None admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:27.602337 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d6ff0-3c03-4a7e-8508-9b236446adee None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:27.602709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d6ff0-3c03-4a7e-8508-9b236446adee None admin] PATH_INFO: `/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/e8a867070e974a918a906148bbfd1fd0/roles/7aef270090c546a0aff3f62f1fcf517a` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:27.618173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d6ff0-3c03-4a7e-8508-9b236446adee None admin] RBAC: Authorizing `identity:create_grant(project_id=35aafba89a1d47cd86cef1eb0a11e507, user_id=e8a867070e974a918a906148bbfd1fd0, role_id=7aef270090c546a0aff3f62f1fcf517a)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:27.619548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:27.619897 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d6ff0-3c03-4a7e-8508-9b236446adee None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:27.644558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 296/610] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:39:27 2022] PUT /identity/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/e8a867070e974a918a906148bbfd1fd0/roles/7aef270090c546a0aff3f62f1fcf517a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:39:27.645748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d6ff0-3c03-4a7e-8508-9b236446adee None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:27.713508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81f20d-6a05-4378-bd9b-b33d269cba47 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:27.776092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37950d72-f7bc-4a62-aa7f-2cb39157362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:27.777111 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37950d72-f7bc-4a62-aa7f-2cb39157362d None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:27.777673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37950d72-f7bc-4a62-aa7f-2cb39157362d None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:27.779342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37950d72-f7bc-4a62-aa7f-2cb39157362d None admin] PATH_INFO: `/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/9fde38c1a2a844368acd3e1b9aa10151/roles/7aef270090c546a0aff3f62f1fcf517a` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:27.780453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:27.810165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37950d72-f7bc-4a62-aa7f-2cb39157362d None admin] RBAC: Authorizing `identity:create_grant(project_id=35aafba89a1d47cd86cef1eb0a11e507, user_id=9fde38c1a2a844368acd3e1b9aa10151, role_id=7aef270090c546a0aff3f62f1fcf517a)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:27.816278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37950d72-f7bc-4a62-aa7f-2cb39157362d None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:27.838012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 315/611] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:39:27 2022] PUT /identity/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/9fde38c1a2a844368acd3e1b9aa10151/roles/7aef270090c546a0aff3f62f1fcf517a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:39:27.855653 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d6ff0-3c03-4a7e-8508-9b236446adee None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:27.893068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37950d72-f7bc-4a62-aa7f-2cb39157362d None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:27.900190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc13e95-539f-4d87-869d-953f346e3bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:27.900753 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc13e95-539f-4d87-869d-953f346e3bab None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:27.901049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc13e95-539f-4d87-869d-953f346e3bab None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:27.901321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc13e95-539f-4d87-869d-953f346e3bab None admin] PATH_INFO: `/v3/roles/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:27.915502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc13e95-539f-4d87-869d-953f346e3bab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-5dc13e95-539f-4d87-869d-953f346e3bab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:27.920313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:27.921496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:27.922516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:27.922516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:27.922516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:27.922516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:27.922516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:27.922516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:27.922516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:27.922516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:27.922516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:27.922516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:27.922516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:27.922516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:27.922516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 297/612] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:27.927535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc13e95-539f-4d87-869d-953f346e3bab None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:27.984275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:28.034749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37950d72-f7bc-4a62-aa7f-2cb39157362d None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:28.055965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc13e95-539f-4d87-869d-953f346e3bab None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:28.073166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4a565-ffdd-480a-b5c2-404c5131de45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:28.073951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4a565-ffdd-480a-b5c2-404c5131de45 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:28.074332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4a565-ffdd-480a-b5c2-404c5131de45 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:28.074789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4a565-ffdd-480a-b5c2-404c5131de45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:28.079279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:28.089087 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4a565-ffdd-480a-b5c2-404c5131de45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-98c4a565-ffdd-480a-b5c2-404c5131de45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:28.096079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:28.097261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:28.098226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:28.098226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:28.098226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:28.098226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:28.098226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:28.098226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:28.098226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:28.098226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:28.098226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:28.098226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:28.098226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:28.098226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:28.099390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 316/613] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:28.104887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd36226-833d-48fd-8a65-76a34efffa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:28.105580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4a565-ffdd-480a-b5c2-404c5131de45 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:28.105988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd36226-833d-48fd-8a65-76a34efffa6b None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:28.106466 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd36226-833d-48fd-8a65-76a34efffa6b None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:28.106968 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd36226-833d-48fd-8a65-76a34efffa6b None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:28.107808 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd36226-833d-48fd-8a65-76a34efffa6b None admin] RBAC: Adding query filter params (name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:28.108312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd36226-833d-48fd-8a65-76a34efffa6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:28.111325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd36226-833d-48fd-8a65-76a34efffa6b None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:28.122984 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 298/614] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:28.128722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd36226-833d-48fd-8a65-76a34efffa6b None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:28.230100 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4a565-ffdd-480a-b5c2-404c5131de45 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:28.260159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:28.271742 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c27a9-fde2-40f2-a9f9-d02bfc8f8832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:28.272436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c27a9-fde2-40f2-a9f9-d02bfc8f8832 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:28.272806 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c27a9-fde2-40f2-a9f9-d02bfc8f8832 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:28.273208 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c27a9-fde2-40f2-a9f9-d02bfc8f8832 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:28.273372 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd36226-833d-48fd-8a65-76a34efffa6b None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:28.274039 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c27a9-fde2-40f2-a9f9-d02bfc8f8832 None admin] RBAC: Adding query filter params (name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:28.274454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c27a9-fde2-40f2-a9f9-d02bfc8f8832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:28.276005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c27a9-fde2-40f2-a9f9-d02bfc8f8832 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:28.285262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 317/615] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:28.291052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c27a9-fde2-40f2-a9f9-d02bfc8f8832 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:28.315353 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a014212-5ad2-4121-93f3-af446bac7c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:28.316809 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a014212-5ad2-4121-93f3-af446bac7c44 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:28.317457 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a014212-5ad2-4121-93f3-af446bac7c44 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:28.318010 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a014212-5ad2-4121-93f3-af446bac7c44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:28.333525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a014212-5ad2-4121-93f3-af446bac7c44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:28.335204 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a014212-5ad2-4121-93f3-af446bac7c44 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-4a014212-5ad2-4121-93f3-af446bac7c44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:28.354202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:28.355378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:28.357038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:28.357038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:28.357038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:28.359362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 299/616] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:28.364915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a014212-5ad2-4121-93f3-af446bac7c44 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:28.396484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:28.409634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c27a9-fde2-40f2-a9f9-d02bfc8f8832 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:28.448494 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b8e25-9018-4c21-bc57-b39dd508cfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:28.449318 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b8e25-9018-4c21-bc57-b39dd508cfa7 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:28.449719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b8e25-9018-4c21-bc57-b39dd508cfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:28.450344 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b8e25-9018-4c21-bc57-b39dd508cfa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:28.462548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b8e25-9018-4c21-bc57-b39dd508cfa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:28.464605 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b8e25-9018-4c21-bc57-b39dd508cfa7 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:28.470329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a014212-5ad2-4121-93f3-af446bac7c44 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-851b8e25-9018-4c21-bc57-b39dd508cfa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:28.480275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:28.481935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:28.482822 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:28.482822 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:28.482822 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:28.483085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 318/617] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:28.488577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b8e25-9018-4c21-bc57-b39dd508cfa7 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:28.509256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da776ddb-5bc7-4477-a2fb-4e250de2ec66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:28.510156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da776ddb-5bc7-4477-a2fb-4e250de2ec66 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:28.510643 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da776ddb-5bc7-4477-a2fb-4e250de2ec66 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:28.511083 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da776ddb-5bc7-4477-a2fb-4e250de2ec66 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:28.511894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da776ddb-5bc7-4477-a2fb-4e250de2ec66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:28.512424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da776ddb-5bc7-4477-a2fb-4e250de2ec66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:28.513979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da776ddb-5bc7-4477-a2fb-4e250de2ec66 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:28.526325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 300/618] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:28.532153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da776ddb-5bc7-4477-a2fb-4e250de2ec66 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:28.536111 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:28.604286 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b8e25-9018-4c21-bc57-b39dd508cfa7 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:28.633744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:28.643740 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da776ddb-5bc7-4477-a2fb-4e250de2ec66 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:28.644510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3141b-9176-4e99-8b48-183241104d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:28.645328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3141b-9176-4e99-8b48-183241104d29 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:28.646302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3141b-9176-4e99-8b48-183241104d29 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:28.646749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3141b-9176-4e99-8b48-183241104d29 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:28.647603 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3141b-9176-4e99-8b48-183241104d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:28.648058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3141b-9176-4e99-8b48-183241104d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:28.649651 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3141b-9176-4e99-8b48-183241104d29 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:28.663059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 319/619] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:28.669345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3141b-9176-4e99-8b48-183241104d29 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:28.705780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41af77-2d47-4b00-b8fb-67588c837b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:28.706419 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41af77-2d47-4b00-b8fb-67588c837b94 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:28.706701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41af77-2d47-4b00-b8fb-67588c837b94 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:28.706976 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41af77-2d47-4b00-b8fb-67588c837b94 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:28.730125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41af77-2d47-4b00-b8fb-67588c837b94 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:28.732226 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41af77-2d47-4b00-b8fb-67588c837b94 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-ce41af77-2d47-4b00-b8fb-67588c837b94 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:28.754280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:28.755473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:28.756443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:28.756443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:28.756443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:28.756443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:28.756443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:28.756443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:28.756443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:28.756443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:28.756443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 08:39:28.756443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:28.756443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 301/620] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:39:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:28.761109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41af77-2d47-4b00-b8fb-67588c837b94 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:28.802196 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3141b-9176-4e99-8b48-183241104d29 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:28.815276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:28.865312 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f341cc4-3269-4326-904b-b150d975be9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:28.865941 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f341cc4-3269-4326-904b-b150d975be9a None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:28.866223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f341cc4-3269-4326-904b-b150d975be9a None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:28.866497 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f341cc4-3269-4326-904b-b150d975be9a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:28.879102 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f341cc4-3269-4326-904b-b150d975be9a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:28.884628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f341cc4-3269-4326-904b-b150d975be9a None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-8f341cc4-3269-4326-904b-b150d975be9a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:28.905716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:28.906712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:28.907661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:28.907661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:28.907661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:28.907661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:28.907661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:28.907661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:28.907661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:28.907661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:28.907661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:39:28.907661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:28.908677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 320/621] 10.222.0.76 () {56 vars in 1093 bytes} [Fri Aug 26 08:39:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:28.913856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f341cc4-3269-4326-904b-b150d975be9a None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:28.963560 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41af77-2d47-4b00-b8fb-67588c837b94 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:29.029549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b8488-cd47-4512-8018-895c33668329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:29.030078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b8488-cd47-4512-8018-895c33668329 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:29.030362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b8488-cd47-4512-8018-895c33668329 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:29.030635 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b8488-cd47-4512-8018-895c33668329 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:29.031371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b8488-cd47-4512-8018-895c33668329 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:29.031676 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b8488-cd47-4512-8018-895c33668329 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:29.033232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b8488-cd47-4512-8018-895c33668329 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:29.051913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 302/622] 10.222.0.76 () {56 vars in 1135 bytes} [Fri Aug 26 08:39:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:29.055226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f341cc4-3269-4326-904b-b150d975be9a None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:29.057308 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b8488-cd47-4512-8018-895c33668329 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:29.067881 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:29.093361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb7350-3c77-4761-ab22-b4f87bfc6d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:29.095937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7350-3c77-4761-ab22-b4f87bfc6d3c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:29.096222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7350-3c77-4761-ab22-b4f87bfc6d3c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:29.096500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7350-3c77-4761-ab22-b4f87bfc6d3c None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:29.097970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb7350-3c77-4761-ab22-b4f87bfc6d3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:29.098282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb7350-3c77-4761-ab22-b4f87bfc6d3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:29.099728 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb7350-3c77-4761-ab22-b4f87bfc6d3c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:29.135177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 321/623] 10.222.0.76 () {56 vars in 1133 bytes} [Fri Aug 26 08:39:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:29.141708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb7350-3c77-4761-ab22-b4f87bfc6d3c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:29.181381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:29.223496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b8488-cd47-4512-8018-895c33668329 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:29.272151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09879e-3da4-43fa-8b5f-20185bf6d619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:29.273065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09879e-3da4-43fa-8b5f-20185bf6d619 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:29.273348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09879e-3da4-43fa-8b5f-20185bf6d619 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:29.273620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09879e-3da4-43fa-8b5f-20185bf6d619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:29.282436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb7350-3c77-4761-ab22-b4f87bfc6d3c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:29.288521 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09879e-3da4-43fa-8b5f-20185bf6d619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:29.290512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09879e-3da4-43fa-8b5f-20185bf6d619 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-ce09879e-3da4-43fa-8b5f-20185bf6d619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:29.310144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:29.311125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:29.312039 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:29.312039 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:29.312039 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:29.312289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 303/624] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:29.314050 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7008833-269c-423d-aa10-844a126bef38 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:29.314702 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7008833-269c-423d-aa10-844a126bef38 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:29.314979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7008833-269c-423d-aa10-844a126bef38 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:29.321091 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 304/625] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:29.321972 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7008833-269c-423d-aa10-844a126bef38 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:29.323656 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47330a-4544-4800-8c21-91baf83dfa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:29.324327 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47330a-4544-4800-8c21-91baf83dfa9f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:29.324616 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47330a-4544-4800-8c21-91baf83dfa9f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:29.325488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47330a-4544-4800-8c21-91baf83dfa9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:29.400200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47330a-4544-4800-8c21-91baf83dfa9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:29.401696 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47330a-4544-4800-8c21-91baf83dfa9f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:29.404174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:29.421949 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:29.459112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7008833-269c-423d-aa10-844a126bef38 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:29.495939 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f10fc-fa8d-4509-8cb9-7f734852de4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:29.497426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f10fc-fa8d-4509-8cb9-7f734852de4b None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:29.497957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f10fc-fa8d-4509-8cb9-7f734852de4b None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:29.498431 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f10fc-fa8d-4509-8cb9-7f734852de4b None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:29.499264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f10fc-fa8d-4509-8cb9-7f734852de4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:29.499766 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f10fc-fa8d-4509-8cb9-7f734852de4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:29.501520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f10fc-fa8d-4509-8cb9-7f734852de4b None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:29.518531 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 322/626] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:39:29.518531 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5b54b-305d-4c3b-9380-0c0cfbaec1c1 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:29.518531 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5b54b-305d-4c3b-9380-0c0cfbaec1c1 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:29.518531 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5b54b-305d-4c3b-9380-0c0cfbaec1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:29.520224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 305/627] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:29.525561 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f10fc-fa8d-4509-8cb9-7f734852de4b None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:29.536659 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-ddb5b54b-305d-4c3b-9380-0c0cfbaec1c1 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:29.537701 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ddb5b54b-305d-4c3b-9380-0c0cfbaec1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:29.618188 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 323/628] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:29.619212 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5b54b-305d-4c3b-9380-0c0cfbaec1c1 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:29.633944 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f10fc-fa8d-4509-8cb9-7f734852de4b None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:29.656489 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:29.672563 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:29.673296 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5ffe7-b85d-4061-87b7-6ff4968c0478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:29.674479 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5ffe7-b85d-4061-87b7-6ff4968c0478 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:29.675035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5ffe7-b85d-4061-87b7-6ff4968c0478 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:29.675600 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5ffe7-b85d-4061-87b7-6ff4968c0478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:29.693395 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5ffe7-b85d-4061-87b7-6ff4968c0478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:29.695408 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5ffe7-b85d-4061-87b7-6ff4968c0478 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-14d5ffe7-b85d-4061-87b7-6ff4968c0478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:29.712176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:29.713444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:29.714636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:29.714636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:29.714636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:29.716666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 306/629] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:29.722407 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5ffe7-b85d-4061-87b7-6ff4968c0478 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:29.756697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5b54b-305d-4c3b-9380-0c0cfbaec1c1 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:29.816644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea86ea6-3cc9-4b25-a704-87c371beb015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:29.816644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea86ea6-3cc9-4b25-a704-87c371beb015 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:29.816644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea86ea6-3cc9-4b25-a704-87c371beb015 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:29.816644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea86ea6-3cc9-4b25-a704-87c371beb015 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:29.823870 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea86ea6-3cc9-4b25-a704-87c371beb015 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:29.825946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea86ea6-3cc9-4b25-a704-87c371beb015 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:29.846965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-dea86ea6-3cc9-4b25-a704-87c371beb015 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:29.846965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:29.846965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:29.846965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:29.846965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:29.846965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:29.846965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:29.846965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:29.846965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:29.846965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:29.846965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:29.846965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:29.846965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:29.846965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:29.846965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:29.847937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:29.848839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:29.848839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:29.848839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:29.848839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:29.848839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:29.848839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:29.848839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:29.848839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:29.848839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 324/630] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:29.855643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea86ea6-3cc9-4b25-a704-87c371beb015 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:29.871228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5ffe7-b85d-4061-87b7-6ff4968c0478 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:29.937659 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c9a1e-d32e-4e9f-ad73-718b1d24331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:29.938826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c9a1e-d32e-4e9f-ad73-718b1d24331c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:29.940002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c9a1e-d32e-4e9f-ad73-718b1d24331c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:29.940644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c9a1e-d32e-4e9f-ad73-718b1d24331c None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:29.942853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c9a1e-d32e-4e9f-ad73-718b1d24331c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:29.943371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c9a1e-d32e-4e9f-ad73-718b1d24331c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:29.946302 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c9a1e-d32e-4e9f-ad73-718b1d24331c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:29.959509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 307/631] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:29.960377 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c9a1e-d32e-4e9f-ad73-718b1d24331c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:30.009358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:30.022089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea86ea6-3cc9-4b25-a704-87c371beb015 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:30.034992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:30.066546 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eb546-8f32-4d6b-b71f-502749dc99f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:30.067657 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eb546-8f32-4d6b-b71f-502749dc99f0 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:30.067976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eb546-8f32-4d6b-b71f-502749dc99f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:30.068336 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eb546-8f32-4d6b-b71f-502749dc99f0 None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:30.069321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037eb546-8f32-4d6b-b71f-502749dc99f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:30.069738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037eb546-8f32-4d6b-b71f-502749dc99f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:30.071904 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037eb546-8f32-4d6b-b71f-502749dc99f0 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:30.079686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c9a1e-d32e-4e9f-ad73-718b1d24331c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:30.092094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 325/632] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:30.093227 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eb546-8f32-4d6b-b71f-502749dc99f0 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:30.124376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3130db1-b109-44a4-a733-b024d66a2788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:30.125426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3130db1-b109-44a4-a733-b024d66a2788 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:30.125910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3130db1-b109-44a4-a733-b024d66a2788 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:30.126379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3130db1-b109-44a4-a733-b024d66a2788 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:30.139370 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3130db1-b109-44a4-a733-b024d66a2788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-f3130db1-b109-44a4-a733-b024d66a2788 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:30.144488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:30.145606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:30.146454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:30.146454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:30.146454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:30.146454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:30.146454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:30.146454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:30.146454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:30.146454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:30.146454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:30.146454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:30.146454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:30.146454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:30.149026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 308/633] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:30.150058 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3130db1-b109-44a4-a733-b024d66a2788 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:30.205876 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eb546-8f32-4d6b-b71f-502749dc99f0 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:30.242783 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e977d-a1a7-49eb-a52d-4ca19704a8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:30.243709 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e977d-a1a7-49eb-a52d-4ca19704a8a9 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:30.243995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e977d-a1a7-49eb-a52d-4ca19704a8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:30.244270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e977d-a1a7-49eb-a52d-4ca19704a8a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:30.251868 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e977d-a1a7-49eb-a52d-4ca19704a8a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:30.253336 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e977d-a1a7-49eb-a52d-4ca19704a8a9 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:30.253589 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:30.263624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3130db1-b109-44a4-a733-b024d66a2788 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:30.265319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-2e3e977d-a1a7-49eb-a52d-4ca19704a8a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:30.265319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:30.265319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:30.265319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:30.265319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:30.265319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:30.265319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:30.265319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:30.265319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:30.265319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:30.265319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:30.265319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:30.265319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:30.265319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:30.265319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:30.266830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:30.268255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:30.268255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:30.268255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:30.268255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:30.268255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:30.268255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:30.268255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:30.268255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:30.268255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 326/634] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:30.268255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e977d-a1a7-49eb-a52d-4ca19704a8a9 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:30.298467 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:30.303831 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1568f-3554-4e88-a2fa-e959d2f742d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:30.304483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1568f-3554-4e88-a2fa-e959d2f742d5 None admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:30.304766 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1568f-3554-4e88-a2fa-e959d2f742d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:30.305068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1568f-3554-4e88-a2fa-e959d2f742d5 None admin] PATH_INFO: `/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/f544d78f417844f68f3bd37863d24885/roles/7aef270090c546a0aff3f62f1fcf517a` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:30.319567 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1568f-3554-4e88-a2fa-e959d2f742d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=35aafba89a1d47cd86cef1eb0a11e507, user_id=f544d78f417844f68f3bd37863d24885, role_id=7aef270090c546a0aff3f62f1fcf517a)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:30.320925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1568f-3554-4e88-a2fa-e959d2f742d5 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:30.332906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 309/635] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:39:30 2022] PUT /identity/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/f544d78f417844f68f3bd37863d24885/roles/7aef270090c546a0aff3f62f1fcf517a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:39:30.334111 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f2634-81d0-418a-8141-dd57f3de9794 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:30.334396 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f2634-81d0-418a-8141-dd57f3de9794 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:30.334665 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f2634-81d0-418a-8141-dd57f3de9794 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:30.335880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 310/636] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:30.336913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c70e44-ae81-4323-9b01-9ee6e0ec0c8d None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:30.337221 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c70e44-ae81-4323-9b01-9ee6e0ec0c8d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:30.337494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c70e44-ae81-4323-9b01-9ee6e0ec0c8d None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:30.339178 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 311/637] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:30.341954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c70e44-ae81-4323-9b01-9ee6e0ec0c8d None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:30.382591 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e977d-a1a7-49eb-a52d-4ca19704a8a9 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:30.424705 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a070b-b4b1-4505-93d1-4fe8079a2267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:30.425599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a070b-b4b1-4505-93d1-4fe8079a2267 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:30.425876 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a070b-b4b1-4505-93d1-4fe8079a2267 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:30.426155 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a070b-b4b1-4505-93d1-4fe8079a2267 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:30.427256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a070b-b4b1-4505-93d1-4fe8079a2267 None admin] RBAC: Adding query filter params (name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:30.427256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a070b-b4b1-4505-93d1-4fe8079a2267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:30.428550 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a070b-b4b1-4505-93d1-4fe8079a2267 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:30.442666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 327/638] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:30.442666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80127ad-ad8c-4f4d-8fad-a924704a03ab None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:30.442666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80127ad-ad8c-4f4d-8fad-a924704a03ab None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:30.442666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80127ad-ad8c-4f4d-8fad-a924704a03ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:30.460053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-a80127ad-ad8c-4f4d-8fad-a924704a03ab None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:30.461311 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a80127ad-ad8c-4f4d-8fad-a924704a03ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:30.471940 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c70e44-ae81-4323-9b01-9ee6e0ec0c8d None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:30.512431 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e79f1-8fb3-4334-953d-894aba299aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:30.513060 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e79f1-8fb3-4334-953d-894aba299aab None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:30.513346 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e79f1-8fb3-4334-953d-894aba299aab None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:30.513620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e79f1-8fb3-4334-953d-894aba299aab None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:30.514310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e79f1-8fb3-4334-953d-894aba299aab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:30.514605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e79f1-8fb3-4334-953d-894aba299aab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:30.516046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e79f1-8fb3-4334-953d-894aba299aab None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:30.527505 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 312/639] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:30.529491 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881847f-fbcc-48d5-a175-42c25924f7c4 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:30.529491 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881847f-fbcc-48d5-a175-42c25924f7c4 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:30.529792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881847f-fbcc-48d5-a175-42c25924f7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:30.536344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:30.547783 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 328/640] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:30.549074 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80127ad-ad8c-4f4d-8fad-a924704a03ab None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:30.554064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-4881847f-fbcc-48d5-a175-42c25924f7c4 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:30.555486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-4881847f-fbcc-48d5-a175-42c25924f7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:30.580726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:30.655525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 313/641] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:30.657037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881847f-fbcc-48d5-a175-42c25924f7c4 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:30.674648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80127ad-ad8c-4f4d-8fad-a924704a03ab None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:30.711302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7a1e4-0d7d-4949-8fc6-f7ad5bf83c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:30.711932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7a1e4-0d7d-4949-8fc6-f7ad5bf83c31 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:30.712214 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7a1e4-0d7d-4949-8fc6-f7ad5bf83c31 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:30.712490 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7a1e4-0d7d-4949-8fc6-f7ad5bf83c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:30.724360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7a1e4-0d7d-4949-8fc6-f7ad5bf83c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:30.725841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7a1e4-0d7d-4949-8fc6-f7ad5bf83c31 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-0ad7a1e4-0d7d-4949-8fc6-f7ad5bf83c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:30.741503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:30.742509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:30.743419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:30.743419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:30.743419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:30.746740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 329/642] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:30.748733 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7a1e4-0d7d-4949-8fc6-f7ad5bf83c31 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:30.779637 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881847f-fbcc-48d5-a175-42c25924f7c4 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:30.834244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:30.844126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e25f63-ab49-4925-a7d8-a557b5c2d592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:30.845041 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25f63-ab49-4925-a7d8-a557b5c2d592 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:30.847114 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25f63-ab49-4925-a7d8-a557b5c2d592 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:30.847741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25f63-ab49-4925-a7d8-a557b5c2d592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:30.849816 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e25f63-ab49-4925-a7d8-a557b5c2d592 None admin] RBAC: Adding query filter params (role.id=7aef270090c546a0aff3f62f1fcf517a, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=b63d6e588f6e4b598b75a2ec13bea25d) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:30.850356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e25f63-ab49-4925-a7d8-a557b5c2d592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:30.854156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e25f63-ab49-4925-a7d8-a557b5c2d592 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:30.865721 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 314/643] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:30 2022] GET /identity/v3/role_assignments?user.id=b63d6e588f6e4b598b75a2ec13bea25d&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=7aef270090c546a0aff3f62f1fcf517a => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:30.871273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:30.906674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7a1e4-0d7d-4949-8fc6-f7ad5bf83c31 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:30.913243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e25f63-ab49-4925-a7d8-a557b5c2d592 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:30.944802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0a8a5-0b2b-4a9f-994d-99171fe35e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:30.945595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0a8a5-0b2b-4a9f-994d-99171fe35e59 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:30.946088 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0a8a5-0b2b-4a9f-994d-99171fe35e59 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:30.946433 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0a8a5-0b2b-4a9f-994d-99171fe35e59 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:30.947151 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0a8a5-0b2b-4a9f-994d-99171fe35e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:30.947526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0a8a5-0b2b-4a9f-994d-99171fe35e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:30.949218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0a8a5-0b2b-4a9f-994d-99171fe35e59 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:30.963298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 330/644] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:30.970532 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0a8a5-0b2b-4a9f-994d-99171fe35e59 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:31.078260 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e25f63-ab49-4925-a7d8-a557b5c2d592 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:31.116784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f0627-f0e1-4e54-a39b-f567449522f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:31.117475 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f0627-f0e1-4e54-a39b-f567449522f1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:31.117758 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f0627-f0e1-4e54-a39b-f567449522f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:31.118035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f0627-f0e1-4e54-a39b-f567449522f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:31.119797 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0a8a5-0b2b-4a9f-994d-99171fe35e59 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:31.129426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f0627-f0e1-4e54-a39b-f567449522f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-804f0627-f0e1-4e54-a39b-f567449522f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:31.134498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:31.135526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:31.137108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:31.137108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:31.137108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:31.137108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:31.137108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:31.137108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:31.137108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:31.137108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:31.137108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:31.137108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:31.137108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:31.137108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:31.137108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 315/645] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:31.137108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f0627-f0e1-4e54-a39b-f567449522f1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:31.159183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:31.166241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29174cca-e268-4dbb-b0be-05307770101f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:31.166875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29174cca-e268-4dbb-b0be-05307770101f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:31.167157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29174cca-e268-4dbb-b0be-05307770101f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:31.167434 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29174cca-e268-4dbb-b0be-05307770101f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:31.175935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29174cca-e268-4dbb-b0be-05307770101f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:31.177398 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29174cca-e268-4dbb-b0be-05307770101f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-29174cca-e268-4dbb-b0be-05307770101f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:31.192875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:31.194019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:31.195282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:31.195282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:31.195282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:31.195282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:31.195282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:31.195282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:31.195282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:31.195282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:31.195282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 08:39:31.195282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:31.195282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 331/646] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:31.195282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29174cca-e268-4dbb-b0be-05307770101f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:31.207695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:31.267354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f0627-f0e1-4e54-a39b-f567449522f1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:31.303717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4a5d9-0ed1-4465-8a12-6686959355b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:31.304350 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4a5d9-0ed1-4465-8a12-6686959355b9 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:31.304636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4a5d9-0ed1-4465-8a12-6686959355b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:31.304902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4a5d9-0ed1-4465-8a12-6686959355b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:31.317669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4a5d9-0ed1-4465-8a12-6686959355b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-c9f4a5d9-0ed1-4465-8a12-6686959355b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:31.322633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:31.323598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:31.325465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:31.325465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:31.325465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:31.325465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:31.325465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:31.325465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:31.325465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:31.325465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:31.325465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:31.325465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:31.325465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:31.325465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:31.325465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 316/647] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:31.327992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29174cca-e268-4dbb-b0be-05307770101f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:31.330003 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4a5d9-0ed1-4465-8a12-6686959355b9 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:31.374942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9ec40-11ec-4227-a6ab-563dd35ac7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:31.375940 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9ec40-11ec-4227-a6ab-563dd35ac7cf None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:31.375940 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9ec40-11ec-4227-a6ab-563dd35ac7cf None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:31.376142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9ec40-11ec-4227-a6ab-563dd35ac7cf None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:31.376797 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9ec40-11ec-4227-a6ab-563dd35ac7cf None admin] RBAC: Adding query filter params (name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:31.377146 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9ec40-11ec-4227-a6ab-563dd35ac7cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:31.378558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9ec40-11ec-4227-a6ab-563dd35ac7cf None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:31.392140 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 332/648] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:31.393060 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9ec40-11ec-4227-a6ab-563dd35ac7cf None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:31.453738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4a5d9-0ed1-4465-8a12-6686959355b9 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:31.459190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:31.473432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:31.493525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f493a6e-87ec-4035-b6be-8f8c35735f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:31.494184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f493a6e-87ec-4035-b6be-8f8c35735f9b None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:31.494468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f493a6e-87ec-4035-b6be-8f8c35735f9b None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:31.494741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f493a6e-87ec-4035-b6be-8f8c35735f9b None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:31.495884 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f493a6e-87ec-4035-b6be-8f8c35735f9b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:31.495997 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f493a6e-87ec-4035-b6be-8f8c35735f9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:31.498241 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f493a6e-87ec-4035-b6be-8f8c35735f9b None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:31.517422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 317/649] 10.222.0.76 () {56 vars in 1137 bytes} [Fri Aug 26 08:39:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:31.517422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f493a6e-87ec-4035-b6be-8f8c35735f9b None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:31.535259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9ec40-11ec-4227-a6ab-563dd35ac7cf None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:31.572478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b25b06-e673-43ab-9120-444ed6dcb6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:31.573189 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b25b06-e673-43ab-9120-444ed6dcb6b6 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:31.573472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b25b06-e673-43ab-9120-444ed6dcb6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:31.573795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b25b06-e673-43ab-9120-444ed6dcb6b6 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:31.574592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b25b06-e673-43ab-9120-444ed6dcb6b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:31.574903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b25b06-e673-43ab-9120-444ed6dcb6b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:31.576274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b25b06-e673-43ab-9120-444ed6dcb6b6 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:31.589491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 333/650] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:31.590433 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b25b06-e673-43ab-9120-444ed6dcb6b6 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:31.635418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f493a6e-87ec-4035-b6be-8f8c35735f9b None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:31.672055 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4d786-141c-44df-9ec5-acb2cfaadcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:31.673080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4d786-141c-44df-9ec5-acb2cfaadcae None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:31.673595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4d786-141c-44df-9ec5-acb2cfaadcae None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:31.674073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4d786-141c-44df-9ec5-acb2cfaadcae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:31.685411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4d786-141c-44df-9ec5-acb2cfaadcae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:31.687109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4d786-141c-44df-9ec5-acb2cfaadcae None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-7bc4d786-141c-44df-9ec5-acb2cfaadcae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:31.702448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:31.703454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:31.704374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:31.704374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:31.704374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:31.704555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b25b06-e673-43ab-9120-444ed6dcb6b6 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:31.706666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 318/651] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:31.707737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4d786-141c-44df-9ec5-acb2cfaadcae None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:31.723193 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:31.738950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:31.746975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93cfca-5f94-4ac9-8205-b8ac13532be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:31.747823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93cfca-5f94-4ac9-8205-b8ac13532be0 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:31.748106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93cfca-5f94-4ac9-8205-b8ac13532be0 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:31.748378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93cfca-5f94-4ac9-8205-b8ac13532be0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:31.823083 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4d786-141c-44df-9ec5-acb2cfaadcae None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:31.845242 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93cfca-5f94-4ac9-8205-b8ac13532be0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:31.846995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93cfca-5f94-4ac9-8205-b8ac13532be0 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:31.869891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b016d0-b65d-4fc7-9326-d1a581a7e1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:31.870519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b016d0-b65d-4fc7-9326-d1a581a7e1eb None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:31.870799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b016d0-b65d-4fc7-9326-d1a581a7e1eb None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:31.871071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b016d0-b65d-4fc7-9326-d1a581a7e1eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:31.886058 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b016d0-b65d-4fc7-9326-d1a581a7e1eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:31.887476 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b016d0-b65d-4fc7-9326-d1a581a7e1eb None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-f9b016d0-b65d-4fc7-9326-d1a581a7e1eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:31.906345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:31.907455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:31.908932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:31.908932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:31.908932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:31.908932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 319/652] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:31.908932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b016d0-b65d-4fc7-9326-d1a581a7e1eb None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:31.969027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 334/653] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:39:31.969027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93cfca-5f94-4ac9-8205-b8ac13532be0 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:31.988942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:32.013597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:32.047465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b016d0-b65d-4fc7-9326-d1a581a7e1eb None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:32.084356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93cfca-5f94-4ac9-8205-b8ac13532be0 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:32.094381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a0ca4-cc4d-4e72-b199-0ca57ede481f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:32.095004 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a0ca4-cc4d-4e72-b199-0ca57ede481f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:32.095266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a0ca4-cc4d-4e72-b199-0ca57ede481f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:32.095903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a0ca4-cc4d-4e72-b199-0ca57ede481f None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:32.096558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a0ca4-cc4d-4e72-b199-0ca57ede481f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:32.096862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a0ca4-cc4d-4e72-b199-0ca57ede481f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:32.098472 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a0ca4-cc4d-4e72-b199-0ca57ede481f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:32.119354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 320/654] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:32.119354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a0ca4-cc4d-4e72-b199-0ca57ede481f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:32.139336 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a58956-cc7f-4cf3-9d61-6e35388fbc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:32.140264 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a58956-cc7f-4cf3-9d61-6e35388fbc0b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:32.140863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a58956-cc7f-4cf3-9d61-6e35388fbc0b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:32.141357 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a58956-cc7f-4cf3-9d61-6e35388fbc0b None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:32.142195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a58956-cc7f-4cf3-9d61-6e35388fbc0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:32.142694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a58956-cc7f-4cf3-9d61-6e35388fbc0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:32.144318 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a58956-cc7f-4cf3-9d61-6e35388fbc0b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:32.161550 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 335/655] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:32.162708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a58956-cc7f-4cf3-9d61-6e35388fbc0b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:32.232199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a0ca4-cc4d-4e72-b199-0ca57ede481f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:32.242915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:32.267182 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a58956-cc7f-4cf3-9d61-6e35388fbc0b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:32.272861 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c17116-3d7e-4c0c-8e60-6c26dab8db41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:32.273695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c17116-3d7e-4c0c-8e60-6c26dab8db41 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:32.274131 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c17116-3d7e-4c0c-8e60-6c26dab8db41 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:32.274651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c17116-3d7e-4c0c-8e60-6c26dab8db41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:32.282887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:32.287916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c17116-3d7e-4c0c-8e60-6c26dab8db41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:32.290719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c17116-3d7e-4c0c-8e60-6c26dab8db41 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:32.302794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75d05f-0460-4e58-abba-1ac60859d42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:32.303419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75d05f-0460-4e58-abba-1ac60859d42f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:32.303753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75d05f-0460-4e58-abba-1ac60859d42f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:32.304025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75d05f-0460-4e58-abba-1ac60859d42f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-60c17116-3d7e-4c0c-8e60-6c26dab8db41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:32.306543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:32.307440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:32.308345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:32.308345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:32.308345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:32.308345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 321/656] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:32.308572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c17116-3d7e-4c0c-8e60-6c26dab8db41 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:32.317608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75d05f-0460-4e58-abba-1ac60859d42f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:32.319470 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75d05f-0460-4e58-abba-1ac60859d42f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-de75d05f-0460-4e58-abba-1ac60859d42f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:32.331684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:32.332824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:32.333810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:32.333810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:32.333810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:32.333810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:32.333810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:32.333810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:32.333810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:32.333810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:32.333810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 08:39:32.333810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:32.333810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 336/657] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:32.334418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696741d-c69d-4015-aee9-c04261442806 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:32.334418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696741d-c69d-4015-aee9-c04261442806 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:32.334692 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696741d-c69d-4015-aee9-c04261442806 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:32.340168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 337/658] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:32.340168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696741d-c69d-4015-aee9-c04261442806 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:32.421037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c17116-3d7e-4c0c-8e60-6c26dab8db41 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:32.448870 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696741d-c69d-4015-aee9-c04261442806 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:32.458130 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a544d-cf5c-48c4-8847-70f7b9f73509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:32.458790 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a544d-cf5c-48c4-8847-70f7b9f73509 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:32.459082 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a544d-cf5c-48c4-8847-70f7b9f73509 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:32.459369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a544d-cf5c-48c4-8847-70f7b9f73509 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:32.468332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a544d-cf5c-48c4-8847-70f7b9f73509 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:32.469817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a544d-cf5c-48c4-8847-70f7b9f73509 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:32.489058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588f862-0c41-4240-9e40-72ce24732f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:32.489972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588f862-0c41-4240-9e40-72ce24732f60 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:32.490448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588f862-0c41-4240-9e40-72ce24732f60 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:32.490910 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588f862-0c41-4240-9e40-72ce24732f60 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-036a544d-cf5c-48c4-8847-70f7b9f73509 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:32.491166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:32.492175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:32.493701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:32.493701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:32.493701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:32.493701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:32.493701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:32.493701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:32.493701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:32.493701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:32.493701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 08:39:32.493701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:32.493701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 322/659] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:32.493701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a544d-cf5c-48c4-8847-70f7b9f73509 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:32.495440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588f862-0c41-4240-9e40-72ce24732f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:32.495759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588f862-0c41-4240-9e40-72ce24732f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:32.497856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588f862-0c41-4240-9e40-72ce24732f60 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:32.500696 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:32.514729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 338/660] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:32.516119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be1b7b-370b-4a29-a872-77bbcf50d07c None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:32.516413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be1b7b-370b-4a29-a872-77bbcf50d07c None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:32.516689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be1b7b-370b-4a29-a872-77bbcf50d07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:32.534942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-c2be1b7b-370b-4a29-a872-77bbcf50d07c None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:32.536267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c2be1b7b-370b-4a29-a872-77bbcf50d07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:32.551850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:32.609312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a544d-cf5c-48c4-8847-70f7b9f73509 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:32.615476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 339/661] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:32.616907 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be1b7b-370b-4a29-a872-77bbcf50d07c None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:32.653716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b902674-fd8a-4144-801b-01693025c45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:32.654597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b902674-fd8a-4144-801b-01693025c45b None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:32.655045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b902674-fd8a-4144-801b-01693025c45b None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:32.655494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b902674-fd8a-4144-801b-01693025c45b None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:32.656892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b902674-fd8a-4144-801b-01693025c45b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:32.657635 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b902674-fd8a-4144-801b-01693025c45b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:32.659862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b902674-fd8a-4144-801b-01693025c45b None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:32.683874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 323/662] 10.222.0.76 () {56 vars in 1139 bytes} [Fri Aug 26 08:39:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:32.685692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b902674-fd8a-4144-801b-01693025c45b None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:32.743640 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be1b7b-370b-4a29-a872-77bbcf50d07c None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:32.771360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:32.781223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502ee75-4028-460f-9e6d-ec1ddbe36005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:32.781901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502ee75-4028-460f-9e6d-ec1ddbe36005 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:32.782184 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502ee75-4028-460f-9e6d-ec1ddbe36005 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:32.782455 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502ee75-4028-460f-9e6d-ec1ddbe36005 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:32.783231 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502ee75-4028-460f-9e6d-ec1ddbe36005 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:32.783482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502ee75-4028-460f-9e6d-ec1ddbe36005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:32.785029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502ee75-4028-460f-9e6d-ec1ddbe36005 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:32.807811 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 340/663] 10.222.0.76 () {56 vars in 1137 bytes} [Fri Aug 26 08:39:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:32.808708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502ee75-4028-460f-9e6d-ec1ddbe36005 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:32.826292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b902674-fd8a-4144-801b-01693025c45b None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:32.839121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:32.874442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18358d77-002e-4c23-ae09-4b3764c49c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:32.875587 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18358d77-002e-4c23-ae09-4b3764c49c65 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:32.876034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18358d77-002e-4c23-ae09-4b3764c49c65 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:32.876709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18358d77-002e-4c23-ae09-4b3764c49c65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:32.886099 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18358d77-002e-4c23-ae09-4b3764c49c65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:32.888250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18358d77-002e-4c23-ae09-4b3764c49c65 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:32.901639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-18358d77-002e-4c23-ae09-4b3764c49c65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:32.901639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:32.901639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:32.901639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:32.901639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:32.901639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:32.901639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:32.901639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:32.901639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:32.901639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:32.901639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:32.901639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:32.901639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:32.901639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:32.901639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:32.902605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:32.903581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:32.903581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:32.903581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:32.903581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:32.903581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:32.903581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:32.903581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:32.903581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:32.903581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 324/664] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:32.904683 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18358d77-002e-4c23-ae09-4b3764c49c65 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:32.924724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502ee75-4028-460f-9e6d-ec1ddbe36005 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:32.960744 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886bcc8-c3f2-45a0-b83d-563e1aec8106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:32.961311 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886bcc8-c3f2-45a0-b83d-563e1aec8106 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:32.961592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886bcc8-c3f2-45a0-b83d-563e1aec8106 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:32.961866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886bcc8-c3f2-45a0-b83d-563e1aec8106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:33.012677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18358d77-002e-4c23-ae09-4b3764c49c65 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:33.026297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:33.041954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886bcc8-c3f2-45a0-b83d-563e1aec8106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:33.043967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886bcc8-c3f2-45a0-b83d-563e1aec8106 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:33.047703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7944dd-5fb2-4ea3-afb1-0c9252b5e6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:33.048307 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7944dd-5fb2-4ea3-afb1-0c9252b5e6a8 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:33.048592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7944dd-5fb2-4ea3-afb1-0c9252b5e6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:33.048869 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7944dd-5fb2-4ea3-afb1-0c9252b5e6a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:33.083013 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:33.116330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7944dd-5fb2-4ea3-afb1-0c9252b5e6a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:33.117801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7944dd-5fb2-4ea3-afb1-0c9252b5e6a8 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:33.141617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 341/665] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:39:33.142451 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886bcc8-c3f2-45a0-b83d-563e1aec8106 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:33.220889 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 325/666] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:39:33.221896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7944dd-5fb2-4ea3-afb1-0c9252b5e6a8 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:33.227637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:33.243865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886bcc8-c3f2-45a0-b83d-563e1aec8106 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:33.276212 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b00da-2279-400c-8726-2645ed900bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:33.276824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b00da-2279-400c-8726-2645ed900bf0 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:33.277126 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b00da-2279-400c-8726-2645ed900bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:33.277395 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b00da-2279-400c-8726-2645ed900bf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:33.287161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:33.287550 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b00da-2279-400c-8726-2645ed900bf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-bc0b00da-2279-400c-8726-2645ed900bf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:33.292322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:33.293942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:33.294828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:33.294828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:33.294828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:33.294828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:33.294828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:33.294828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:33.294828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:33.294828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:33.294828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:33.294828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:33.294828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:33.294828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:33.294828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 342/667] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:33.296066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bf3c0-7d26-44f3-b25b-ea1746070ea6 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:33.296066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bf3c0-7d26-44f3-b25b-ea1746070ea6 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:33.296066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bf3c0-7d26-44f3-b25b-ea1746070ea6 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:33.297062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 343/668] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:33.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bf3c0-7d26-44f3-b25b-ea1746070ea6 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:33.325645 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7944dd-5fb2-4ea3-afb1-0c9252b5e6a8 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:33.359658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55139cad-370f-4b9e-9542-910afa8cd72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:33.360248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55139cad-370f-4b9e-9542-910afa8cd72e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:33.360523 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55139cad-370f-4b9e-9542-910afa8cd72e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:33.360793 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55139cad-370f-4b9e-9542-910afa8cd72e None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:33.361509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55139cad-370f-4b9e-9542-910afa8cd72e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:33.361814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55139cad-370f-4b9e-9542-910afa8cd72e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:33.363242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55139cad-370f-4b9e-9542-910afa8cd72e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:33.374217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 326/669] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:33.374993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55139cad-370f-4b9e-9542-910afa8cd72e None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:33.405094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bf3c0-7d26-44f3-b25b-ea1746070ea6 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:33.437823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975ab6-304c-4684-a0c6-8d61381dd491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:33.438437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975ab6-304c-4684-a0c6-8d61381dd491 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:33.438718 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975ab6-304c-4684-a0c6-8d61381dd491 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:33.438992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975ab6-304c-4684-a0c6-8d61381dd491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:33.448712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21975ab6-304c-4684-a0c6-8d61381dd491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:33.450194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21975ab6-304c-4684-a0c6-8d61381dd491 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:33.452936 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-21975ab6-304c-4684-a0c6-8d61381dd491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:33.465987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:33.467094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:33.468460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:33.468460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:33.468460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:33.468460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 344/670] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:33.468460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975ab6-304c-4684-a0c6-8d61381dd491 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:33.475566 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55139cad-370f-4b9e-9542-910afa8cd72e None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:33.501620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:33.511219 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51687901-cdec-4bea-b933-07bc97551d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:33.511836 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51687901-cdec-4bea-b933-07bc97551d61 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:33.512145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51687901-cdec-4bea-b933-07bc97551d61 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:33.512419 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51687901-cdec-4bea-b933-07bc97551d61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:33.522527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51687901-cdec-4bea-b933-07bc97551d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:33.524072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51687901-cdec-4bea-b933-07bc97551d61 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-51687901-cdec-4bea-b933-07bc97551d61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:33.538425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:33.539356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:33.540256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:33.540256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:33.540256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:33.540256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 327/671] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:33.540573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f4b26-afbe-4e2b-877b-6560422bc69b None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:33.541097 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f4b26-afbe-4e2b-877b-6560422bc69b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:33.541203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f4b26-afbe-4e2b-877b-6560422bc69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:33.558611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-6a0f4b26-afbe-4e2b-877b-6560422bc69b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:33.559793 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-6a0f4b26-afbe-4e2b-877b-6560422bc69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:33.568735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975ab6-304c-4684-a0c6-8d61381dd491 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:33.602637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b17e8-ec4d-4046-bba5-7e827d1be33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:33.603243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b17e8-ec4d-4046-bba5-7e827d1be33d None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:33.603527 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b17e8-ec4d-4046-bba5-7e827d1be33d None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:33.603804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b17e8-ec4d-4046-bba5-7e827d1be33d None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:33.604749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b17e8-ec4d-4046-bba5-7e827d1be33d None admin] RBAC: Adding query filter params (name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:33.605095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b17e8-ec4d-4046-bba5-7e827d1be33d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:33.606489 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b17e8-ec4d-4046-bba5-7e827d1be33d None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:33.614210 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 345/672] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:33.614990 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b17e8-ec4d-4046-bba5-7e827d1be33d None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:33.630656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 328/673] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:33.631490 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f4b26-afbe-4e2b-877b-6560422bc69b None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:33.677999 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:33.725078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b17e8-ec4d-4046-bba5-7e827d1be33d None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:33.735792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f4b26-afbe-4e2b-877b-6560422bc69b None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:33.746990 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:33.760530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093c88a-cf2e-4f3b-9163-281a0ec0d07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:33.761484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093c88a-cf2e-4f3b-9163-281a0ec0d07d None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:33.761773 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093c88a-cf2e-4f3b-9163-281a0ec0d07d None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:33.762711 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093c88a-cf2e-4f3b-9163-281a0ec0d07d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:33.763423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093c88a-cf2e-4f3b-9163-281a0ec0d07d None admin] RBAC: Adding query filter params (role.id=7aef270090c546a0aff3f62f1fcf517a, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=0f3147e5695240afa9eaf42d2343b7c9) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:33.763833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093c88a-cf2e-4f3b-9163-281a0ec0d07d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:33.765294 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093c88a-cf2e-4f3b-9163-281a0ec0d07d None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:33.771267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 346/674] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:33 2022] GET /identity/v3/role_assignments?user.id=0f3147e5695240afa9eaf42d2343b7c9&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=7aef270090c546a0aff3f62f1fcf517a => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:33.771885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093c88a-cf2e-4f3b-9163-281a0ec0d07d None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:33.775759 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ed49c-200a-424b-b11b-26a45227e7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:33.776718 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ed49c-200a-424b-b11b-26a45227e7dc None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:33.777284 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ed49c-200a-424b-b11b-26a45227e7dc None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:33.778404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ed49c-200a-424b-b11b-26a45227e7dc None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:33.779316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ed49c-200a-424b-b11b-26a45227e7dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:33.779832 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ed49c-200a-424b-b11b-26a45227e7dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:33.782355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ed49c-200a-424b-b11b-26a45227e7dc None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:33.805045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 329/675] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:33.805045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ed49c-200a-424b-b11b-26a45227e7dc None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:33.901222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093c88a-cf2e-4f3b-9163-281a0ec0d07d None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:33.929814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:33.938892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ed49c-200a-424b-b11b-26a45227e7dc None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:33.946394 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afea163-c87a-4d14-8b51-1bd6ed7a1140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:33.947018 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afea163-c87a-4d14-8b51-1bd6ed7a1140 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:33.947303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afea163-c87a-4d14-8b51-1bd6ed7a1140 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:33.947583 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afea163-c87a-4d14-8b51-1bd6ed7a1140 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:33.948602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afea163-c87a-4d14-8b51-1bd6ed7a1140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:33.948913 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afea163-c87a-4d14-8b51-1bd6ed7a1140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:33.950840 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afea163-c87a-4d14-8b51-1bd6ed7a1140 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:33.966085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 347/676] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:33.967056 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afea163-c87a-4d14-8b51-1bd6ed7a1140 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:33.979071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b67a6-9853-4253-8ca5-522c910106d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:33.979710 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b67a6-9853-4253-8ca5-522c910106d7 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:33.980000 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b67a6-9853-4253-8ca5-522c910106d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:33.980279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b67a6-9853-4253-8ca5-522c910106d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:33.991963 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b67a6-9853-4253-8ca5-522c910106d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:33.993754 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b67a6-9853-4253-8ca5-522c910106d7 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-3d3b67a6-9853-4253-8ca5-522c910106d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:34.013713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:34.014727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:34.016288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:34.016288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:34.016288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:34.016288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 330/677] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:34.016539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b67a6-9853-4253-8ca5-522c910106d7 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:34.042431 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:34.078024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afea163-c87a-4d14-8b51-1bd6ed7a1140 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:34.115310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a4810-73a7-40a5-a4b9-bb2673f26499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:34.115943 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a4810-73a7-40a5-a4b9-bb2673f26499 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:34.116217 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a4810-73a7-40a5-a4b9-bb2673f26499 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:34.116486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a4810-73a7-40a5-a4b9-bb2673f26499 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:34.124231 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a4810-73a7-40a5-a4b9-bb2673f26499 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:34.125275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b67a6-9853-4253-8ca5-522c910106d7 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:34.125739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a4810-73a7-40a5-a4b9-bb2673f26499 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:34.136925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-2b6a4810-73a7-40a5-a4b9-bb2673f26499 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:34.136925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:34.136925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:34.136925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:34.136925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:34.136925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:34.136925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:34.136925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:34.136925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:34.136925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:34.136925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:34.136925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:34.136925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:34.136925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:34.136925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:34.138068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:34.138986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:34.138986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:34.138986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:34.138986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:34.138986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:34.138986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:34.138986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:34.138986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:34.138986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 348/678] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:34.139478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a4810-73a7-40a5-a4b9-bb2673f26499 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:34.165866 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62799b-dcd1-44fc-981d-0a6e4fe4bdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:34.166667 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62799b-dcd1-44fc-981d-0a6e4fe4bdfd None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:34.166946 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62799b-dcd1-44fc-981d-0a6e4fe4bdfd None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:34.167218 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62799b-dcd1-44fc-981d-0a6e4fe4bdfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:34.177901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62799b-dcd1-44fc-981d-0a6e4fe4bdfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-0b62799b-dcd1-44fc-981d-0a6e4fe4bdfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:34.182894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:34.183833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:34.184677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:34.184677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:34.184677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:34.184677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:34.184677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:34.184677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:34.184677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:34.184677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:34.184677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:34.184677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:34.184677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:34.184677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:34.184677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 331/679] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:39:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:34.185633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62799b-dcd1-44fc-981d-0a6e4fe4bdfd None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:34.190097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:34.254274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a4810-73a7-40a5-a4b9-bb2673f26499 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:34.273671 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:34.289484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db1254-892a-4f1f-b4ae-152e09cdab65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:34.290117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db1254-892a-4f1f-b4ae-152e09cdab65 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:34.290394 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db1254-892a-4f1f-b4ae-152e09cdab65 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:34.290849 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db1254-892a-4f1f-b4ae-152e09cdab65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:34.294251 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62799b-dcd1-44fc-981d-0a6e4fe4bdfd None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:34.298027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db1254-892a-4f1f-b4ae-152e09cdab65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:34.299459 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db1254-892a-4f1f-b4ae-152e09cdab65 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:34.311202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-11db1254-892a-4f1f-b4ae-152e09cdab65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:34.311202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:34.311202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:34.311202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:34.311202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:34.311202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:34.311202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:34.311202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:34.311202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:34.311202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:34.311202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:34.311202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:34.311202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:34.311202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:34.311202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:34.312129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:34.313153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:34.313153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:34.313153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:34.313153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:34.313153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:34.313153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:34.313153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:34.313153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:34.313153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 349/680] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:34.313153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db1254-892a-4f1f-b4ae-152e09cdab65 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:34.334814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335eea5-aeb9-4c98-a9a9-909c89873c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:34.335421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335eea5-aeb9-4c98-a9a9-909c89873c27 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:34.335701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335eea5-aeb9-4c98-a9a9-909c89873c27 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:34.335968 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335eea5-aeb9-4c98-a9a9-909c89873c27 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:34.336597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335eea5-aeb9-4c98-a9a9-909c89873c27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:34.336905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335eea5-aeb9-4c98-a9a9-909c89873c27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:34.338276 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335eea5-aeb9-4c98-a9a9-909c89873c27 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:34.355824 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 332/681] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:34.356694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335eea5-aeb9-4c98-a9a9-909c89873c27 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:34.422299 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db1254-892a-4f1f-b4ae-152e09cdab65 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:34.423812 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:34.459053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335eea5-aeb9-4c98-a9a9-909c89873c27 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:34.460131 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40a5c6-9b49-4503-a37d-b931f7fbaf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:34.460737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40a5c6-9b49-4503-a37d-b931f7fbaf65 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:34.461053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40a5c6-9b49-4503-a37d-b931f7fbaf65 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:34.461953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40a5c6-9b49-4503-a37d-b931f7fbaf65 None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:34.462063 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40a5c6-9b49-4503-a37d-b931f7fbaf65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:34.462309 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40a5c6-9b49-4503-a37d-b931f7fbaf65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:34.463723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40a5c6-9b49-4503-a37d-b931f7fbaf65 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:34.477292 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 350/682] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:34.478163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40a5c6-9b49-4503-a37d-b931f7fbaf65 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:34.503247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2fd18-ea72-4499-bf6b-95045c56fb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:34.503856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2fd18-ea72-4499-bf6b-95045c56fb0d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:34.504139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2fd18-ea72-4499-bf6b-95045c56fb0d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:34.504471 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2fd18-ea72-4499-bf6b-95045c56fb0d None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:34.505112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2fd18-ea72-4499-bf6b-95045c56fb0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:34.505418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2fd18-ea72-4499-bf6b-95045c56fb0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:34.506778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2fd18-ea72-4499-bf6b-95045c56fb0d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:34.515570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 333/683] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:34.516360 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2fd18-ea72-4499-bf6b-95045c56fb0d None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:34.521285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:34.596228 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40a5c6-9b49-4503-a37d-b931f7fbaf65 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:34.636202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3721e-c457-4023-97ec-d85761320cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:34.637550 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3721e-c457-4023-97ec-d85761320cdd None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:34.637683 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2fd18-ea72-4499-bf6b-95045c56fb0d None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:34.637951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3721e-c457-4023-97ec-d85761320cdd None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:34.638356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3721e-c457-4023-97ec-d85761320cdd None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:34.639400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3721e-c457-4023-97ec-d85761320cdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:34.639708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3721e-c457-4023-97ec-d85761320cdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:34.641170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3721e-c457-4023-97ec-d85761320cdd None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:34.655127 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 351/684] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:34.660205 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3721e-c457-4023-97ec-d85761320cdd None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:34.677701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b7381-2850-42d2-9a53-ff35c4d612ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:34.678328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b7381-2850-42d2-9a53-ff35c4d612ec None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:34.678609 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b7381-2850-42d2-9a53-ff35c4d612ec None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:34.678883 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b7381-2850-42d2-9a53-ff35c4d612ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:34.686867 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:34.687544 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b7381-2850-42d2-9a53-ff35c4d612ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:34.689015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b7381-2850-42d2-9a53-ff35c4d612ec None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-e57b7381-2850-42d2-9a53-ff35c4d612ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:34.701120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:34.702075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:34.708287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:34.708287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:34.708287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:34.708287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:34.708287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:34.708287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:34.708287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:34.708287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:34.708287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 08:39:34.708287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:34.708287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 334/685] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:39:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:34.708287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b7381-2850-42d2-9a53-ff35c4d612ec None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:34.776430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3721e-c457-4023-97ec-d85761320cdd None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:34.779830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:34.813315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad10365-b181-4fe8-af5c-a27a7110c56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:34.813930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad10365-b181-4fe8-af5c-a27a7110c56c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:34.814241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad10365-b181-4fe8-af5c-a27a7110c56c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:34.814480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad10365-b181-4fe8-af5c-a27a7110c56c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:34.815266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad10365-b181-4fe8-af5c-a27a7110c56c None admin] RBAC: Adding query filter params (role.id=7aef270090c546a0aff3f62f1fcf517a, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=e8a867070e974a918a906148bbfd1fd0) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:34.815512 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad10365-b181-4fe8-af5c-a27a7110c56c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:34.817269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad10365-b181-4fe8-af5c-a27a7110c56c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:34.819056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b7381-2850-42d2-9a53-ff35c4d612ec None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:34.824154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 352/686] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:34 2022] GET /identity/v3/role_assignments?user.id=e8a867070e974a918a906148bbfd1fd0&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=7aef270090c546a0aff3f62f1fcf517a => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:34.825471 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad10365-b181-4fe8-af5c-a27a7110c56c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:34.872726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc588941-b62a-44c5-a285-8ecfa765776d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:34.873869 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc588941-b62a-44c5-a285-8ecfa765776d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:34.874350 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc588941-b62a-44c5-a285-8ecfa765776d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:34.874877 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc588941-b62a-44c5-a285-8ecfa765776d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:34.888185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc588941-b62a-44c5-a285-8ecfa765776d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:34.890132 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc588941-b62a-44c5-a285-8ecfa765776d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-cc588941-b62a-44c5-a285-8ecfa765776d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:34.906380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:34.907424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:34.908323 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:34.908323 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:34.908323 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:34.915732 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 335/687] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:34.917075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc588941-b62a-44c5-a285-8ecfa765776d None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:34.924975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:34.943058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad10365-b181-4fe8-af5c-a27a7110c56c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:34.981116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b6ad-7b9b-4fde-b92d-aa98232b2e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:34.981732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b6ad-7b9b-4fde-b92d-aa98232b2e91 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:34.982021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b6ad-7b9b-4fde-b92d-aa98232b2e91 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:34.982297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b6ad-7b9b-4fde-b92d-aa98232b2e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:34.983023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179b6ad-7b9b-4fde-b92d-aa98232b2e91 None admin] RBAC: Adding query filter params (role.id=7aef270090c546a0aff3f62f1fcf517a, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=9fde38c1a2a844368acd3e1b9aa10151) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:34.983335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179b6ad-7b9b-4fde-b92d-aa98232b2e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:34.984761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179b6ad-7b9b-4fde-b92d-aa98232b2e91 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:34.992509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 353/688] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:34 2022] GET /identity/v3/role_assignments?user.id=9fde38c1a2a844368acd3e1b9aa10151&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=7aef270090c546a0aff3f62f1fcf517a => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:34.993338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b6ad-7b9b-4fde-b92d-aa98232b2e91 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:35.061517 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc588941-b62a-44c5-a285-8ecfa765776d None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:35.087006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:35.111109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbca25b-c36d-48c6-bd14-a4e9485f3751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:35.112169 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbca25b-c36d-48c6-bd14-a4e9485f3751 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:35.112169 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbca25b-c36d-48c6-bd14-a4e9485f3751 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:35.112452 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbca25b-c36d-48c6-bd14-a4e9485f3751 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:35.113214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbca25b-c36d-48c6-bd14-a4e9485f3751 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:35.113518 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbca25b-c36d-48c6-bd14-a4e9485f3751 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:35.114985 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbca25b-c36d-48c6-bd14-a4e9485f3751 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:35.130407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b6ad-7b9b-4fde-b92d-aa98232b2e91 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:35.136698 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 336/689] 10.222.0.76 () {56 vars in 1135 bytes} [Fri Aug 26 08:39:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:35.142095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbca25b-c36d-48c6-bd14-a4e9485f3751 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:35.177183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55c79a-8150-4f6f-a38b-58b2b619e606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:35.178057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55c79a-8150-4f6f-a38b-58b2b619e606 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:35.178461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55c79a-8150-4f6f-a38b-58b2b619e606 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:35.178948 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55c79a-8150-4f6f-a38b-58b2b619e606 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:35.179790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55c79a-8150-4f6f-a38b-58b2b619e606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:35.180179 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55c79a-8150-4f6f-a38b-58b2b619e606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:35.181717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55c79a-8150-4f6f-a38b-58b2b619e606 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:35.196001 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 354/690] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:35.203673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55c79a-8150-4f6f-a38b-58b2b619e606 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:35.219166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:35.267404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbca25b-c36d-48c6-bd14-a4e9485f3751 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:35.307195 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5cc3f-f244-4d76-898a-0a175c244854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:35.308033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5cc3f-f244-4d76-898a-0a175c244854 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:35.308313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5cc3f-f244-4d76-898a-0a175c244854 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:35.308585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5cc3f-f244-4d76-898a-0a175c244854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:35.330159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55c79a-8150-4f6f-a38b-58b2b619e606 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:35.370481 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:35.383994 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d76e03-d01b-4a87-ac76-6725e5d498dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:35.384641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d76e03-d01b-4a87-ac76-6725e5d498dd None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:35.384921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d76e03-d01b-4a87-ac76-6725e5d498dd None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:35.385225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d76e03-d01b-4a87-ac76-6725e5d498dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:35.394299 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d76e03-d01b-4a87-ac76-6725e5d498dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:35.396465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d76e03-d01b-4a87-ac76-6725e5d498dd None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:35.410512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5cc3f-f244-4d76-898a-0a175c244854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-f3d76e03-d01b-4a87-ac76-6725e5d498dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:35.411903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:35.412895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:35.414552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:35.414552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:35.414552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:35.414552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:35.414552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:35.414552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:35.414552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:35.414552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:35.414552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:39:35.414552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:35.414552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 355/691] 10.222.0.76 () {56 vars in 1093 bytes} [Fri Aug 26 08:39:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:35.415923 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5cc3f-f244-4d76-898a-0a175c244854 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:35.419564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d76e03-d01b-4a87-ac76-6725e5d498dd None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:35.506538 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:35.559109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d76e03-d01b-4a87-ac76-6725e5d498dd None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:35.559469 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 337/692] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:39:35.562279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5cc3f-f244-4d76-898a-0a175c244854 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:35.615083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5b414-9f5f-4cce-9986-9ee77cc7b004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:35.615974 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5b414-9f5f-4cce-9986-9ee77cc7b004 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:35.616407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5b414-9f5f-4cce-9986-9ee77cc7b004 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:35.616836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5b414-9f5f-4cce-9986-9ee77cc7b004 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:35.617730 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5b414-9f5f-4cce-9986-9ee77cc7b004 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:35.618175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5b414-9f5f-4cce-9986-9ee77cc7b004 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:35.620300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5b414-9f5f-4cce-9986-9ee77cc7b004 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:35.639989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 356/693] 10.222.0.76 () {56 vars in 1133 bytes} [Fri Aug 26 08:39:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:35.645734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5b414-9f5f-4cce-9986-9ee77cc7b004 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:35.755878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:35.790367 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5b414-9f5f-4cce-9986-9ee77cc7b004 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:35.791247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5cc3f-f244-4d76-898a-0a175c244854 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:35.830753 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9981624-e942-4dfb-8ba3-ba8c34635350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:35.831542 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9981624-e942-4dfb-8ba3-ba8c34635350 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:35.832151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9981624-e942-4dfb-8ba3-ba8c34635350 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:35.832290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:35.832425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9981624-e942-4dfb-8ba3-ba8c34635350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:35.838518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7738f9-04b4-4a98-a63c-f742f0b6f111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:35.840860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7738f9-04b4-4a98-a63c-f742f0b6f111 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:35.841591 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7738f9-04b4-4a98-a63c-f742f0b6f111 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:35.842387 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7738f9-04b4-4a98-a63c-f742f0b6f111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:35.844070 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9981624-e942-4dfb-8ba3-ba8c34635350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:35.845797 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9981624-e942-4dfb-8ba3-ba8c34635350 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-d9981624-e942-4dfb-8ba3-ba8c34635350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:35.863862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:35.865077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:35.866235 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:35.866235 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:35.866235 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:35.866235 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 338/694] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:35.866526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1bb7a-8680-4c19-a150-a060a3fa852d None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:35.870958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1bb7a-8680-4c19-a150-a060a3fa852d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:35.870958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1bb7a-8680-4c19-a150-a060a3fa852d None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:35.872716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 339/695] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:35.873523 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1bb7a-8680-4c19-a150-a060a3fa852d None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:35.928717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7738f9-04b4-4a98-a63c-f742f0b6f111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:35.931113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7738f9-04b4-4a98-a63c-f742f0b6f111 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:36.001140 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1bb7a-8680-4c19-a150-a060a3fa852d None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:36.034803 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:36.046387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca2394-612b-4cb3-adb9-aaeb877dbc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:36.047314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca2394-612b-4cb3-adb9-aaeb877dbc37 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:36.047597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca2394-612b-4cb3-adb9-aaeb877dbc37 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:36.047874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca2394-612b-4cb3-adb9-aaeb877dbc37 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:36.048796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca2394-612b-4cb3-adb9-aaeb877dbc37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:36.049134 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca2394-612b-4cb3-adb9-aaeb877dbc37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:36.050672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca2394-612b-4cb3-adb9-aaeb877dbc37 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:36.060466 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 357/696] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 08:39:36.062694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede3df2-1563-48f2-99f2-051812c8faa1 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:36.063485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede3df2-1563-48f2-99f2-051812c8faa1 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:36.063966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede3df2-1563-48f2-99f2-051812c8faa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:36.065308 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 340/697] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:36.066146 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca2394-612b-4cb3-adb9-aaeb877dbc37 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:36.093316 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-7ede3df2-1563-48f2-99f2-051812c8faa1 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:36.095701 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-7ede3df2-1563-48f2-99f2-051812c8faa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:36.128580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:36.178725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca2394-612b-4cb3-adb9-aaeb877dbc37 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:36.192892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 358/698] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:36.195355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede3df2-1563-48f2-99f2-051812c8faa1 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:36.227810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dffcc2-039a-4281-97b7-c43942099c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:36.227810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dffcc2-039a-4281-97b7-c43942099c6a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:36.227810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dffcc2-039a-4281-97b7-c43942099c6a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:36.227810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dffcc2-039a-4281-97b7-c43942099c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:36.250472 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dffcc2-039a-4281-97b7-c43942099c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:36.251917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dffcc2-039a-4281-97b7-c43942099c6a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-07dffcc2-039a-4281-97b7-c43942099c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:36.276306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:36.277319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:36.278280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:36.278280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:36.278280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:36.279952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 341/699] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:36.285399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dffcc2-039a-4281-97b7-c43942099c6a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:36.347428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:36.358098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede3df2-1563-48f2-99f2-051812c8faa1 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:36.394924 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344874c7-bb6c-4cb2-90ce-b3d123a5ae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:36.395477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344874c7-bb6c-4cb2-90ce-b3d123a5ae8b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:36.395761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344874c7-bb6c-4cb2-90ce-b3d123a5ae8b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:36.396035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344874c7-bb6c-4cb2-90ce-b3d123a5ae8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:36.402947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344874c7-bb6c-4cb2-90ce-b3d123a5ae8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:36.404384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344874c7-bb6c-4cb2-90ce-b3d123a5ae8b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:36.415554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-344874c7-bb6c-4cb2-90ce-b3d123a5ae8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:36.415554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:36.415554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:36.415554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:36.415554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:36.415554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:36.415554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:36.415554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:36.415554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:36.415554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:36.415554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:36.415554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:36.415554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:36.415554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:36.415554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:36.416485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:36.417476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:36.417476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:36.417476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:36.417476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:36.417476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:36.417476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:36.417476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:36.417476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:36.417476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 359/700] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:36.423862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344874c7-bb6c-4cb2-90ce-b3d123a5ae8b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:36.444016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:36.451495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dffcc2-039a-4281-97b7-c43942099c6a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:36.492283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9d9df-c215-4d04-a738-c9422b5df3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:36.493166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d9df-c215-4d04-a738-c9422b5df3b1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:36.493482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d9df-c215-4d04-a738-c9422b5df3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:36.494125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d9df-c215-4d04-a738-c9422b5df3b1 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:36.495046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9d9df-c215-4d04-a738-c9422b5df3b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:36.495355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9d9df-c215-4d04-a738-c9422b5df3b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:36.497344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9d9df-c215-4d04-a738-c9422b5df3b1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:36.516378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 342/701] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:36.524436 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9d9df-c215-4d04-a738-c9422b5df3b1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:36.554863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344874c7-bb6c-4cb2-90ce-b3d123a5ae8b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:36.607916 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc391224-f4cd-4885-aff8-92f593064978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:36.608782 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc391224-f4cd-4885-aff8-92f593064978 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:36.609264 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc391224-f4cd-4885-aff8-92f593064978 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:36.609675 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc391224-f4cd-4885-aff8-92f593064978 None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:36.610500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc391224-f4cd-4885-aff8-92f593064978 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:36.611002 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc391224-f4cd-4885-aff8-92f593064978 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:36.612567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc391224-f4cd-4885-aff8-92f593064978 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:36.626042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 360/702] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:36.627159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc391224-f4cd-4885-aff8-92f593064978 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:36.664405 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:36.669487 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9d9df-c215-4d04-a738-c9422b5df3b1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:36.713327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab979b-3b5f-4e8b-980b-99b4b5e6246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:36.714381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab979b-3b5f-4e8b-980b-99b4b5e6246d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:36.714759 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab979b-3b5f-4e8b-980b-99b4b5e6246d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:36.715159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab979b-3b5f-4e8b-980b-99b4b5e6246d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:36.720723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:36.725538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab979b-3b5f-4e8b-980b-99b4b5e6246d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:36.727371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab979b-3b5f-4e8b-980b-99b4b5e6246d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:36.742255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-50ab979b-3b5f-4e8b-980b-99b4b5e6246d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:36.742255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:36.742255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:36.742255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:36.742255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:36.742255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:36.742255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:36.742255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:36.742255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:36.742255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:36.742255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:36.742255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:36.742255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:36.742255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:36.742255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:36.743356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:36.744459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:36.744459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:36.744459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:36.744459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:36.744459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:36.744459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:36.744459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:36.744459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:36.751600 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 343/703] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:36.751600 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab979b-3b5f-4e8b-980b-99b4b5e6246d None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:36.753645 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc391224-f4cd-4885-aff8-92f593064978 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:36.788733 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda4edb-ab38-4cf3-b853-b19ba07d74ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:36.789620 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda4edb-ab38-4cf3-b853-b19ba07d74ca None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:36.790091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda4edb-ab38-4cf3-b853-b19ba07d74ca None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:36.790495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda4edb-ab38-4cf3-b853-b19ba07d74ca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:36.791203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda4edb-ab38-4cf3-b853-b19ba07d74ca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:36.792697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda4edb-ab38-4cf3-b853-b19ba07d74ca None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-eeda4edb-ab38-4cf3-b853-b19ba07d74ca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:36.804565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:36.805847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:36.806860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:36.806860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:36.806860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:36.806860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:36.806860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:36.806860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:36.806860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:36.806860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:36.806860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:36.806860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:36.806860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:39:36.806860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:36.806860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 08:39:36.806860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:36.814747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 361/704] 10.222.0.76 () {56 vars in 1129 bytes} [Fri Aug 26 08:39:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:36.815795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda4edb-ab38-4cf3-b853-b19ba07d74ca None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:36.882556 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab979b-3b5f-4e8b-980b-99b4b5e6246d None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:36.927409 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283f4fe-6404-49b9-a8d0-12f896ad60c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:36.928362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283f4fe-6404-49b9-a8d0-12f896ad60c1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:36.928787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283f4fe-6404-49b9-a8d0-12f896ad60c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:36.929285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283f4fe-6404-49b9-a8d0-12f896ad60c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:36.929893 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda4edb-ab38-4cf3-b853-b19ba07d74ca None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:36.930351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283f4fe-6404-49b9-a8d0-12f896ad60c1 None admin] RBAC: Adding query filter params (role.id=7aef270090c546a0aff3f62f1fcf517a, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=f544d78f417844f68f3bd37863d24885) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:36.930813 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283f4fe-6404-49b9-a8d0-12f896ad60c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:36.933304 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283f4fe-6404-49b9-a8d0-12f896ad60c1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:36.942393 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 344/705] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:36 2022] GET /identity/v3/role_assignments?user.id=f544d78f417844f68f3bd37863d24885&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=7aef270090c546a0aff3f62f1fcf517a => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:36.943962 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283f4fe-6404-49b9-a8d0-12f896ad60c1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:36.993354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:36.996963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a600b07-e32a-4966-be80-e453a6f0462e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:36.997624 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a600b07-e32a-4966-be80-e453a6f0462e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:36.997911 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a600b07-e32a-4966-be80-e453a6f0462e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:36.998194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a600b07-e32a-4966-be80-e453a6f0462e None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:36.998902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a600b07-e32a-4966-be80-e453a6f0462e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:37.000374 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a600b07-e32a-4966-be80-e453a6f0462e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:37.001928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a600b07-e32a-4966-be80-e453a6f0462e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:37.035710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 362/706] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:37.041974 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a600b07-e32a-4966-be80-e453a6f0462e None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:37.045979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:37.160431 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a600b07-e32a-4966-be80-e453a6f0462e None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:37.161686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283f4fe-6404-49b9-a8d0-12f896ad60c1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:37.199826 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054abb6-9dfb-4572-8161-ebfea483c71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:37.200376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054abb6-9dfb-4572-8161-ebfea483c71e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:37.200670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054abb6-9dfb-4572-8161-ebfea483c71e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:37.201824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054abb6-9dfb-4572-8161-ebfea483c71e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:37.202068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13783fd8-a86d-4d36-b03b-fd6736298322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:37.202571 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054abb6-9dfb-4572-8161-ebfea483c71e None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=b63d6e588f6e4b598b75a2ec13bea25d) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:37.202891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054abb6-9dfb-4572-8161-ebfea483c71e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:37.203530 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13783fd8-a86d-4d36-b03b-fd6736298322 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:37.204009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13783fd8-a86d-4d36-b03b-fd6736298322 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:37.204328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054abb6-9dfb-4572-8161-ebfea483c71e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:37.204694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13783fd8-a86d-4d36-b03b-fd6736298322 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:37.205363 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13783fd8-a86d-4d36-b03b-fd6736298322 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:37.205671 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13783fd8-a86d-4d36-b03b-fd6736298322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:37.207158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13783fd8-a86d-4d36-b03b-fd6736298322 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:37.210517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 363/707] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:37 2022] GET /identity/v3/role_assignments?user.id=b63d6e588f6e4b598b75a2ec13bea25d&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:37.212498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 345/708] 10.222.0.76 () {56 vars in 1124 bytes} [Fri Aug 26 08:39:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:37.213277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b63a51-f5fd-4d15-9dff-92943cea1e2d None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:37.213561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b63a51-f5fd-4d15-9dff-92943cea1e2d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:37.214107 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b63a51-f5fd-4d15-9dff-92943cea1e2d None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:37.216128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 364/709] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:37.222500 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83139f55-ea2d-410d-b8c1-e7eea32e49f5 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:37.223004 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83139f55-ea2d-410d-b8c1-e7eea32e49f5 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:37.223437 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83139f55-ea2d-410d-b8c1-e7eea32e49f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:37.226134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b63a51-f5fd-4d15-9dff-92943cea1e2d None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:37.243728 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-83139f55-ea2d-410d-b8c1-e7eea32e49f5 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:37.245356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-83139f55-ea2d-410d-b8c1-e7eea32e49f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:37.315833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:37.333706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 346/710] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:37.368304 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b63a51-f5fd-4d15-9dff-92943cea1e2d None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:37.412712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a6201-fee9-482b-82bc-91304def6806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:37.413349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6201-fee9-482b-82bc-91304def6806 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:37.413627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6201-fee9-482b-82bc-91304def6806 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:37.413925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6201-fee9-482b-82bc-91304def6806 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:37.414554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a6201-fee9-482b-82bc-91304def6806 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:37.414856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a6201-fee9-482b-82bc-91304def6806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:37.416202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a6201-fee9-482b-82bc-91304def6806 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:37.422373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 365/711] 10.222.0.76 () {56 vars in 1124 bytes} [Fri Aug 26 08:39:37 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:37.502415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ceef0-ea3d-4daa-8c80-efe28e5820d7 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:37.502716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ceef0-ea3d-4daa-8c80-efe28e5820d7 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:37.502867 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ceef0-ea3d-4daa-8c80-efe28e5820d7 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:37.504487 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 347/712] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:37.509780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8c006-2bc6-4779-bc72-09e76a4dd849 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:37.510173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8c006-2bc6-4779-bc72-09e76a4dd849 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:37.510543 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8c006-2bc6-4779-bc72-09e76a4dd849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:37.542176 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-38f8c006-2bc6-4779-bc72-09e76a4dd849 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:37.543427 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-38f8c006-2bc6-4779-bc72-09e76a4dd849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:37.617711 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 366/713] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:37.643050 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ceef0-ea3d-4daa-8c80-efe28e5820d7 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:37.665544 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:37.773807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ceef0-ea3d-4daa-8c80-efe28e5820d7 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:37.816414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716e738-23c9-48f6-8af3-3e802601b2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:37.817476 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716e738-23c9-48f6-8af3-3e802601b2c4 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:37.818000 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716e738-23c9-48f6-8af3-3e802601b2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:37.818470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716e738-23c9-48f6-8af3-3e802601b2c4 None admin] PATH_INFO: `/v3/services/network` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:37.819269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716e738-23c9-48f6-8af3-3e802601b2c4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:37.820827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716e738-23c9-48f6-8af3-3e802601b2c4 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-a716e738-23c9-48f6-8af3-3e802601b2c4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:37.838052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:37.839354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:37.840288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:37.840288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:37.840288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:37.840288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:37.840288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:37.840288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:37.840288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:37.840288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:37.840288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:37.840288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:37.840288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:39:37.840288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:37.840288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 08:39:37.840288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:37.842766 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 348/714] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:37 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:37.848693 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8c006-2bc6-4779-bc72-09e76a4dd849 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:37.897079 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716e738-23c9-48f6-8af3-3e802601b2c4 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:37.961369 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:38.016103 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8c006-2bc6-4779-bc72-09e76a4dd849 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:38.053997 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:38.061230 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c3cff-db71-45d0-872c-cf3aa418d16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:38.061906 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c3cff-db71-45d0-872c-cf3aa418d16e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:38.062196 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c3cff-db71-45d0-872c-cf3aa418d16e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:38.062470 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c3cff-db71-45d0-872c-cf3aa418d16e None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:38.063161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c3cff-db71-45d0-872c-cf3aa418d16e None admin] RBAC: Adding query filter params (name=network) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:38.063471 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c3cff-db71-45d0-872c-cf3aa418d16e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:38.065017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c3cff-db71-45d0-872c-cf3aa418d16e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:38.077970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 367/715] 10.222.0.76 () {56 vars in 1112 bytes} [Fri Aug 26 08:39:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:38.078572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716e738-23c9-48f6-8af3-3e802601b2c4 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:38.083234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c3cff-db71-45d0-872c-cf3aa418d16e None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:38.115031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059f3c0-1021-4c8f-a9b2-239864d5428d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:38.116012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059f3c0-1021-4c8f-a9b2-239864d5428d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:38.116494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059f3c0-1021-4c8f-a9b2-239864d5428d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:38.117016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059f3c0-1021-4c8f-a9b2-239864d5428d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:38.128656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059f3c0-1021-4c8f-a9b2-239864d5428d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:38.130406 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059f3c0-1021-4c8f-a9b2-239864d5428d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-4059f3c0-1021-4c8f-a9b2-239864d5428d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:38.145024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:38.146043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:38.146984 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:38.146984 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:38.146984 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:38.149038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 349/716] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:38.174317 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059f3c0-1021-4c8f-a9b2-239864d5428d None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:38.211359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c3cff-db71-45d0-872c-cf3aa418d16e None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:38.236724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:38.258029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6bb1d-7027-49d0-bae9-1dd06785f37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:38.258994 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6bb1d-7027-49d0-bae9-1dd06785f37f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:38.259483 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6bb1d-7027-49d0-bae9-1dd06785f37f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:38.259961 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6bb1d-7027-49d0-bae9-1dd06785f37f None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:38.260791 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6bb1d-7027-49d0-bae9-1dd06785f37f None admin] RBAC: Adding query filter params (type=network) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:38.261319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6bb1d-7027-49d0-bae9-1dd06785f37f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:38.262949 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6bb1d-7027-49d0-bae9-1dd06785f37f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:38.273135 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 368/717] 10.222.0.76 () {56 vars in 1112 bytes} [Fri Aug 26 08:39:38 2022] GET /identity/v3/services?type=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:38.311520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059f3c0-1021-4c8f-a9b2-239864d5428d None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:38.349089 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:38.350009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9d1ee-4f22-4a43-b33e-aff1959456ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:38.350640 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9d1ee-4f22-4a43-b33e-aff1959456ab None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:38.350927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9d1ee-4f22-4a43-b33e-aff1959456ab None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:38.351207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9d1ee-4f22-4a43-b33e-aff1959456ab None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:38.351879 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9d1ee-4f22-4a43-b33e-aff1959456ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:38.352185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9d1ee-4f22-4a43-b33e-aff1959456ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:38.353633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9d1ee-4f22-4a43-b33e-aff1959456ab None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:38.367650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 350/718] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:38.374173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6bb1d-7027-49d0-bae9-1dd06785f37f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:38.514115 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6bb1d-7027-49d0-bae9-1dd06785f37f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:38.558280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a89a0c-f2c5-41ca-8773-a69e6c150ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:38.558932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a89a0c-f2c5-41ca-8773-a69e6c150ce7 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:38.559207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a89a0c-f2c5-41ca-8773-a69e6c150ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:38.559475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a89a0c-f2c5-41ca-8773-a69e6c150ce7 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:38.560125 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a89a0c-f2c5-41ca-8773-a69e6c150ce7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:38.561638 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a89a0c-f2c5-41ca-8773-a69e6c150ce7 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:38.608324 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 369/719] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:39:38 2022] POST /identity/v3/users => generated 254 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:39:39.419889 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad903a-6da6-460b-9faa-0256fc9e9dda None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:39.420928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad903a-6da6-460b-9faa-0256fc9e9dda None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:39.421448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad903a-6da6-460b-9faa-0256fc9e9dda None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:39.423301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 351/720] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:39.428106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd938e-c419-4d43-a686-1add7caa77b5 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:39.428917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd938e-c419-4d43-a686-1add7caa77b5 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:39.429441 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd938e-c419-4d43-a686-1add7caa77b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:39.457485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-73fd938e-c419-4d43-a686-1add7caa77b5 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:39.459037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-73fd938e-c419-4d43-a686-1add7caa77b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:39.507063 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:39.543674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 370/721] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:39.695690 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e118f-daef-4821-9d32-9fa5978027d8 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:39.695992 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e118f-daef-4821-9d32-9fa5978027d8 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:39.696207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e118f-daef-4821-9d32-9fa5978027d8 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:39.697737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 352/722] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:39.706866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b44bb-8c3e-4ebb-8bfc-e9c9dd6ed2cc None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:39.707154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b44bb-8c3e-4ebb-8bfc-e9c9dd6ed2cc None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:39.707432 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b44bb-8c3e-4ebb-8bfc-e9c9dd6ed2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:39.733981 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-d37b44bb-8c3e-4ebb-8bfc-e9c9dd6ed2cc None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:39.735169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d37b44bb-8c3e-4ebb-8bfc-e9c9dd6ed2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:39.823555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 371/723] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:40.020524 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e118f-daef-4821-9d32-9fa5978027d8 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:40.044658 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c0486-c5fc-4b12-8313-391a71dc262e None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:40.044971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c0486-c5fc-4b12-8313-391a71dc262e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:40.045232 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c0486-c5fc-4b12-8313-391a71dc262e None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:40.046584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 372/724] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:39:40.060510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b35cce-ad5b-4ec6-8e6f-46a144cc8ac5 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:40.060802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b35cce-ad5b-4ec6-8e6f-46a144cc8ac5 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:40.061110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b35cce-ad5b-4ec6-8e6f-46a144cc8ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:40.081734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-83b35cce-ad5b-4ec6-8e6f-46a144cc8ac5 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:40.082923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-83b35cce-ad5b-4ec6-8e6f-46a144cc8ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:40.205188 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 373/725] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 08:39:40.209652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e118f-daef-4821-9d32-9fa5978027d8 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:40.209885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b35cce-ad5b-4ec6-8e6f-46a144cc8ac5 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:40.283590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace7443-3a8e-443c-a5ff-0d4df12c1407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:40.284147 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace7443-3a8e-443c-a5ff-0d4df12c1407 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:40.284427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace7443-3a8e-443c-a5ff-0d4df12c1407 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:40.284699 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace7443-3a8e-443c-a5ff-0d4df12c1407 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:40.293396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:40.302762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace7443-3a8e-443c-a5ff-0d4df12c1407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-7ace7443-3a8e-443c-a5ff-0d4df12c1407 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:40.313159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:40.314120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:40.315460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:40.315460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:40.315460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:40.315460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:40.315460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:40.315460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:40.315460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:40.315460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:40.315460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:40.315460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:40.315460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:40.315460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:40.315460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 353/726] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:39:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:40.322917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace7443-3a8e-443c-a5ff-0d4df12c1407 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:40.396983 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b35cce-ad5b-4ec6-8e6f-46a144cc8ac5 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:40.424109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:40.466816 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40234304-b381-4171-b41a-42db40f5842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:40.467484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40234304-b381-4171-b41a-42db40f5842e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:40.467732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40234304-b381-4171-b41a-42db40f5842e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:40.468003 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40234304-b381-4171-b41a-42db40f5842e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:40.482448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40234304-b381-4171-b41a-42db40f5842e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-40234304-b381-4171-b41a-42db40f5842e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:40.489265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:40.490215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:40.491077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:40.491077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:40.491077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:40.491077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:40.491077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:40.491077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:40.491077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:40.491077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:40.491077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:40.491077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:40.491077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:40.491077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:40.492355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 374/727] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:39:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:40.495098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37732968-f3f7-4aba-9aef-09cef1891f26 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:40.495098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37732968-f3f7-4aba-9aef-09cef1891f26 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:40.495098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37732968-f3f7-4aba-9aef-09cef1891f26 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:40.495535 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 375/728] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:40.497356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace7443-3a8e-443c-a5ff-0d4df12c1407 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:40.501359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37732968-f3f7-4aba-9aef-09cef1891f26 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:40.534735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273e857-f2c0-4653-899c-d0db51d287b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:40.535273 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273e857-f2c0-4653-899c-d0db51d287b0 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:40.535555 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273e857-f2c0-4653-899c-d0db51d287b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:40.535829 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273e857-f2c0-4653-899c-d0db51d287b0 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:40.536496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273e857-f2c0-4653-899c-d0db51d287b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:40.536790 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273e857-f2c0-4653-899c-d0db51d287b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:40.538258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273e857-f2c0-4653-899c-d0db51d287b0 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:40.548455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 354/729] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:40.549410 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b55ad3-7db3-4d60-84c1-821f51298937 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:40.549688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b55ad3-7db3-4d60-84c1-821f51298937 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:40.549980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b55ad3-7db3-4d60-84c1-821f51298937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:40.569060 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-12b55ad3-7db3-4d60-84c1-821f51298937 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:40.570247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-12b55ad3-7db3-4d60-84c1-821f51298937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:40.618740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:40.628825 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37732968-f3f7-4aba-9aef-09cef1891f26 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:40.644334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 355/730] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 08:39:40.645351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b55ad3-7db3-4d60-84c1-821f51298937 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:40.677653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b01908-5f1c-469d-8805-79d8495bf8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:40.679245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b01908-5f1c-469d-8805-79d8495bf8ba None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:40.679764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b01908-5f1c-469d-8805-79d8495bf8ba None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:40.680754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b01908-5f1c-469d-8805-79d8495bf8ba None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:40.682218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b01908-5f1c-469d-8805-79d8495bf8ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:40.682840 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b01908-5f1c-469d-8805-79d8495bf8ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:40.685673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b01908-5f1c-469d-8805-79d8495bf8ba None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:40.696413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 376/731] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:40.698194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b01908-5f1c-469d-8805-79d8495bf8ba None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:40.704890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:40.768581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b55ad3-7db3-4d60-84c1-821f51298937 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:40.805598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff91c57-e63c-4a8b-9350-ee70bf202995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:40.806123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff91c57-e63c-4a8b-9350-ee70bf202995 None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:40.806400 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff91c57-e63c-4a8b-9350-ee70bf202995 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:40.806669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff91c57-e63c-4a8b-9350-ee70bf202995 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:40.807310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff91c57-e63c-4a8b-9350-ee70bf202995 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:40.809126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff91c57-e63c-4a8b-9350-ee70bf202995 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:40.835805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 356/732] 10.222.0.76 () {60 vars in 1141 bytes} [Fri Aug 26 08:39:40 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:39:40.835805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff91c57-e63c-4a8b-9350-ee70bf202995 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:40.849879 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b01908-5f1c-469d-8805-79d8495bf8ba None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:40.954759 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:40.959493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff91c57-e63c-4a8b-9350-ee70bf202995 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:40.961118 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2a0f7-7edb-49b9-96b6-dcb3063fa7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:40.963442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2a0f7-7edb-49b9-96b6-dcb3063fa7a2 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:40.964309 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2a0f7-7edb-49b9-96b6-dcb3063fa7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:40.965662 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2a0f7-7edb-49b9-96b6-dcb3063fa7a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:40.982521 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2a0f7-7edb-49b9-96b6-dcb3063fa7a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:40.984125 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2a0f7-7edb-49b9-96b6-dcb3063fa7a2 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-1ca2a0f7-7edb-49b9-96b6-dcb3063fa7a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:41.002282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:41.003530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:41.004667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:41.004667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:41.004667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:41.004869 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc709d-5edb-4614-88ab-e1901297b3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:41.004869 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc709d-5edb-4614-88ab-e1901297b3aa None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:41.004869 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc709d-5edb-4614-88ab-e1901297b3aa None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:41.004869 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc709d-5edb-4614-88ab-e1901297b3aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:41.009643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 377/733] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:41.010600 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2a0f7-7edb-49b9-96b6-dcb3063fa7a2 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:41.016983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc709d-5edb-4614-88ab-e1901297b3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:41.018541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc709d-5edb-4614-88ab-e1901297b3aa None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:41.024128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-e2dc709d-5edb-4614-88ab-e1901297b3aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:41.038618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:41.039840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:41.040807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:41.040807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:41.040807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:41.040807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 357/734] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:41.040807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc709d-5edb-4614-88ab-e1901297b3aa None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:41.131693 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2a0f7-7edb-49b9-96b6-dcb3063fa7a2 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:41.157277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc709d-5edb-4614-88ab-e1901297b3aa None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:41.166194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b953fa4-1d74-49cd-8f1e-d5ebeab6857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:41.166805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b953fa4-1d74-49cd-8f1e-d5ebeab6857f None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:41.167095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b953fa4-1d74-49cd-8f1e-d5ebeab6857f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:41.167369 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b953fa4-1d74-49cd-8f1e-d5ebeab6857f None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:41.168006 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b953fa4-1d74-49cd-8f1e-d5ebeab6857f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:41.169443 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b953fa4-1d74-49cd-8f1e-d5ebeab6857f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:41.186132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 378/735] 10.222.0.76 () {60 vars in 1141 bytes} [Fri Aug 26 08:39:41 2022] POST /identity/v3/services => generated 240 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:39:41.186132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b953fa4-1d74-49cd-8f1e-d5ebeab6857f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:41.211996 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7255c-6db8-44cc-a643-30803c0b971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:41.213268 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7255c-6db8-44cc-a643-30803c0b971d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:41.213705 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7255c-6db8-44cc-a643-30803c0b971d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:41.214588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7255c-6db8-44cc-a643-30803c0b971d None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:41.216629 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7255c-6db8-44cc-a643-30803c0b971d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:41.217226 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7255c-6db8-44cc-a643-30803c0b971d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:41.219389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7255c-6db8-44cc-a643-30803c0b971d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:41.237387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 358/736] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:41.239686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af593f6-7713-4f9f-b4a6-04457848a569 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:41.240406 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af593f6-7713-4f9f-b4a6-04457848a569 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:41.240831 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af593f6-7713-4f9f-b4a6-04457848a569 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:41.243074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 359/737] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:41.244076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af593f6-7713-4f9f-b4a6-04457848a569 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:41.265417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:41.266448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:41.310519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b953fa4-1d74-49cd-8f1e-d5ebeab6857f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:41.363472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039691de-38bf-45be-a090-1b641e8b8443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:41.364120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039691de-38bf-45be-a090-1b641e8b8443 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:41.364399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039691de-38bf-45be-a090-1b641e8b8443 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:41.364674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039691de-38bf-45be-a090-1b641e8b8443 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:41.366149 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039691de-38bf-45be-a090-1b641e8b8443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:41.366467 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039691de-38bf-45be-a090-1b641e8b8443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:41.367850 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039691de-38bf-45be-a090-1b641e8b8443 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:41.381565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 379/738] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:41.382939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190176c-44f2-41a7-b49c-ed36b23fb470 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:41.383165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190176c-44f2-41a7-b49c-ed36b23fb470 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:41.383443 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190176c-44f2-41a7-b49c-ed36b23fb470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:41.384090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af593f6-7713-4f9f-b4a6-04457848a569 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:41.403264 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-d190176c-44f2-41a7-b49c-ed36b23fb470 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:41.404472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d190176c-44f2-41a7-b49c-ed36b23fb470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:41.424968 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd6b46-7962-475e-8776-b102319bec1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:41.425647 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd6b46-7962-475e-8776-b102319bec1d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:41.425911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd6b46-7962-475e-8776-b102319bec1d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:41.426187 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd6b46-7962-475e-8776-b102319bec1d None admin] PATH_INFO: `/v3/users/nova` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:41.437903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd6b46-7962-475e-8776-b102319bec1d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:41.439525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd6b46-7962-475e-8776-b102319bec1d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-c2dd6b46-7962-475e-8776-b102319bec1d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:41.453390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:41.454411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:41.455802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:41.455802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:41.455802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:41.455802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:41.455802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:41.455802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:41.455802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:41.455802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:41.455802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:39:41.455802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:41.455802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 360/739] 10.222.0.76 () {56 vars in 1093 bytes} [Fri Aug 26 08:39:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:41.455802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd6b46-7962-475e-8776-b102319bec1d None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:41.502102 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 380/740] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:41.504468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190176c-44f2-41a7-b49c-ed36b23fb470 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:41.565347 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:41.609921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:41.633957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd6b46-7962-475e-8776-b102319bec1d None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:41.692240 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190176c-44f2-41a7-b49c-ed36b23fb470 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:41.696203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead2d96-8e81-4e5f-afff-5ed8b097d469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:41.696834 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead2d96-8e81-4e5f-afff-5ed8b097d469 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:41.697142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead2d96-8e81-4e5f-afff-5ed8b097d469 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:41.697420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead2d96-8e81-4e5f-afff-5ed8b097d469 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:41.714515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead2d96-8e81-4e5f-afff-5ed8b097d469 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:41.716012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead2d96-8e81-4e5f-afff-5ed8b097d469 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-1ead2d96-8e81-4e5f-afff-5ed8b097d469 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:41.736970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:41.737991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:41.738969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:41.738969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:41.738969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:41.738969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:41.738969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:41.738969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:41.738969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:41.738969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:41.738969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 08:39:41.738969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:41.739860 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 361/741] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:39:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:41.744908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead2d96-8e81-4e5f-afff-5ed8b097d469 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:41.758970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6e13a-e004-48f3-a8f0-aabb3020354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:41.759601 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6e13a-e004-48f3-a8f0-aabb3020354c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:41.759889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6e13a-e004-48f3-a8f0-aabb3020354c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:41.760167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6e13a-e004-48f3-a8f0-aabb3020354c None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:41.760912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6e13a-e004-48f3-a8f0-aabb3020354c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:41.761262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6e13a-e004-48f3-a8f0-aabb3020354c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:41.766452 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6e13a-e004-48f3-a8f0-aabb3020354c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:41.801919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 381/742] 10.222.0.76 () {56 vars in 1133 bytes} [Fri Aug 26 08:39:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:41.803079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6e13a-e004-48f3-a8f0-aabb3020354c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:41.885781 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead2d96-8e81-4e5f-afff-5ed8b097d469 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:41.921752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:41.930480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6e13a-e004-48f3-a8f0-aabb3020354c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:41.932593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560629d-5bb7-44bd-932f-f1a6a68de7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:41.934719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560629d-5bb7-44bd-932f-f1a6a68de7ec None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:41.935131 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560629d-5bb7-44bd-932f-f1a6a68de7ec None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:41.935483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560629d-5bb7-44bd-932f-f1a6a68de7ec None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:41.936293 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560629d-5bb7-44bd-932f-f1a6a68de7ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:41.936671 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560629d-5bb7-44bd-932f-f1a6a68de7ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:41.938210 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560629d-5bb7-44bd-932f-f1a6a68de7ec None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:41.957476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:41.965961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 362/743] 10.222.0.76 () {56 vars in 1135 bytes} [Fri Aug 26 08:39:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:41.966964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560629d-5bb7-44bd-932f-f1a6a68de7ec None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:41.973552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd9e2e-3bcf-4dc4-9b2e-4f2aef399b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:41.974412 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd9e2e-3bcf-4dc4-9b2e-4f2aef399b23 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:41.974872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd9e2e-3bcf-4dc4-9b2e-4f2aef399b23 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:41.975347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd9e2e-3bcf-4dc4-9b2e-4f2aef399b23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:41.989038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd9e2e-3bcf-4dc4-9b2e-4f2aef399b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-05fd9e2e-3bcf-4dc4-9b2e-4f2aef399b23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:41.995689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:41.997554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:41.998634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:41.998634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:41.998634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:41.998634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:41.998634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:41.998634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:41.998634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:41.998634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:41.998634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:41.998634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:41.998634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:41.998634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:42.006290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 382/744] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:42.007587 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd9e2e-3bcf-4dc4-9b2e-4f2aef399b23 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:42.101856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560629d-5bb7-44bd-932f-f1a6a68de7ec None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:42.109943 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd9e2e-3bcf-4dc4-9b2e-4f2aef399b23 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:42.144692 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9515d76-3762-4f9a-b8e2-18cf0c344c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:42.145385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9515d76-3762-4f9a-b8e2-18cf0c344c92 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:42.145701 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9515d76-3762-4f9a-b8e2-18cf0c344c92 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:42.146051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9515d76-3762-4f9a-b8e2-18cf0c344c92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:42.146656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd258b-5ad3-4990-aa45-fe5e5eb149ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:42.147474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd258b-5ad3-4990-aa45-fe5e5eb149ce None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:42.147949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd258b-5ad3-4990-aa45-fe5e5eb149ce None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:42.148395 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd258b-5ad3-4990-aa45-fe5e5eb149ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:42.161247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd258b-5ad3-4990-aa45-fe5e5eb149ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:42.163472 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd258b-5ad3-4990-aa45-fe5e5eb149ce None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-04dd258b-5ad3-4990-aa45-fe5e5eb149ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:42.183185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:42.184716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:42.185750 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:42.185750 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:42.185750 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:42.188171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 363/745] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:42.189181 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd258b-5ad3-4990-aa45-fe5e5eb149ce None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:42.209597 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:42.224631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9515d76-3762-4f9a-b8e2-18cf0c344c92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:42.226329 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9515d76-3762-4f9a-b8e2-18cf0c344c92 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:42.242141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:42.312359 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd258b-5ad3-4990-aa45-fe5e5eb149ce None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:42.352889 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944b626-2de6-4e52-861f-dc86c06d9fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:42.353620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944b626-2de6-4e52-861f-dc86c06d9fa5 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:42.353910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944b626-2de6-4e52-861f-dc86c06d9fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:42.354255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944b626-2de6-4e52-861f-dc86c06d9fa5 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:42.354926 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944b626-2de6-4e52-861f-dc86c06d9fa5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:42.355284 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944b626-2de6-4e52-861f-dc86c06d9fa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:42.357380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944b626-2de6-4e52-861f-dc86c06d9fa5 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:42.365112 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 383/746] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:39:42.366240 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9515d76-3762-4f9a-b8e2-18cf0c344c92 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:42.370788 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 364/747] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:42.371829 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944b626-2de6-4e52-861f-dc86c06d9fa5 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:42.459502 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:42.489761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:42.494151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944b626-2de6-4e52-861f-dc86c06d9fa5 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:42.506148 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9515d76-3762-4f9a-b8e2-18cf0c344c92 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:42.532894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423a0e7-214b-4bea-a9ae-44782708c1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:42.533756 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423a0e7-214b-4bea-a9ae-44782708c1c1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:42.534527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423a0e7-214b-4bea-a9ae-44782708c1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:42.534527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423a0e7-214b-4bea-a9ae-44782708c1c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:42.547066 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423a0e7-214b-4bea-a9ae-44782708c1c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:42.548647 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423a0e7-214b-4bea-a9ae-44782708c1c1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:42.552309 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e7479-b430-472c-b96a-ced45f3f5a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:42.553113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e7479-b430-472c-b96a-ced45f3f5a65 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:42.553567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e7479-b430-472c-b96a-ced45f3f5a65 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:42.553993 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e7479-b430-472c-b96a-ced45f3f5a65 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:42.554839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e7479-b430-472c-b96a-ced45f3f5a65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:42.555288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e7479-b430-472c-b96a-ced45f3f5a65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:42.557351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e7479-b430-472c-b96a-ced45f3f5a65 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-1423a0e7-214b-4bea-a9ae-44782708c1c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:42.564525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:42.565677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:42.566792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:42.566792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:42.566792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:42.577483 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 384/748] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:42.578829 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 365/749] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:42.579279 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e7479-b430-472c-b96a-ced45f3f5a65 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:42.579721 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423a0e7-214b-4bea-a9ae-44782708c1c1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:42.703686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423a0e7-214b-4bea-a9ae-44782708c1c1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:42.710427 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e7479-b430-472c-b96a-ced45f3f5a65 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:42.744677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:42.748935 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc15d94-db02-4fac-8ed7-ff480fb4d5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:42.749856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc15d94-db02-4fac-8ed7-ff480fb4d5cf None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:42.750232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc15d94-db02-4fac-8ed7-ff480fb4d5cf None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:42.750615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc15d94-db02-4fac-8ed7-ff480fb4d5cf None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:42.751362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc15d94-db02-4fac-8ed7-ff480fb4d5cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:42.751760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b43428-54cc-4a6a-82b1-6e6fb1fab3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:42.751889 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc15d94-db02-4fac-8ed7-ff480fb4d5cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:42.752641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b43428-54cc-4a6a-82b1-6e6fb1fab3f2 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:42.753097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b43428-54cc-4a6a-82b1-6e6fb1fab3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:42.753511 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b43428-54cc-4a6a-82b1-6e6fb1fab3f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:42.753645 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc15d94-db02-4fac-8ed7-ff480fb4d5cf None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:42.767579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b43428-54cc-4a6a-82b1-6e6fb1fab3f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:42.769249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b43428-54cc-4a6a-82b1-6e6fb1fab3f2 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:42.772363 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 366/750] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:42.773354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc15d94-db02-4fac-8ed7-ff480fb4d5cf None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-d0b43428-54cc-4a6a-82b1-6e6fb1fab3f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:42.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:42.788081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:42.789030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:42.789030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:42.789030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:42.789030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 385/751] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:42.789030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b43428-54cc-4a6a-82b1-6e6fb1fab3f2 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:42.793684 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:42.888614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc15d94-db02-4fac-8ed7-ff480fb4d5cf None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:42.910675 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b43428-54cc-4a6a-82b1-6e6fb1fab3f2 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:42.924154 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1c496-6c00-4ffc-91b3-1594e3708a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:42.924784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1c496-6c00-4ffc-91b3-1594e3708a18 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:42.925110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1c496-6c00-4ffc-91b3-1594e3708a18 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:42.925387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1c496-6c00-4ffc-91b3-1594e3708a18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:42.932383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1c496-6c00-4ffc-91b3-1594e3708a18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:42.933875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1c496-6c00-4ffc-91b3-1594e3708a18 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:42.944644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108b9a5-c865-46bd-806b-8b92477462b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:42.944902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-62e1c496-6c00-4ffc-91b3-1594e3708a18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:42.944902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:42.944902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:42.944902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:42.944902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:42.944902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:42.944902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:42.944902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:42.944902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:42.944902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:42.944902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:42.944902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:42.944902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:42.944902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:42.944902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:42.945787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:42.946692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:42.946692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:42.946692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:42.946692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:42.946692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:42.946692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:42.946692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:42.946692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:42.947131 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108b9a5-c865-46bd-806b-8b92477462b0 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:42.947131 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108b9a5-c865-46bd-806b-8b92477462b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:42.947131 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108b9a5-c865-46bd-806b-8b92477462b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:42.947311 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 367/752] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:42.947311 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1c496-6c00-4ffc-91b3-1594e3708a18 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:42.958189 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108b9a5-c865-46bd-806b-8b92477462b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:42.960304 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108b9a5-c865-46bd-806b-8b92477462b0 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:42.972919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-d108b9a5-c865-46bd-806b-8b92477462b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:42.972919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:42.972919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:42.972919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:42.972919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:42.972919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:42.972919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:42.972919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:42.972919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:42.972919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:42.972919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:42.972919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:42.972919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:42.972919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:42.972919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:42.973927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:42.974838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:42.974838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:42.974838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:42.974838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:42.974838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:42.974838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:42.974838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:42.974838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:42.974838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 386/753] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:42.976044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7531eb2-7b81-48b0-b2d6-b1c290341e3f None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:42.976044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7531eb2-7b81-48b0-b2d6-b1c290341e3f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:42.976044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7531eb2-7b81-48b0-b2d6-b1c290341e3f None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:42.981422 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 387/754] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:42.981422 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7531eb2-7b81-48b0-b2d6-b1c290341e3f None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:43.028338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:43.031130 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:43.062566 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1c496-6c00-4ffc-91b3-1594e3708a18 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:43.090908 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7531eb2-7b81-48b0-b2d6-b1c290341e3f None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:43.099899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862a182-13d7-4bda-9af1-337772a1a229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:43.100518 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862a182-13d7-4bda-9af1-337772a1a229 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:43.100805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862a182-13d7-4bda-9af1-337772a1a229 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:43.101427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862a182-13d7-4bda-9af1-337772a1a229 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:43.102078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862a182-13d7-4bda-9af1-337772a1a229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:43.102450 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862a182-13d7-4bda-9af1-337772a1a229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:43.103822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862a182-13d7-4bda-9af1-337772a1a229 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:43.120411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 368/755] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:43.121720 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862a182-13d7-4bda-9af1-337772a1a229 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:43.124958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57035d18-ff23-4fbf-8178-f097fd007bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:43.125584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57035d18-ff23-4fbf-8178-f097fd007bae None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:43.125864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57035d18-ff23-4fbf-8178-f097fd007bae None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:43.126133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57035d18-ff23-4fbf-8178-f097fd007bae None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:43.126818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57035d18-ff23-4fbf-8178-f097fd007bae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:43.127119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57035d18-ff23-4fbf-8178-f097fd007bae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:43.128542 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57035d18-ff23-4fbf-8178-f097fd007bae None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:43.142072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 388/756] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:43.143280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b103a-686f-4118-8a09-cc3098cad390 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:43.143565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b103a-686f-4118-8a09-cc3098cad390 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:43.143835 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b103a-686f-4118-8a09-cc3098cad390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:43.161260 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-922b103a-686f-4118-8a09-cc3098cad390 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:43.162461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-922b103a-686f-4118-8a09-cc3098cad390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:43.231156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862a182-13d7-4bda-9af1-337772a1a229 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:43.233487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 389/757] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:43.234257 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b103a-686f-4118-8a09-cc3098cad390 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:43.269282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:43.285844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:43.292923 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27910857-0402-4b89-8e7a-9f3d78f06428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:43.294340 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27910857-0402-4b89-8e7a-9f3d78f06428 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:43.294826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27910857-0402-4b89-8e7a-9f3d78f06428 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:43.295591 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27910857-0402-4b89-8e7a-9f3d78f06428 None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:43.296741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27910857-0402-4b89-8e7a-9f3d78f06428 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:43.297291 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27910857-0402-4b89-8e7a-9f3d78f06428 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:43.299521 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27910857-0402-4b89-8e7a-9f3d78f06428 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:43.317278 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 369/758] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:43.318073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27910857-0402-4b89-8e7a-9f3d78f06428 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:43.354893 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b103a-686f-4118-8a09-cc3098cad390 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:43.390103 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bef26-fb39-4210-a85b-bd948ab077aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:43.390729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bef26-fb39-4210-a85b-bd948ab077aa None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:43.391011 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bef26-fb39-4210-a85b-bd948ab077aa None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:43.391284 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bef26-fb39-4210-a85b-bd948ab077aa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:43.398307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bef26-fb39-4210-a85b-bd948ab077aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:43.399734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bef26-fb39-4210-a85b-bd948ab077aa None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-d16bef26-fb39-4210-a85b-bd948ab077aa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:43.411349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:43.412474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:43.413474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:43.413474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:43.413474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:43.413474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:43.413474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:43.413474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:43.413474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:43.413474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:43.413474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 08:39:43.413474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:43.413474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 390/759] 10.222.0.76 () {56 vars in 1117 bytes} [Fri Aug 26 08:39:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:43.414076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b39df-29cc-4705-a982-a22daa5338c4 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:43.414259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b39df-29cc-4705-a982-a22daa5338c4 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:43.414533 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b39df-29cc-4705-a982-a22daa5338c4 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:43.415876 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 391/760] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:43.417733 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b39df-29cc-4705-a982-a22daa5338c4 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:43.432109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27910857-0402-4b89-8e7a-9f3d78f06428 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:43.466330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48861ec4-a595-4af8-aa51-4e59bcd97509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:43.466974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48861ec4-a595-4af8-aa51-4e59bcd97509 None admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:43.467253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48861ec4-a595-4af8-aa51-4e59bcd97509 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:43.467527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48861ec4-a595-4af8-aa51-4e59bcd97509 None admin] PATH_INFO: `/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/b63d6e588f6e4b598b75a2ec13bea25d/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:43.469432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48861ec4-a595-4af8-aa51-4e59bcd97509 None admin] RBAC: Authorizing `identity:create_grant(project_id=35aafba89a1d47cd86cef1eb0a11e507, user_id=b63d6e588f6e4b598b75a2ec13bea25d, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:43.470845 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48861ec4-a595-4af8-aa51-4e59bcd97509 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:43.485873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 370/761] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:39:43 2022] PUT /identity/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/b63d6e588f6e4b598b75a2ec13bea25d/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:39:43.487012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48861ec4-a595-4af8-aa51-4e59bcd97509 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:43.526667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:43.535433 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b39df-29cc-4705-a982-a22daa5338c4 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:43.561344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:43.577037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e464efc-3e8f-4e49-83b7-a8c4463fad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:43.577662 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e464efc-3e8f-4e49-83b7-a8c4463fad82 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:43.577943 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e464efc-3e8f-4e49-83b7-a8c4463fad82 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:43.578216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e464efc-3e8f-4e49-83b7-a8c4463fad82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:43.579353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e464efc-3e8f-4e49-83b7-a8c4463fad82 None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=f544d78f417844f68f3bd37863d24885) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:43.579353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e464efc-3e8f-4e49-83b7-a8c4463fad82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:43.580695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e464efc-3e8f-4e49-83b7-a8c4463fad82 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:43.593163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 392/762] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:43 2022] GET /identity/v3/role_assignments?user.id=f544d78f417844f68f3bd37863d24885&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:43.593163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde25070-0b40-406c-81ad-8b4243e88528 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:43.593163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde25070-0b40-406c-81ad-8b4243e88528 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:43.593163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde25070-0b40-406c-81ad-8b4243e88528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:43.630003 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-bde25070-0b40-406c-81ad-8b4243e88528 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:43.631267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-bde25070-0b40-406c-81ad-8b4243e88528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:43.646514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48861ec4-a595-4af8-aa51-4e59bcd97509 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:43.702838 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dafc2-0286-4c19-8772-1e641b0a682f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:43.703959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dafc2-0286-4c19-8772-1e641b0a682f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:43.704248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dafc2-0286-4c19-8772-1e641b0a682f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:43.704532 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dafc2-0286-4c19-8772-1e641b0a682f None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:43.705406 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dafc2-0286-4c19-8772-1e641b0a682f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:43.705724 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dafc2-0286-4c19-8772-1e641b0a682f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:43.707910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dafc2-0286-4c19-8772-1e641b0a682f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:43.723012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 393/763] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:43.724033 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde25070-0b40-406c-81ad-8b4243e88528 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:43.735149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 371/764] 10.222.0.76 () {56 vars in 1149 bytes} [Fri Aug 26 08:39:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:43.740776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dafc2-0286-4c19-8772-1e641b0a682f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:43.837396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:43.852004 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde25070-0b40-406c-81ad-8b4243e88528 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:43.890951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dafc2-0286-4c19-8772-1e641b0a682f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:43.898654 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16227246-f445-4e7a-80f4-0e536d1ef8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:43.899299 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16227246-f445-4e7a-80f4-0e536d1ef8aa None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:43.899584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16227246-f445-4e7a-80f4-0e536d1ef8aa None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:43.901937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16227246-f445-4e7a-80f4-0e536d1ef8aa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:43.905326 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16227246-f445-4e7a-80f4-0e536d1ef8aa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:43.907218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16227246-f445-4e7a-80f4-0e536d1ef8aa None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:43.914433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-16227246-f445-4e7a-80f4-0e536d1ef8aa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:43.924619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:43.925710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:43.926559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:43.926559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:43.926559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:43.926559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:43.926559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:43.926559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:43.926559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:43.926559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:43.926559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:43.926559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:43.926559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:39:43.926559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:43.926559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 08:39:43.926559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:43.932595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 394/765] 10.222.0.76 () {56 vars in 1129 bytes} [Fri Aug 26 08:39:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:43.933536 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16227246-f445-4e7a-80f4-0e536d1ef8aa None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:43.961014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab84345-ae88-4a6c-a866-483bb4f8e969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:43.961622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab84345-ae88-4a6c-a866-483bb4f8e969 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:43.961899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab84345-ae88-4a6c-a866-483bb4f8e969 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:43.962169 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab84345-ae88-4a6c-a866-483bb4f8e969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:44.052927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab84345-ae88-4a6c-a866-483bb4f8e969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:44.054556 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab84345-ae88-4a6c-a866-483bb4f8e969 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:44.122775 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16227246-f445-4e7a-80f4-0e536d1ef8aa None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:44.159174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd5df4-7b45-4294-acf0-0d56a24a28c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:44.159788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd5df4-7b45-4294-acf0-0d56a24a28c8 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:44.160070 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd5df4-7b45-4294-acf0-0d56a24a28c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:44.160350 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd5df4-7b45-4294-acf0-0d56a24a28c8 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:44.160965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd5df4-7b45-4294-acf0-0d56a24a28c8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:44.161303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd5df4-7b45-4294-acf0-0d56a24a28c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:44.162655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd5df4-7b45-4294-acf0-0d56a24a28c8 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:44.167550 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 395/766] 10.222.0.76 () {56 vars in 1124 bytes} [Fri Aug 26 08:39:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:44.168470 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd5df4-7b45-4294-acf0-0d56a24a28c8 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:44.187539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:44.189053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 372/767] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 08:39:44.190034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab84345-ae88-4a6c-a866-483bb4f8e969 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:44.205616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:44.299607 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd5df4-7b45-4294-acf0-0d56a24a28c8 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:44.310488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab84345-ae88-4a6c-a866-483bb4f8e969 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:44.349343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3d0e4-6239-4376-83a9-69718df002d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:44.349979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3d0e4-6239-4376-83a9-69718df002d3 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:44.350357 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3d0e4-6239-4376-83a9-69718df002d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:44.350620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3c942-3df1-4f4c-b053-3d82e02e9648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:44.350744 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3d0e4-6239-4376-83a9-69718df002d3 None admin] PATH_INFO: `/v3/services/network` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:44.351202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3d0e4-6239-4376-83a9-69718df002d3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:44.351615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3c942-3df1-4f4c-b053-3d82e02e9648 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:44.352028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3c942-3df1-4f4c-b053-3d82e02e9648 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:44.352444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3c942-3df1-4f4c-b053-3d82e02e9648 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:44.352552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3d0e4-6239-4376-83a9-69718df002d3 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:44.353509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3c942-3df1-4f4c-b053-3d82e02e9648 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:44.353967 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3c942-3df1-4f4c-b053-3d82e02e9648 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:44.356159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3c942-3df1-4f4c-b053-3d82e02e9648 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-46b3d0e4-6239-4376-83a9-69718df002d3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:44.361629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:44.362795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:44.363809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:44.363809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:44.363809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:44.363809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:44.363809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:44.363809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:44.363809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:44.363809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:44.363809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:44.363809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:44.363809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:39:44.363809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:44.363809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 08:39:44.363809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:44.365772 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 373/768] 10.222.0.76 () {56 vars in 1124 bytes} [Fri Aug 26 08:39:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:44.366696 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3c942-3df1-4f4c-b053-3d82e02e9648 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:44.367829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 396/769] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:44 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:44.368661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3d0e4-6239-4376-83a9-69718df002d3 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:44.458669 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:44.462133 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:44.483505 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3d0e4-6239-4376-83a9-69718df002d3 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:44.496581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3c942-3df1-4f4c-b053-3d82e02e9648 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:44.523442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c18843-800a-4093-b0b7-f6e8a4704f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:44.524306 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c18843-800a-4093-b0b7-f6e8a4704f97 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:44.524901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c18843-800a-4093-b0b7-f6e8a4704f97 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:44.525405 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c18843-800a-4093-b0b7-f6e8a4704f97 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:44.526297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c18843-800a-4093-b0b7-f6e8a4704f97 None admin] RBAC: Adding query filter params (name=network) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:44.526786 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c18843-800a-4093-b0b7-f6e8a4704f97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:44.529063 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c18843-800a-4093-b0b7-f6e8a4704f97 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:44.534319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 397/770] 10.222.0.76 () {56 vars in 1112 bytes} [Fri Aug 26 08:39:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:44.535370 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c18843-800a-4093-b0b7-f6e8a4704f97 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:44.537495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c1c55-fbb3-407f-84b5-2b725f61623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:44.538186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c1c55-fbb3-407f-84b5-2b725f61623b None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:44.538751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c1c55-fbb3-407f-84b5-2b725f61623b None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:44.539361 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c1c55-fbb3-407f-84b5-2b725f61623b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:44.553549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c1c55-fbb3-407f-84b5-2b725f61623b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:44.554990 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c1c55-fbb3-407f-84b5-2b725f61623b None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-450c1c55-fbb3-407f-84b5-2b725f61623b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:44.573021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:44.575326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:44.577439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:44.577439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:44.577439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:44.577439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 374/771] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:44.577439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c1c55-fbb3-407f-84b5-2b725f61623b None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:44.682962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c18843-800a-4093-b0b7-f6e8a4704f97 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:44.697504 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c1c55-fbb3-407f-84b5-2b725f61623b None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:44.722658 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74c6ec-f2a6-4256-b524-22f4da3efa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:44.723341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74c6ec-f2a6-4256-b524-22f4da3efa2a None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:44.723555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74c6ec-f2a6-4256-b524-22f4da3efa2a None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:44.723835 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74c6ec-f2a6-4256-b524-22f4da3efa2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:44.724549 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74c6ec-f2a6-4256-b524-22f4da3efa2a None admin] RBAC: Adding query filter params (interface=public, service_id=a557547314a34ceb87f915232e9535b2, region_id=RegionOne) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:44.724863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74c6ec-f2a6-4256-b524-22f4da3efa2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:44.726310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74c6ec-f2a6-4256-b524-22f4da3efa2a None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:44.735415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 398/772] 10.222.0.76 () {56 vars in 1251 bytes} [Fri Aug 26 08:39:44 2022] GET /identity/v3/endpoints?service_id=a557547314a34ceb87f915232e9535b2&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:44.736191 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:44.736392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74c6ec-f2a6-4256-b524-22f4da3efa2a None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:44.748638 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6189e6-38d0-4965-81b6-cdb36ec8ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:44.749296 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:44.750858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6189e6-38d0-4965-81b6-cdb36ec8ea6c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:44.751488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6189e6-38d0-4965-81b6-cdb36ec8ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:44.752069 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6189e6-38d0-4965-81b6-cdb36ec8ea6c None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:44.753895 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6189e6-38d0-4965-81b6-cdb36ec8ea6c None admin] RBAC: Adding query filter params (type=network) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:44.754407 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6189e6-38d0-4965-81b6-cdb36ec8ea6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:44.756220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6189e6-38d0-4965-81b6-cdb36ec8ea6c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:44.762827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 375/773] 10.222.0.76 () {56 vars in 1112 bytes} [Fri Aug 26 08:39:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:44.763914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6189e6-38d0-4965-81b6-cdb36ec8ea6c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:44.850124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74c6ec-f2a6-4256-b524-22f4da3efa2a None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:44.877048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6189e6-38d0-4965-81b6-cdb36ec8ea6c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:44.885172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ece78-2be1-4edc-9c68-ff1b29dad899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:44.885781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ece78-2be1-4edc-9c68-ff1b29dad899 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:44.886065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ece78-2be1-4edc-9c68-ff1b29dad899 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:44.886343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ece78-2be1-4edc-9c68-ff1b29dad899 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:44.887012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ece78-2be1-4edc-9c68-ff1b29dad899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:44.887319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ece78-2be1-4edc-9c68-ff1b29dad899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:44.888749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ece78-2be1-4edc-9c68-ff1b29dad899 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:44.905298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 399/774] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:44.906157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ece78-2be1-4edc-9c68-ff1b29dad899 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:44.915559 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf88d07-5512-4b26-a2f8-3e4cdbc8925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:44.916514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf88d07-5512-4b26-a2f8-3e4cdbc8925b None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:44.917026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf88d07-5512-4b26-a2f8-3e4cdbc8925b None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:44.917531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf88d07-5512-4b26-a2f8-3e4cdbc8925b None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:44.918918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf88d07-5512-4b26-a2f8-3e4cdbc8925b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:44.920474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf88d07-5512-4b26-a2f8-3e4cdbc8925b None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:44.926862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 376/775] 10.222.0.76 () {56 vars in 1087 bytes} [Fri Aug 26 08:39:44 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:44.928023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf88d07-5512-4b26-a2f8-3e4cdbc8925b None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:44.979280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:44.997655 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:45.018033 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ece78-2be1-4edc-9c68-ff1b29dad899 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:45.052313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf88d07-5512-4b26-a2f8-3e4cdbc8925b None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:45.056463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91383846-e3eb-4b4c-835c-b2a77dc62130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:45.057119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91383846-e3eb-4b4c-835c-b2a77dc62130 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:45.057456 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91383846-e3eb-4b4c-835c-b2a77dc62130 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:45.057739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91383846-e3eb-4b4c-835c-b2a77dc62130 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:45.058450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91383846-e3eb-4b4c-835c-b2a77dc62130 None admin] RBAC: Adding query filter params (interface=public, service_id=574d27833b5043e789148dd83e4435c7, region_id=RegionOne) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:45.059326 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91383846-e3eb-4b4c-835c-b2a77dc62130 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:45.061080 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91383846-e3eb-4b4c-835c-b2a77dc62130 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:45.067221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 400/776] 10.222.0.76 () {56 vars in 1251 bytes} [Fri Aug 26 08:39:44 2022] GET /identity/v3/endpoints?service_id=574d27833b5043e789148dd83e4435c7&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:45.074054 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91383846-e3eb-4b4c-835c-b2a77dc62130 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:45.095733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66893dfd-e19b-4648-81c0-ec8fcff803f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:45.096881 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66893dfd-e19b-4648-81c0-ec8fcff803f1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:45.097401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66893dfd-e19b-4648-81c0-ec8fcff803f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:45.097928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66893dfd-e19b-4648-81c0-ec8fcff803f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:45.106092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66893dfd-e19b-4648-81c0-ec8fcff803f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:45.108039 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66893dfd-e19b-4648-81c0-ec8fcff803f1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:45.120924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-66893dfd-e19b-4648-81c0-ec8fcff803f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:45.120924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:45.120924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:45.120924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:45.120924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:45.120924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:45.120924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:45.120924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:45.120924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:45.120924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:45.120924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:45.120924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:45.120924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:45.120924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:45.120924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:45.121941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:45.122841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:45.122841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:45.122841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:45.122841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:45.122841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:45.122841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:45.122841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:45.122841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:45.125741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 377/777] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:45.132513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66893dfd-e19b-4648-81c0-ec8fcff803f1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:45.212360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91383846-e3eb-4b4c-835c-b2a77dc62130 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:45.243817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:45.250530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5e64b-24b3-4dbe-aecf-793d1041b646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:45.251142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e64b-24b3-4dbe-aecf-793d1041b646 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:45.251521 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e64b-24b3-4dbe-aecf-793d1041b646 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:45.251801 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e64b-24b3-4dbe-aecf-793d1041b646 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:45.252505 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5e64b-24b3-4dbe-aecf-793d1041b646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:45.253921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5e64b-24b3-4dbe-aecf-793d1041b646 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:45.259813 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 401/778] 10.222.0.76 () {56 vars in 1087 bytes} [Fri Aug 26 08:39:45 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:45.270247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66893dfd-e19b-4648-81c0-ec8fcff803f1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:45.287210 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:45.312825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb8a44-4ca0-4c5e-8d67-00f5dd019890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:45.313493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb8a44-4ca0-4c5e-8d67-00f5dd019890 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:45.313777 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb8a44-4ca0-4c5e-8d67-00f5dd019890 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:45.314054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb8a44-4ca0-4c5e-8d67-00f5dd019890 None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:45.314760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb8a44-4ca0-4c5e-8d67-00f5dd019890 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:45.315068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb8a44-4ca0-4c5e-8d67-00f5dd019890 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:45.316552 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb8a44-4ca0-4c5e-8d67-00f5dd019890 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:45.331922 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 378/779] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:45.337983 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5e64b-24b3-4dbe-aecf-793d1041b646 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:45.458038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5e64b-24b3-4dbe-aecf-793d1041b646 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:45.496647 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888dfe9-8ec8-4649-ad26-4e557f778690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:45.497373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888dfe9-8ec8-4649-ad26-4e557f778690 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:45.497666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888dfe9-8ec8-4649-ad26-4e557f778690 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:45.497944 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888dfe9-8ec8-4649-ad26-4e557f778690 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:45.498677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888dfe9-8ec8-4649-ad26-4e557f778690 None admin] RBAC: Adding query filter params (role.id=7aef270090c546a0aff3f62f1fcf517a, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=c50a6fa776a849cfbb0173ce24616906) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:45.498988 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888dfe9-8ec8-4649-ad26-4e557f778690 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:45.500490 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888dfe9-8ec8-4649-ad26-4e557f778690 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:45.506734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 402/780] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:45 2022] GET /identity/v3/role_assignments?user.id=c50a6fa776a849cfbb0173ce24616906&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=7aef270090c546a0aff3f62f1fcf517a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:45.650392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b2c7b-c32a-4df5-83c9-bb04ebe7667c None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:45.650950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b2c7b-c32a-4df5-83c9-bb04ebe7667c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:45.651187 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b2c7b-c32a-4df5-83c9-bb04ebe7667c None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:45.653328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 379/781] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:45.661031 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9f1c6-50f8-4800-800a-b5a5a6fd653c None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:45.661031 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9f1c6-50f8-4800-800a-b5a5a6fd653c None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:45.661031 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9f1c6-50f8-4800-800a-b5a5a6fd653c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:45.680280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-6bc9f1c6-50f8-4800-800a-b5a5a6fd653c None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:45.681818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6bc9f1c6-50f8-4800-800a-b5a5a6fd653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:45.722234 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1daa3-d731-4335-b387-e5ad46cbc22c None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:45.722479 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1daa3-d731-4335-b387-e5ad46cbc22c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:45.722714 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1daa3-d731-4335-b387-e5ad46cbc22c None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:45.724289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 380/782] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:45.729284 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f18f10-63c0-4e19-a46e-68ef45309fb6 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:45.729575 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f18f10-63c0-4e19-a46e-68ef45309fb6 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:45.729850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f18f10-63c0-4e19-a46e-68ef45309fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:45.743702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:45.751011 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-24f18f10-63c0-4e19-a46e-68ef45309fb6 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:45.752219 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-24f18f10-63c0-4e19-a46e-68ef45309fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:45.764608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 403/783] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:45.853468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 381/784] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:39:46.154467 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9f1c6-50f8-4800-800a-b5a5a6fd653c None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:46.250047 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f18f10-63c0-4e19-a46e-68ef45309fb6 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:46.275751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9f1c6-50f8-4800-800a-b5a5a6fd653c None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:46.311666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fd15d-ff20-4bc8-b49b-819b65f83861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:46.312649 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fd15d-ff20-4bc8-b49b-819b65f83861 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:46.313160 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fd15d-ff20-4bc8-b49b-819b65f83861 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:46.313653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fd15d-ff20-4bc8-b49b-819b65f83861 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:46.324682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fd15d-ff20-4bc8-b49b-819b65f83861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-2a5fd15d-ff20-4bc8-b49b-819b65f83861 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:46.329702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:46.330631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:46.331461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:46.331461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:46.331461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:46.331461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:46.331461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:46.331461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:46.331461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:46.331461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:46.331461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:46.331461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:46.331461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:46.331461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:46.334187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 404/785] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:39:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:46.340564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fd15d-ff20-4bc8-b49b-819b65f83861 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:46.398446 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:46.481112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f18f10-63c0-4e19-a46e-68ef45309fb6 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:46.481292 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fd15d-ff20-4bc8-b49b-819b65f83861 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:46.493015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:46.515346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a15b43-247c-4814-a00c-f95248faba67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:46.515954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a15b43-247c-4814-a00c-f95248faba67 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:46.516234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a15b43-247c-4814-a00c-f95248faba67 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:46.516509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a15b43-247c-4814-a00c-f95248faba67 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:46.517198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a15b43-247c-4814-a00c-f95248faba67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:46.517506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a15b43-247c-4814-a00c-f95248faba67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:46.518883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a15b43-247c-4814-a00c-f95248faba67 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:46.528283 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 405/786] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:46.535762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0812985-024f-4a26-b708-b2ae52d7481c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:46.536401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0812985-024f-4a26-b708-b2ae52d7481c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:46.536686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0812985-024f-4a26-b708-b2ae52d7481c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:46.536962 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0812985-024f-4a26-b708-b2ae52d7481c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:46.540061 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a15b43-247c-4814-a00c-f95248faba67 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:46.569299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0812985-024f-4a26-b708-b2ae52d7481c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-c0812985-024f-4a26-b708-b2ae52d7481c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:46.574062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:46.575539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:46.576387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:46.576387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:46.576387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:46.576387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:46.576387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:46.576387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:46.576387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:46.576387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:46.576387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:46.576387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:46.576387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:46.576387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:46.576387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 382/787] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:39:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:46.584210 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0812985-024f-4a26-b708-b2ae52d7481c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:46.790735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a15b43-247c-4814-a00c-f95248faba67 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:46.804354 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:46.834445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574867c8-0468-4640-89a7-bcb6dd0a3099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:46.835071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574867c8-0468-4640-89a7-bcb6dd0a3099 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:46.835352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574867c8-0468-4640-89a7-bcb6dd0a3099 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:46.835627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574867c8-0468-4640-89a7-bcb6dd0a3099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:46.845780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0812985-024f-4a26-b708-b2ae52d7481c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:46.852254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574867c8-0468-4640-89a7-bcb6dd0a3099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:46.853760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574867c8-0468-4640-89a7-bcb6dd0a3099 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-574867c8-0468-4640-89a7-bcb6dd0a3099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:46.882262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:46.883277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:46.884203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:46.884203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:46.884203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:46.890878 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 406/788] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:46.897346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574867c8-0468-4640-89a7-bcb6dd0a3099 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:46.918303 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c62d33-9d70-456a-95e4-3dd513eb0410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:46.918915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c62d33-9d70-456a-95e4-3dd513eb0410 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:46.919256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c62d33-9d70-456a-95e4-3dd513eb0410 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:46.919536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c62d33-9d70-456a-95e4-3dd513eb0410 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:46.920205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c62d33-9d70-456a-95e4-3dd513eb0410 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:46.920510 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c62d33-9d70-456a-95e4-3dd513eb0410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:46.921899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c62d33-9d70-456a-95e4-3dd513eb0410 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:46.943976 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 383/789] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:46.944860 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c62d33-9d70-456a-95e4-3dd513eb0410 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:46.991441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:47.086356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574867c8-0468-4640-89a7-bcb6dd0a3099 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:47.119163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c62d33-9d70-456a-95e4-3dd513eb0410 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:47.138427 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0eec7-bed4-4350-8631-ac66c8e03043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:47.139045 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0eec7-bed4-4350-8631-ac66c8e03043 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:47.139327 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0eec7-bed4-4350-8631-ac66c8e03043 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:47.139600 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0eec7-bed4-4350-8631-ac66c8e03043 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:47.140240 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0eec7-bed4-4350-8631-ac66c8e03043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:47.140546 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0eec7-bed4-4350-8631-ac66c8e03043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:47.141941 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0eec7-bed4-4350-8631-ac66c8e03043 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:47.169408 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 407/790] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:47.175922 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0eec7-bed4-4350-8631-ac66c8e03043 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:47.179062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139953b-6c32-4e41-9d2c-d60412979ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:47.179712 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139953b-6c32-4e41-9d2c-d60412979ce1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:47.179996 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139953b-6c32-4e41-9d2c-d60412979ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:47.180273 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139953b-6c32-4e41-9d2c-d60412979ce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:47.192481 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139953b-6c32-4e41-9d2c-d60412979ce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:47.193983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139953b-6c32-4e41-9d2c-d60412979ce1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-b139953b-6c32-4e41-9d2c-d60412979ce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:47.209023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:47.210067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:47.210965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:47.210965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:47.210965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:47.210965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 384/791] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:47.216314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139953b-6c32-4e41-9d2c-d60412979ce1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:47.227972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:47.321599 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139953b-6c32-4e41-9d2c-d60412979ce1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:47.325309 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:47.358175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805c875-24ab-4065-b1c8-3eb213e3171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:47.358796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805c875-24ab-4065-b1c8-3eb213e3171c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:47.359088 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805c875-24ab-4065-b1c8-3eb213e3171c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:47.359365 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805c875-24ab-4065-b1c8-3eb213e3171c None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:47.360019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805c875-24ab-4065-b1c8-3eb213e3171c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:47.360325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805c875-24ab-4065-b1c8-3eb213e3171c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:47.361735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805c875-24ab-4065-b1c8-3eb213e3171c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:47.377423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 385/792] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:47.383519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805c875-24ab-4065-b1c8-3eb213e3171c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:47.417741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0eec7-bed4-4350-8631-ac66c8e03043 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:47.460547 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7e22f-ee8b-445f-b8dd-7610757c6873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:47.461355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7e22f-ee8b-445f-b8dd-7610757c6873 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:47.461640 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7e22f-ee8b-445f-b8dd-7610757c6873 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:47.462238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7e22f-ee8b-445f-b8dd-7610757c6873 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:47.474913 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7e22f-ee8b-445f-b8dd-7610757c6873 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:47.476565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7e22f-ee8b-445f-b8dd-7610757c6873 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-0cc7e22f-ee8b-445f-b8dd-7610757c6873 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:47.488487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:47.489468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:47.490424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:47.490424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:47.490424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:47.490424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:47.490424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:47.490424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:47.490424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:47.490424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:47.490424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:39:47.490424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:47.490424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 408/793] 10.222.0.76 () {56 vars in 1093 bytes} [Fri Aug 26 08:39:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:47.491506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cfbea-84a3-4c8e-a3d8-ffd896a6ad15 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:47.491506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cfbea-84a3-4c8e-a3d8-ffd896a6ad15 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:47.497065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cfbea-84a3-4c8e-a3d8-ffd896a6ad15 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:47.498213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 409/794] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:47.498865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cfbea-84a3-4c8e-a3d8-ffd896a6ad15 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:47.513245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805c875-24ab-4065-b1c8-3eb213e3171c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:47.548581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa280b62-2fcb-4ffc-8de9-e76b10952751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:47.549310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa280b62-2fcb-4ffc-8de9-e76b10952751 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:47.549594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa280b62-2fcb-4ffc-8de9-e76b10952751 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:47.549873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa280b62-2fcb-4ffc-8de9-e76b10952751 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:47.557144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa280b62-2fcb-4ffc-8de9-e76b10952751 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:47.559156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa280b62-2fcb-4ffc-8de9-e76b10952751 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:47.560911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-aa280b62-2fcb-4ffc-8de9-e76b10952751 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:47.571245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:47.573433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:47.576283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:47.576283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:47.576283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:47.576283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:47.576283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:47.576283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:47.576283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:47.576283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:47.576283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 08:39:47.576283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:47.580220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 386/795] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:39:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:47.581769 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e320b-8cc0-42b1-9c97-477498c37e9a None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:47.582231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e320b-8cc0-42b1-9c97-477498c37e9a None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:47.582674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e320b-8cc0-42b1-9c97-477498c37e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:47.596136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:47.601317 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-c05e320b-8cc0-42b1-9c97-477498c37e9a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:47.602760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c05e320b-8cc0-42b1-9c97-477498c37e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:47.615866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cfbea-84a3-4c8e-a3d8-ffd896a6ad15 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:47.654882 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46b21e-c5b6-47d2-9a60-516cc8b015b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:47.655580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46b21e-c5b6-47d2-9a60-516cc8b015b2 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:47.655828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46b21e-c5b6-47d2-9a60-516cc8b015b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:47.656109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46b21e-c5b6-47d2-9a60-516cc8b015b2 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:47.656949 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46b21e-c5b6-47d2-9a60-516cc8b015b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:47.657290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46b21e-c5b6-47d2-9a60-516cc8b015b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:47.658996 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46b21e-c5b6-47d2-9a60-516cc8b015b2 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:47.676178 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 387/796] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:47.677346 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e320b-8cc0-42b1-9c97-477498c37e9a None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:47.692604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 410/797] 10.222.0.76 () {56 vars in 1133 bytes} [Fri Aug 26 08:39:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:47.693517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46b21e-c5b6-47d2-9a60-516cc8b015b2 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:47.796245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e320b-8cc0-42b1-9c97-477498c37e9a None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:47.829590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:47.839103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23364a83-59f0-42f3-80d8-aff504fecaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:47.839741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23364a83-59f0-42f3-80d8-aff504fecaa3 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:47.840023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23364a83-59f0-42f3-80d8-aff504fecaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:47.840305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23364a83-59f0-42f3-80d8-aff504fecaa3 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:47.841045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23364a83-59f0-42f3-80d8-aff504fecaa3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:47.841336 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23364a83-59f0-42f3-80d8-aff504fecaa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:47.842366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46b21e-c5b6-47d2-9a60-516cc8b015b2 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:47.842806 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23364a83-59f0-42f3-80d8-aff504fecaa3 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:47.864327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 388/798] 10.222.0.76 () {56 vars in 1135 bytes} [Fri Aug 26 08:39:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:47.864327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa6b66-731e-42bf-918f-d00b3529ea82 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:47.864327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa6b66-731e-42bf-918f-d00b3529ea82 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:47.864327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa6b66-731e-42bf-918f-d00b3529ea82 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:47.864327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 389/799] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:47.864327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e610-c647-44ef-af47-b68ecb74901d None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:47.865606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e610-c647-44ef-af47-b68ecb74901d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:47.865606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e610-c647-44ef-af47-b68ecb74901d None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:47.865745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 390/800] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:47.866442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133e610-c647-44ef-af47-b68ecb74901d None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:47.893083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403067e-8a80-4343-a331-d16a1a692d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:47.893690 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403067e-8a80-4343-a331-d16a1a692d2a None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:47.893966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403067e-8a80-4343-a331-d16a1a692d2a None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:47.894248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403067e-8a80-4343-a331-d16a1a692d2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:47.907844 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:47.970216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403067e-8a80-4343-a331-d16a1a692d2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:47.971658 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403067e-8a80-4343-a331-d16a1a692d2a None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:47.972087 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133e610-c647-44ef-af47-b68ecb74901d None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:48.008127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b2ed1-2a93-4b14-a30a-c26c15ed6c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:48.008762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b2ed1-2a93-4b14-a30a-c26c15ed6c16 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:48.009072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b2ed1-2a93-4b14-a30a-c26c15ed6c16 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:48.009351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b2ed1-2a93-4b14-a30a-c26c15ed6c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:48.019190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b2ed1-2a93-4b14-a30a-c26c15ed6c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:48.020625 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b2ed1-2a93-4b14-a30a-c26c15ed6c16 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-5c1b2ed1-2a93-4b14-a30a-c26c15ed6c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:48.035904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:48.036896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:48.038049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:48.038049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:48.038049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:48.038049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 391/801] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:48.038286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1118-9951-4eb1-831b-c9dd4e41cd42 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:48.038508 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1118-9951-4eb1-831b-c9dd4e41cd42 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:48.038655 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1118-9951-4eb1-831b-c9dd4e41cd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:48.055988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-0d6a1118-9951-4eb1-831b-c9dd4e41cd42 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:48.057197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0d6a1118-9951-4eb1-831b-c9dd4e41cd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:48.076263 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 411/802] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:39:48.077592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1032-2c69-4ef0-812c-b541c598c28f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:48.077883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1032-2c69-4ef0-812c-b541c598c28f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:48.078157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1032-2c69-4ef0-812c-b541c598c28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:48.091163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:48.095138 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-ac4e1032-2c69-4ef0-812c-b541c598c28f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:48.096308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ac4e1032-2c69-4ef0-812c-b541c598c28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:48.130045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 392/803] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:48.130796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a1118-9951-4eb1-831b-c9dd4e41cd42 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:48.140466 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:48.185029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 412/804] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:48.185029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1032-2c69-4ef0-812c-b541c598c28f None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:48.244092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a1118-9951-4eb1-831b-c9dd4e41cd42 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:48.281129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03b254-f2cb-4c25-b6e9-8aa3b67170b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:48.281892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03b254-f2cb-4c25-b6e9-8aa3b67170b1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:48.282235 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03b254-f2cb-4c25-b6e9-8aa3b67170b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:48.282668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03b254-f2cb-4c25-b6e9-8aa3b67170b1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:48.283318 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03b254-f2cb-4c25-b6e9-8aa3b67170b1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:48.284890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03b254-f2cb-4c25-b6e9-8aa3b67170b1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-7c03b254-f2cb-4c25-b6e9-8aa3b67170b1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:48.294899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:48.295904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:48.296764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:48.296764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:48.296764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:48.296764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:48.296764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:48.296764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:48.296764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:48.296764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:48.296764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:48.296764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:48.296764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:39:48.296764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:48.296764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 08:39:48.296764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:48.296764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 393/805] 10.222.0.76 () {56 vars in 1129 bytes} [Fri Aug 26 08:39:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:48.297603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03b254-f2cb-4c25-b6e9-8aa3b67170b1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:48.318029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1032-2c69-4ef0-812c-b541c598c28f None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:48.331857 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:48.370786 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647be31-259f-478d-9bdf-6b7cb39628d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:48.371748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647be31-259f-478d-9bdf-6b7cb39628d4 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:48.372033 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647be31-259f-478d-9bdf-6b7cb39628d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:48.372308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647be31-259f-478d-9bdf-6b7cb39628d4 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:48.373563 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647be31-259f-478d-9bdf-6b7cb39628d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:48.373878 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647be31-259f-478d-9bdf-6b7cb39628d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:48.375532 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647be31-259f-478d-9bdf-6b7cb39628d4 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:48.397266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 413/806] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:48.398157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647be31-259f-478d-9bdf-6b7cb39628d4 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:48.413288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03b254-f2cb-4c25-b6e9-8aa3b67170b1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:48.429538 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:48.452473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77201da7-e108-4bcd-92f1-676d5d27f7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:48.453359 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77201da7-e108-4bcd-92f1-676d5d27f7f0 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:48.453680 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77201da7-e108-4bcd-92f1-676d5d27f7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:48.453914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77201da7-e108-4bcd-92f1-676d5d27f7f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:48.465947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77201da7-e108-4bcd-92f1-676d5d27f7f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:48.467427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77201da7-e108-4bcd-92f1-676d5d27f7f0 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-77201da7-e108-4bcd-92f1-676d5d27f7f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:48.482389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:48.488076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:48.489048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:48.489048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:48.489048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:48.489048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 394/807] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:48.489048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77201da7-e108-4bcd-92f1-676d5d27f7f0 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:48.499699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647be31-259f-478d-9bdf-6b7cb39628d4 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:48.533203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7d6f4-2c84-4f8f-bb86-7176813b85f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:48.533804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7d6f4-2c84-4f8f-bb86-7176813b85f2 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:48.534087 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7d6f4-2c84-4f8f-bb86-7176813b85f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:48.534363 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7d6f4-2c84-4f8f-bb86-7176813b85f2 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:48.534989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7d6f4-2c84-4f8f-bb86-7176813b85f2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:48.535294 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7d6f4-2c84-4f8f-bb86-7176813b85f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:48.536648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7d6f4-2c84-4f8f-bb86-7176813b85f2 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:48.540975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 414/808] 10.222.0.76 () {56 vars in 1124 bytes} [Fri Aug 26 08:39:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:48.541771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7d6f4-2c84-4f8f-bb86-7176813b85f2 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:48.567786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:48.590471 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77201da7-e108-4bcd-92f1-676d5d27f7f0 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:48.622764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c1f90-da18-4897-b17a-b07cc89e0fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:48.623384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c1f90-da18-4897-b17a-b07cc89e0fd2 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:48.623668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c1f90-da18-4897-b17a-b07cc89e0fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:48.623947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c1f90-da18-4897-b17a-b07cc89e0fd2 None admin] PATH_INFO: `/v3/services/network` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:48.624527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c1f90-da18-4897-b17a-b07cc89e0fd2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:48.625915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c1f90-da18-4897-b17a-b07cc89e0fd2 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-fd3c1f90-da18-4897-b17a-b07cc89e0fd2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:48.634577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:48.635669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:48.637093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:48.637093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:48.637093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:48.637093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:48.637093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:48.637093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:48.637093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:48.637093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:48.637093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:48.637093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:48.637093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:39:48.637093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:48.637093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 08:39:48.637093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:48.637093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 395/809] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:48 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:48.638052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c1f90-da18-4897-b17a-b07cc89e0fd2 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:48.638969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:48.644346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7d6f4-2c84-4f8f-bb86-7176813b85f2 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:48.678584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7f704-c2be-40c3-afcc-bcd3f2390db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:48.679136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7f704-c2be-40c3-afcc-bcd3f2390db0 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:48.679420 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7f704-c2be-40c3-afcc-bcd3f2390db0 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:48.679697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7f704-c2be-40c3-afcc-bcd3f2390db0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:48.686378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7f704-c2be-40c3-afcc-bcd3f2390db0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:48.687803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7f704-c2be-40c3-afcc-bcd3f2390db0 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:48.699927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-97c7f704-c2be-40c3-afcc-bcd3f2390db0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:48.699927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:48.699927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:48.699927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:48.699927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:48.699927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:48.699927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:48.699927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:48.699927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:48.699927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:48.699927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:48.699927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:48.699927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:48.699927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:48.699927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:48.700946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:48.702051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:48.702051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:48.702051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:48.702051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:48.702051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:48.702051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:48.702051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:48.702051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:48.702051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 415/810] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:48.702051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7f704-c2be-40c3-afcc-bcd3f2390db0 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:48.740133 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c1f90-da18-4897-b17a-b07cc89e0fd2 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:48.774986 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256edb7-79b2-4648-9b14-862c1637e51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:48.775614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256edb7-79b2-4648-9b14-862c1637e51c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:48.775901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256edb7-79b2-4648-9b14-862c1637e51c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:48.776174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256edb7-79b2-4648-9b14-862c1637e51c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:48.786580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256edb7-79b2-4648-9b14-862c1637e51c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-e256edb7-79b2-4648-9b14-862c1637e51c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:48.791243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:48.792253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:48.793535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:48.793535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:48.793535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:48.793535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:48.793535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:48.793535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:48.793535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:48.793535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:48.793535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:48.793535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:48.793535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:48.793535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:48.793535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 396/811] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:48.793535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256edb7-79b2-4648-9b14-862c1637e51c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:48.805024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:48.817926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7f704-c2be-40c3-afcc-bcd3f2390db0 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:48.852046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e0fc4-ea26-41a6-aa64-3209a7d67c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:48.852647 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e0fc4-ea26-41a6-aa64-3209a7d67c54 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:48.852920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e0fc4-ea26-41a6-aa64-3209a7d67c54 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:48.853281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e0fc4-ea26-41a6-aa64-3209a7d67c54 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:48.853911 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e0fc4-ea26-41a6-aa64-3209a7d67c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:48.854221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e0fc4-ea26-41a6-aa64-3209a7d67c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:48.855631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e0fc4-ea26-41a6-aa64-3209a7d67c54 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:48.867082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 416/812] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:48.867900 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e0fc4-ea26-41a6-aa64-3209a7d67c54 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:48.886003 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:48.895754 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256edb7-79b2-4648-9b14-862c1637e51c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:48.929641 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508be746-af72-4018-9b77-9746340ed418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:48.930176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508be746-af72-4018-9b77-9746340ed418 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:48.930458 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508be746-af72-4018-9b77-9746340ed418 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:48.930732 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508be746-af72-4018-9b77-9746340ed418 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:48.931355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508be746-af72-4018-9b77-9746340ed418 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:48.931656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508be746-af72-4018-9b77-9746340ed418 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:48.933043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508be746-af72-4018-9b77-9746340ed418 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:48.937720 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 397/813] 10.222.0.76 () {56 vars in 1124 bytes} [Fri Aug 26 08:39:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:48.938494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508be746-af72-4018-9b77-9746340ed418 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:48.969952 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e0fc4-ea26-41a6-aa64-3209a7d67c54 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:49.003181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37d991-fd42-4e29-b19e-c79b127e2a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:49.003773 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37d991-fd42-4e29-b19e-c79b127e2a6d None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:49.004054 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37d991-fd42-4e29-b19e-c79b127e2a6d None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:49.004328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37d991-fd42-4e29-b19e-c79b127e2a6d None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:49.004951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37d991-fd42-4e29-b19e-c79b127e2a6d None admin] RBAC: Adding query filter params (name=network) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:49.005283 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37d991-fd42-4e29-b19e-c79b127e2a6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:49.006631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37d991-fd42-4e29-b19e-c79b127e2a6d None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:49.009142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:49.011142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 417/814] 10.222.0.76 () {56 vars in 1112 bytes} [Fri Aug 26 08:39:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:49.012473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37d991-fd42-4e29-b19e-c79b127e2a6d None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:49.039897 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508be746-af72-4018-9b77-9746340ed418 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:49.073061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92c5b0-0d57-47a4-95d9-eedb9b3263e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:49.073668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92c5b0-0d57-47a4-95d9-eedb9b3263e2 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:49.073958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92c5b0-0d57-47a4-95d9-eedb9b3263e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:49.074774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92c5b0-0d57-47a4-95d9-eedb9b3263e2 None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:49.075457 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92c5b0-0d57-47a4-95d9-eedb9b3263e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:49.075761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92c5b0-0d57-47a4-95d9-eedb9b3263e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:49.077200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92c5b0-0d57-47a4-95d9-eedb9b3263e2 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:49.088151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 398/815] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:49.089198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92c5b0-0d57-47a4-95d9-eedb9b3263e2 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:49.093915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:49.112704 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37d991-fd42-4e29-b19e-c79b127e2a6d None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:49.147128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06396110-2c52-4dfa-969d-eee44f9b05a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:49.147742 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06396110-2c52-4dfa-969d-eee44f9b05a2 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:49.148004 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06396110-2c52-4dfa-969d-eee44f9b05a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:49.148278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06396110-2c52-4dfa-969d-eee44f9b05a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:49.148933 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06396110-2c52-4dfa-969d-eee44f9b05a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:49.149267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06396110-2c52-4dfa-969d-eee44f9b05a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:49.150610 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06396110-2c52-4dfa-969d-eee44f9b05a2 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:49.158478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 418/816] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:49.159393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06396110-2c52-4dfa-969d-eee44f9b05a2 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:49.188025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92c5b0-0d57-47a4-95d9-eedb9b3263e2 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:49.217065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:49.222499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d899e36-66ae-4460-9fa8-aba48df740c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:49.223123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d899e36-66ae-4460-9fa8-aba48df740c6 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:49.223404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d899e36-66ae-4460-9fa8-aba48df740c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:49.223679 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d899e36-66ae-4460-9fa8-aba48df740c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:49.230294 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d899e36-66ae-4460-9fa8-aba48df740c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:49.231727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d899e36-66ae-4460-9fa8-aba48df740c6 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:49.242558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-2d899e36-66ae-4460-9fa8-aba48df740c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:49.242558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:49.242558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:49.242558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:49.242558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:49.242558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:49.242558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:49.242558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:49.242558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:49.242558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:49.242558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:49.242558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:49.242558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:49.242558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:49.242558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:49.243513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:49.244432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:49.244432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:49.244432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:49.244432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:49.244432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:49.244432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:49.244432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:49.244432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:49.244432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 399/817] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:49.244926 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d899e36-66ae-4460-9fa8-aba48df740c6 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:49.261126 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06396110-2c52-4dfa-969d-eee44f9b05a2 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:49.294414 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a5db2-08c6-4974-a7f1-495438ef37bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:49.295021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a5db2-08c6-4974-a7f1-495438ef37bc None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:49.295307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a5db2-08c6-4974-a7f1-495438ef37bc None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:49.295587 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a5db2-08c6-4974-a7f1-495438ef37bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:49.296325 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a5db2-08c6-4974-a7f1-495438ef37bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:49.297652 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a5db2-08c6-4974-a7f1-495438ef37bc None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:49.319903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:49.332181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 419/818] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:39:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:39:49.332865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a5db2-08c6-4974-a7f1-495438ef37bc None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:49.362038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d899e36-66ae-4460-9fa8-aba48df740c6 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:49.409603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069ebd8-ba58-480c-82bf-feebcccfca49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:49.410266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069ebd8-ba58-480c-82bf-feebcccfca49 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:49.410556 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069ebd8-ba58-480c-82bf-feebcccfca49 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:49.410839 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069ebd8-ba58-480c-82bf-feebcccfca49 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:49.411623 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069ebd8-ba58-480c-82bf-feebcccfca49 None admin] RBAC: Adding query filter params (type=network) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:49.412118 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069ebd8-ba58-480c-82bf-feebcccfca49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:49.414354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069ebd8-ba58-480c-82bf-feebcccfca49 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:49.426910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 400/819] 10.222.0.76 () {56 vars in 1112 bytes} [Fri Aug 26 08:39:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:49.427974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069ebd8-ba58-480c-82bf-feebcccfca49 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:49.480206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a5db2-08c6-4974-a7f1-495438ef37bc None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:49.501505 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:49.530500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeec7b-a1a0-4d7b-9ba9-9aff92ee5169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:49.531172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeec7b-a1a0-4d7b-9ba9-9aff92ee5169 None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:49.531452 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeec7b-a1a0-4d7b-9ba9-9aff92ee5169 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:49.531754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeec7b-a1a0-4d7b-9ba9-9aff92ee5169 None admin] PATH_INFO: `/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/f544d78f417844f68f3bd37863d24885/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:49.533873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeec7b-a1a0-4d7b-9ba9-9aff92ee5169 None admin] RBAC: Authorizing `identity:create_grant(project_id=35aafba89a1d47cd86cef1eb0a11e507, user_id=f544d78f417844f68f3bd37863d24885, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:49.535284 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeec7b-a1a0-4d7b-9ba9-9aff92ee5169 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:49.557310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 420/820] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:39:49 2022] PUT /identity/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/f544d78f417844f68f3bd37863d24885/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:39:49.557310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeec7b-a1a0-4d7b-9ba9-9aff92ee5169 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:49.570071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069ebd8-ba58-480c-82bf-feebcccfca49 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:49.624735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4f3de-2e92-4874-b788-3c74274b9264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:49.627121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4f3de-2e92-4874-b788-3c74274b9264 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:49.627884 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4f3de-2e92-4874-b788-3c74274b9264 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:49.628182 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4f3de-2e92-4874-b788-3c74274b9264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:49.649791 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4f3de-2e92-4874-b788-3c74274b9264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:49.651662 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4f3de-2e92-4874-b788-3c74274b9264 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:49.670731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-94a4f3de-2e92-4874-b788-3c74274b9264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:49.686250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:49.687292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:49.688205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:49.688205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:49.688205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:49.688205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 401/821] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:49.689953 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4f3de-2e92-4874-b788-3c74274b9264 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:49.756842 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeec7b-a1a0-4d7b-9ba9-9aff92ee5169 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:49.808877 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04095e0f-3ef6-474d-930b-f78bc9c4dee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:49.809974 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04095e0f-3ef6-474d-930b-f78bc9c4dee0 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:49.810259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04095e0f-3ef6-474d-930b-f78bc9c4dee0 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:49.810533 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04095e0f-3ef6-474d-930b-f78bc9c4dee0 None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:49.811222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04095e0f-3ef6-474d-930b-f78bc9c4dee0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:49.811624 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04095e0f-3ef6-474d-930b-f78bc9c4dee0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:49.813977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04095e0f-3ef6-474d-930b-f78bc9c4dee0 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:49.835595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 421/822] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:49.836467 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04095e0f-3ef6-474d-930b-f78bc9c4dee0 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:49.873979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4f3de-2e92-4874-b788-3c74274b9264 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:49.877440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:49.920369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6976fa6-cded-437a-ac59-5e8f4ed0b2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:49.921045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6976fa6-cded-437a-ac59-5e8f4ed0b2d1 None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:49.921574 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6976fa6-cded-437a-ac59-5e8f4ed0b2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:49.921759 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6976fa6-cded-437a-ac59-5e8f4ed0b2d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:49.922495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6976fa6-cded-437a-ac59-5e8f4ed0b2d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:49.924135 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6976fa6-cded-437a-ac59-5e8f4ed0b2d1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:49.951609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04095e0f-3ef6-474d-930b-f78bc9c4dee0 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:49.957084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 402/823] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:39:49 2022] POST /identity/v3/endpoints => generated 337 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:39:49.959276 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6976fa6-cded-437a-ac59-5e8f4ed0b2d1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:49.991910 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:50.043792 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d58185-551b-41a2-839d-f27f69ea204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:50.044325 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d58185-551b-41a2-839d-f27f69ea204c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:50.044600 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d58185-551b-41a2-839d-f27f69ea204c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:50.044867 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d58185-551b-41a2-839d-f27f69ea204c None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:50.045541 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d58185-551b-41a2-839d-f27f69ea204c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:50.045841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d58185-551b-41a2-839d-f27f69ea204c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:50.047229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d58185-551b-41a2-839d-f27f69ea204c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:50.073416 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 422/824] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:50.079775 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d58185-551b-41a2-839d-f27f69ea204c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:50.137696 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6976fa6-cded-437a-ac59-5e8f4ed0b2d1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:50.183978 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86796a40-eadc-4d53-82dc-44dd1fc95482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:50.185466 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86796a40-eadc-4d53-82dc-44dd1fc95482 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:50.186091 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86796a40-eadc-4d53-82dc-44dd1fc95482 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:50.186569 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86796a40-eadc-4d53-82dc-44dd1fc95482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:50.187976 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86796a40-eadc-4d53-82dc-44dd1fc95482 None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=b63d6e588f6e4b598b75a2ec13bea25d) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:50.188778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86796a40-eadc-4d53-82dc-44dd1fc95482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:50.190990 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86796a40-eadc-4d53-82dc-44dd1fc95482 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:50.200415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 403/825] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:49 2022] GET /identity/v3/role_assignments?user.id=b63d6e588f6e4b598b75a2ec13bea25d&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:50.243104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d58185-551b-41a2-839d-f27f69ea204c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:50.281677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db5180-5fc4-4c5c-84a7-c176ddf4dee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:50.282444 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db5180-5fc4-4c5c-84a7-c176ddf4dee8 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:50.282727 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db5180-5fc4-4c5c-84a7-c176ddf4dee8 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:50.283035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db5180-5fc4-4c5c-84a7-c176ddf4dee8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:50.291761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db5180-5fc4-4c5c-84a7-c176ddf4dee8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:50.293305 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db5180-5fc4-4c5c-84a7-c176ddf4dee8 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-40db5180-5fc4-4c5c-84a7-c176ddf4dee8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:50.305673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:50.306667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:50.307648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:50.307648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:50.307648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:50.307648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:50.307648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:50.307648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:50.307648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:50.307648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:50.307648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 08:39:50.307648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:50.307648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 423/826] 10.222.0.76 () {56 vars in 1117 bytes} [Fri Aug 26 08:39:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:50.312669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86796a40-eadc-4d53-82dc-44dd1fc95482 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:50.346628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:50.431567 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86796a40-eadc-4d53-82dc-44dd1fc95482 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:50.468392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92140b1b-ed69-481f-b384-a70d42a5052d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:50.469036 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92140b1b-ed69-481f-b384-a70d42a5052d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:50.469358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92140b1b-ed69-481f-b384-a70d42a5052d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:50.469625 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92140b1b-ed69-481f-b384-a70d42a5052d None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:50.470407 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92140b1b-ed69-481f-b384-a70d42a5052d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:50.470709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92140b1b-ed69-481f-b384-a70d42a5052d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:50.472136 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92140b1b-ed69-481f-b384-a70d42a5052d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:50.490262 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 404/827] 10.222.0.76 () {56 vars in 1149 bytes} [Fri Aug 26 08:39:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:50.495437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db5180-5fc4-4c5c-84a7-c176ddf4dee8 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:50.531261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:50.605046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db5180-5fc4-4c5c-84a7-c176ddf4dee8 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:50.641514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4f8e9-2601-481f-b29a-3bd7c37552ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:50.642148 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4f8e9-2601-481f-b29a-3bd7c37552ad None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:50.642431 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4f8e9-2601-481f-b29a-3bd7c37552ad None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:50.642708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4f8e9-2601-481f-b29a-3bd7c37552ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:50.652946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4f8e9-2601-481f-b29a-3bd7c37552ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:50.654421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4f8e9-2601-481f-b29a-3bd7c37552ad None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-daa4f8e9-2601-481f-b29a-3bd7c37552ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:50.669249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:50.670218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:50.671154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:50.671154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:50.671154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:50.671154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 424/828] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:50.676420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92140b1b-ed69-481f-b384-a70d42a5052d None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:50.764846 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:50.785446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92140b1b-ed69-481f-b384-a70d42a5052d None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:50.822887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc48647-5bfd-4251-a9f8-7c131d60ed17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:50.823524 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc48647-5bfd-4251-a9f8-7c131d60ed17 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:50.823804 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc48647-5bfd-4251-a9f8-7c131d60ed17 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:50.824131 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc48647-5bfd-4251-a9f8-7c131d60ed17 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:50.825328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc48647-5bfd-4251-a9f8-7c131d60ed17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:50.825631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc48647-5bfd-4251-a9f8-7c131d60ed17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:50.827051 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc48647-5bfd-4251-a9f8-7c131d60ed17 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:50.840713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 405/829] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:50.846075 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4f8e9-2601-481f-b29a-3bd7c37552ad None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:50.934204 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:50.953314 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4f8e9-2601-481f-b29a-3bd7c37552ad None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:50.988213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ece12b-ea8f-443b-8aff-513f5c1c4b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:50.988848 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ece12b-ea8f-443b-8aff-513f5c1c4b24 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:50.989161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ece12b-ea8f-443b-8aff-513f5c1c4b24 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:50.989424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ece12b-ea8f-443b-8aff-513f5c1c4b24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:50.996740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ece12b-ea8f-443b-8aff-513f5c1c4b24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:50.998194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ece12b-ea8f-443b-8aff-513f5c1c4b24 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:51.009586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-c1ece12b-ea8f-443b-8aff-513f5c1c4b24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:51.009586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:51.009586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:51.009586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:51.009586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:51.009586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:51.009586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:51.009586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:51.009586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:51.009586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:51.009586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:51.009586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:51.009586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:51.009586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:51.009586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:51.010537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:51.012206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:51.012206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:51.012206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:51.012206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:51.012206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:51.012206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:51.012206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:51.012206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:51.012206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 425/830] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:51.016430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc48647-5bfd-4251-a9f8-7c131d60ed17 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:51.124660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc48647-5bfd-4251-a9f8-7c131d60ed17 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:51.159317 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab840a79-283f-4d94-ad13-208c0c599a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:51.160252 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab840a79-283f-4d94-ad13-208c0c599a38 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:51.160728 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab840a79-283f-4d94-ad13-208c0c599a38 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:51.161272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab840a79-283f-4d94-ad13-208c0c599a38 None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:51.162166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab840a79-283f-4d94-ad13-208c0c599a38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:51.162675 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab840a79-283f-4d94-ad13-208c0c599a38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:51.164280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab840a79-283f-4d94-ad13-208c0c599a38 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:51.177941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 406/831] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:51.185546 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ece12b-ea8f-443b-8aff-513f5c1c4b24 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:51.286996 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ece12b-ea8f-443b-8aff-513f5c1c4b24 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:51.323620 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5780d-1023-4fc2-92b3-268d3734a56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:51.324319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5780d-1023-4fc2-92b3-268d3734a56b None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:51.324606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5780d-1023-4fc2-92b3-268d3734a56b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:51.324887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5780d-1023-4fc2-92b3-268d3734a56b None admin] PATH_INFO: `/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/c50a6fa776a849cfbb0173ce24616906/roles/7aef270090c546a0aff3f62f1fcf517a` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:51.341109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5780d-1023-4fc2-92b3-268d3734a56b None admin] RBAC: Authorizing `identity:create_grant(project_id=35aafba89a1d47cd86cef1eb0a11e507, user_id=c50a6fa776a849cfbb0173ce24616906, role_id=7aef270090c546a0aff3f62f1fcf517a)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:51.342553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5780d-1023-4fc2-92b3-268d3734a56b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:51.345674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:51.362132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 426/832] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:39:51 2022] PUT /identity/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/c50a6fa776a849cfbb0173ce24616906/roles/7aef270090c546a0aff3f62f1fcf517a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:39:51.453171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd62fe-894d-4ee9-ae57-4cd1991b6469 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:51.453369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd62fe-894d-4ee9-ae57-4cd1991b6469 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:51.453639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd62fe-894d-4ee9-ae57-4cd1991b6469 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:51.455264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 407/833] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:51.460858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1c3fe-5a93-41aa-8237-e4e828b7771f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:51.461300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1c3fe-5a93-41aa-8237-e4e828b7771f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:51.461655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1c3fe-5a93-41aa-8237-e4e828b7771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:51.482000 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-f6f1c3fe-5a93-41aa-8237-e4e828b7771f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:51.483463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f6f1c3fe-5a93-41aa-8237-e4e828b7771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:51.559864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 427/834] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:51.731428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597bc37-b5ca-4176-b250-a16cf699c7ad None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:51.731631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597bc37-b5ca-4176-b250-a16cf699c7ad None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:51.731886 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597bc37-b5ca-4176-b250-a16cf699c7ad None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:51.733558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 408/835] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:51.738761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ad0fe-51ed-4a74-8b88-88bc708acbcb None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:51.739048 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ad0fe-51ed-4a74-8b88-88bc708acbcb None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:51.739324 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ad0fe-51ed-4a74-8b88-88bc708acbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:51.758192 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-dd6ad0fe-51ed-4a74-8b88-88bc708acbcb None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:51.759353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-dd6ad0fe-51ed-4a74-8b88-88bc708acbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:51.834191 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 428/836] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:51.840535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597bc37-b5ca-4176-b250-a16cf699c7ad None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:51.847847 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:51.953604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597bc37-b5ca-4176-b250-a16cf699c7ad None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:51.989997 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1b307-3a3a-4ba4-a1ba-360c852dc3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:51.990540 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1b307-3a3a-4ba4-a1ba-360c852dc3b8 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:51.990813 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1b307-3a3a-4ba4-a1ba-360c852dc3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:51.991081 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1b307-3a3a-4ba4-a1ba-360c852dc3b8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:51.991654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1b307-3a3a-4ba4-a1ba-360c852dc3b8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:51.993016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1b307-3a3a-4ba4-a1ba-360c852dc3b8 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-46a1b307-3a3a-4ba4-a1ba-360c852dc3b8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:52.002389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:52.003430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:52.004330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:52.004330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:52.004330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:52.004330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:52.004330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:52.004330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:52.004330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:52.004330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:52.004330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:52.004330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:52.004330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:39:52.004330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:52.004330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 08:39:52.004330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:52.004330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 409/837] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:39:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:52.011716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ad0fe-51ed-4a74-8b88-88bc708acbcb None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:52.071280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:52.116503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ad0fe-51ed-4a74-8b88-88bc708acbcb None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:52.149700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1b307-3a3a-4ba4-a1ba-360c852dc3b8 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:52.151348 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f075a6-9b4b-410f-bb88-75a3bed3b92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:52.152027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f075a6-9b4b-410f-bb88-75a3bed3b92c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:52.152909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f075a6-9b4b-410f-bb88-75a3bed3b92c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:52.153277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f075a6-9b4b-410f-bb88-75a3bed3b92c None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:52.153977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f075a6-9b4b-410f-bb88-75a3bed3b92c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:52.154356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f075a6-9b4b-410f-bb88-75a3bed3b92c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:52.155783 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f075a6-9b4b-410f-bb88-75a3bed3b92c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:52.160966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 429/838] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:39:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:52.170076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f075a6-9b4b-410f-bb88-75a3bed3b92c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:52.223466 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:52.274990 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1b307-3a3a-4ba4-a1ba-360c852dc3b8 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:52.276170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f075a6-9b4b-410f-bb88-75a3bed3b92c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:52.298296 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:52.312143 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ecee4-4867-4585-a61b-c2080c07c7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:52.312894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ecee4-4867-4585-a61b-c2080c07c7b0 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:52.313311 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ecee4-4867-4585-a61b-c2080c07c7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:52.313688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ecee4-4867-4585-a61b-c2080c07c7b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:52.314938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b2bab-2bbe-4776-b822-9b27894f846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:52.315692 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b2bab-2bbe-4776-b822-9b27894f846c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:52.315975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b2bab-2bbe-4776-b822-9b27894f846c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:52.316245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b2bab-2bbe-4776-b822-9b27894f846c None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:52.317175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b2bab-2bbe-4776-b822-9b27894f846c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:52.317475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b2bab-2bbe-4776-b822-9b27894f846c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:52.318821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b2bab-2bbe-4776-b822-9b27894f846c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:52.331747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ecee4-4867-4585-a61b-c2080c07c7b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:52.331950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 430/839] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:39:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:52.331950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58d73e-6c02-42ff-88c9-7ea23b0ee04f None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:52.331950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58d73e-6c02-42ff-88c9-7ea23b0ee04f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:52.331950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58d73e-6c02-42ff-88c9-7ea23b0ee04f None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:52.331950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 431/840] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-8a6ecee4-4867-4585-a61b-c2080c07c7b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:52.332298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:52.333352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:52.334392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:52.334392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:52.334392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:52.334392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:52.334392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:52.334392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:52.334392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:52.334392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:52.334392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:52.334392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:52.334392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:39:52.334392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:52.341019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 410/841] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:39:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:52.341505 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3caabb-d5a6-489f-aab3-749fbcfaa617 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:52.341505 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3caabb-d5a6-489f-aab3-749fbcfaa617 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:52.341505 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3caabb-d5a6-489f-aab3-749fbcfaa617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:52.342568 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ecee4-4867-4585-a61b-c2080c07c7b0 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:52.363670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-bf3caabb-d5a6-489f-aab3-749fbcfaa617 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:52.365629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-bf3caabb-d5a6-489f-aab3-749fbcfaa617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:52.457475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 432/842] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:52.469949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ecee4-4867-4585-a61b-c2080c07c7b0 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:52.497320 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:52.507300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acdd0a-83e9-4610-84cb-92a101daa76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:52.507912 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acdd0a-83e9-4610-84cb-92a101daa76c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:52.508198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acdd0a-83e9-4610-84cb-92a101daa76c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:52.508478 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acdd0a-83e9-4610-84cb-92a101daa76c None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:52.509179 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acdd0a-83e9-4610-84cb-92a101daa76c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:52.509486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acdd0a-83e9-4610-84cb-92a101daa76c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:52.510849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acdd0a-83e9-4610-84cb-92a101daa76c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:52.520725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 411/843] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:39:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:52.526314 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3caabb-d5a6-489f-aab3-749fbcfaa617 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:52.635899 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3caabb-d5a6-489f-aab3-749fbcfaa617 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:52.650824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:52.672398 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8af0c-696b-4dd2-9b40-d03b3655fb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:52.673053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8af0c-696b-4dd2-9b40-d03b3655fb3b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:52.673342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8af0c-696b-4dd2-9b40-d03b3655fb3b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:52.673620 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8af0c-696b-4dd2-9b40-d03b3655fb3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:52.684080 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8af0c-696b-4dd2-9b40-d03b3655fb3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:52.685608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8af0c-696b-4dd2-9b40-d03b3655fb3b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-f2b8af0c-696b-4dd2-9b40-d03b3655fb3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:52.701013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:52.701971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:52.702885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:52.702885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:52.702885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:52.702885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 433/844] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:52.710366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acdd0a-83e9-4610-84cb-92a101daa76c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:52.748976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8af0c-696b-4dd2-9b40-d03b3655fb3b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:52.842757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acdd0a-83e9-4610-84cb-92a101daa76c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:52.863598 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8af0c-696b-4dd2-9b40-d03b3655fb3b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:52.903179 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913b2a5-4de3-4829-a29f-b858e3e2c2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:52.904276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b2a5-4de3-4829-a29f-b858e3e2c2a5 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:52.904829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b2a5-4de3-4829-a29f-b858e3e2c2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:52.905351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b2a5-4de3-4829-a29f-b858e3e2c2a5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:52.906167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913b2a5-4de3-4829-a29f-b858e3e2c2a5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:52.907808 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913b2a5-4de3-4829-a29f-b858e3e2c2a5 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-8913b2a5-4de3-4829-a29f-b858e3e2c2a5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:52.918180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:52.919207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:52.920154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:52.920154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:52.920154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:52.920154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:52.920154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:52.920154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:52.920154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:52.920154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:52.920154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:52.920154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:52.920154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:39:52.920154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:52.920154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 08:39:52.920154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:52.923262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 434/845] 10.222.0.76 () {56 vars in 1132 bytes} [Fri Aug 26 08:39:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:52.928842 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913b2a5-4de3-4829-a29f-b858e3e2c2a5 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:52.964554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:53.013755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140ac09-8d28-479e-a0ed-03c670c52049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:53.014776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140ac09-8d28-479e-a0ed-03c670c52049 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:53.015332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140ac09-8d28-479e-a0ed-03c670c52049 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:53.015807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140ac09-8d28-479e-a0ed-03c670c52049 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:53.016669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140ac09-8d28-479e-a0ed-03c670c52049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:53.017244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140ac09-8d28-479e-a0ed-03c670c52049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:53.018809 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140ac09-8d28-479e-a0ed-03c670c52049 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:53.036474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 412/846] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:53.037860 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140ac09-8d28-479e-a0ed-03c670c52049 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:53.050234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913b2a5-4de3-4829-a29f-b858e3e2c2a5 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:53.094447 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb876d8-892b-4e6f-ad36-0bfb27403208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:53.095381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb876d8-892b-4e6f-ad36-0bfb27403208 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:53.095866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb876d8-892b-4e6f-ad36-0bfb27403208 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:53.096343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb876d8-892b-4e6f-ad36-0bfb27403208 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:53.096753 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:53.097439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb876d8-892b-4e6f-ad36-0bfb27403208 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:53.097947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb876d8-892b-4e6f-ad36-0bfb27403208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:53.099517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb876d8-892b-4e6f-ad36-0bfb27403208 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:53.105086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 435/847] 10.222.0.76 () {56 vars in 1126 bytes} [Fri Aug 26 08:39:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:53.110988 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb876d8-892b-4e6f-ad36-0bfb27403208 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:53.156578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140ac09-8d28-479e-a0ed-03c670c52049 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:53.193394 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df3826-2900-4dfe-b5d6-b5679a48b1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:53.194020 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df3826-2900-4dfe-b5d6-b5679a48b1d0 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:53.194324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df3826-2900-4dfe-b5d6-b5679a48b1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:53.194936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df3826-2900-4dfe-b5d6-b5679a48b1d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:53.202737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df3826-2900-4dfe-b5d6-b5679a48b1d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:53.204170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df3826-2900-4dfe-b5d6-b5679a48b1d0 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:53.215396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-63df3826-2900-4dfe-b5d6-b5679a48b1d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:53.217188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:53.219751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:53.220903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:53.220903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:53.220903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:53.220903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:53.220903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:53.220903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:53.220903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:53.220903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:53.220903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 08:39:53.220903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:53.220903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 413/848] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:39:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:53.225026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df3826-2900-4dfe-b5d6-b5679a48b1d0 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:53.228358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb876d8-892b-4e6f-ad36-0bfb27403208 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:53.272554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece051d-c49a-451d-a5e4-c6170536faba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:53.273223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece051d-c49a-451d-a5e4-c6170536faba None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:53.273513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece051d-c49a-451d-a5e4-c6170536faba None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:53.273831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece051d-c49a-451d-a5e4-c6170536faba None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:53.274474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece051d-c49a-451d-a5e4-c6170536faba None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:53.274780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece051d-c49a-451d-a5e4-c6170536faba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:53.276195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece051d-c49a-451d-a5e4-c6170536faba None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:53.285083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 436/849] 10.222.0.76 () {56 vars in 1126 bytes} [Fri Aug 26 08:39:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:53.353595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df3826-2900-4dfe-b5d6-b5679a48b1d0 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:53.364316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:53.393996 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f92d5-6e1e-4870-b1a2-b00bdf351ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:53.394625 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f92d5-6e1e-4870-b1a2-b00bdf351ff5 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:53.394911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f92d5-6e1e-4870-b1a2-b00bdf351ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:53.395189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f92d5-6e1e-4870-b1a2-b00bdf351ff5 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:53.395951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f92d5-6e1e-4870-b1a2-b00bdf351ff5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:53.396253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f92d5-6e1e-4870-b1a2-b00bdf351ff5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:53.397757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f92d5-6e1e-4870-b1a2-b00bdf351ff5 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:53.410545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f155d-f61f-4bfb-8e12-31074bb711a7 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:53.410897 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f155d-f61f-4bfb-8e12-31074bb711a7 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:53.411108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f155d-f61f-4bfb-8e12-31074bb711a7 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:53.412645 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 437/850] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:53.418614 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825451d-0d61-43bf-a4d2-f672a349b084 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:53.418902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825451d-0d61-43bf-a4d2-f672a349b084 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:53.419172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825451d-0d61-43bf-a4d2-f672a349b084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:53.422068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 414/851] 10.222.0.76 () {56 vars in 1135 bytes} [Fri Aug 26 08:39:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:53.427871 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f92d5-6e1e-4870-b1a2-b00bdf351ff5 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:53.441114 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-1825451d-0d61-43bf-a4d2-f672a349b084 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:53.442749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1825451d-0d61-43bf-a4d2-f672a349b084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:53.525388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 438/852] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:39:53.551756 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f92d5-6e1e-4870-b1a2-b00bdf351ff5 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:53.590190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a42f34-92fe-4b7d-b69c-3fdb82554edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:53.590853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a42f34-92fe-4b7d-b69c-3fdb82554edf None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:53.591141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a42f34-92fe-4b7d-b69c-3fdb82554edf None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:53.591413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a42f34-92fe-4b7d-b69c-3fdb82554edf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:53.626470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:53.667558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a42f34-92fe-4b7d-b69c-3fdb82554edf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:53.669603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a42f34-92fe-4b7d-b69c-3fdb82554edf None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:53.772145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 415/853] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:53 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:39:53.778304 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825451d-0d61-43bf-a4d2-f672a349b084 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:53.806212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a42f34-92fe-4b7d-b69c-3fdb82554edf None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:53.877087 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:53.888842 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:53.890344 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825451d-0d61-43bf-a4d2-f672a349b084 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:53.914515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a42f34-92fe-4b7d-b69c-3fdb82554edf None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:53.926934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942661c-d596-4c5b-8de7-acd0beee2e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:53.927704 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942661c-d596-4c5b-8de7-acd0beee2e32 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:53.928089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942661c-d596-4c5b-8de7-acd0beee2e32 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:53.928515 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942661c-d596-4c5b-8de7-acd0beee2e32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:53.938824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942661c-d596-4c5b-8de7-acd0beee2e32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:53.940579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942661c-d596-4c5b-8de7-acd0beee2e32 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-6942661c-d596-4c5b-8de7-acd0beee2e32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:53.956067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:53.957380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:53.958496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:53.958496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:53.958496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:53.963444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94576a3d-d040-4639-a13c-00074493c8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:53.964299 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 439/854] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:53.965343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94576a3d-d040-4639-a13c-00074493c8f7 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:53.965767 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94576a3d-d040-4639-a13c-00074493c8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:53.966034 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942661c-d596-4c5b-8de7-acd0beee2e32 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:53.966352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94576a3d-d040-4639-a13c-00074493c8f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:53.980222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94576a3d-d040-4639-a13c-00074493c8f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-94576a3d-d040-4639-a13c-00074493c8f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:53.987254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:53.988398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:53.989486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:53.989486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:53.989486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:53.989486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:53.989486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:53.989486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:53.989486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:53.989486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:53.989486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:53.989486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:53.989486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:39:53.989486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:53.992304 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 416/855] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:39:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:53.998837 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94576a3d-d040-4639-a13c-00074493c8f7 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:54.085583 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942661c-d596-4c5b-8de7-acd0beee2e32 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:54.124322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94576a3d-d040-4639-a13c-00074493c8f7 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:54.128516 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1981f74-f7ff-467d-934e-14d90b08bf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:54.129399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1981f74-f7ff-467d-934e-14d90b08bf6b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:54.129860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1981f74-f7ff-467d-934e-14d90b08bf6b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:54.130287 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1981f74-f7ff-467d-934e-14d90b08bf6b None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:54.131078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1981f74-f7ff-467d-934e-14d90b08bf6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:54.131537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1981f74-f7ff-467d-934e-14d90b08bf6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:54.133620 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1981f74-f7ff-467d-934e-14d90b08bf6b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:54.146559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:54.152944 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 440/856] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:54.158060 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:54.160279 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1981f74-f7ff-467d-934e-14d90b08bf6b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:54.168045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af8473-c82c-479c-a778-415572192472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:54.168664 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af8473-c82c-479c-a778-415572192472 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:54.168955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af8473-c82c-479c-a778-415572192472 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:54.169270 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af8473-c82c-479c-a778-415572192472 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:54.169942 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af8473-c82c-479c-a778-415572192472 None admin] RBAC: Adding query filter params (name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:54.170253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af8473-c82c-479c-a778-415572192472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:54.171630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af8473-c82c-479c-a778-415572192472 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:54.185059 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 417/857] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:39:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:54.185933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af8473-c82c-479c-a778-415572192472 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:54.283989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1981f74-f7ff-467d-934e-14d90b08bf6b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:54.296307 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af8473-c82c-479c-a778-415572192472 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:54.320346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1e391-efed-42dc-9f50-f4ceb894841f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:54.320977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1e391-efed-42dc-9f50-f4ceb894841f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:54.321288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1e391-efed-42dc-9f50-f4ceb894841f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:54.321819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1e391-efed-42dc-9f50-f4ceb894841f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:54.328800 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1e391-efed-42dc-9f50-f4ceb894841f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:54.330293 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1e391-efed-42dc-9f50-f4ceb894841f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:54.336807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa1542-237b-4f9b-afb6-1ad9864da4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:54.337459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa1542-237b-4f9b-afb6-1ad9864da4fe None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:54.337741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa1542-237b-4f9b-afb6-1ad9864da4fe None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:54.338014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa1542-237b-4f9b-afb6-1ad9864da4fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:54.341818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-ebb1e391-efed-42dc-9f50-f4ceb894841f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:54.341818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:54.341818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:54.341818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:54.341818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:54.341818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:54.341818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:54.341818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:54.341818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:54.341818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:54.341818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:54.341818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:54.341818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:54.341818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:54.341818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:54.342738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:54.344234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:54.344234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:54.344234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:54.344234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:54.344234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:54.344234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:54.344234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:54.344234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:54.344234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 441/858] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:54.344724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f265095-9ae3-475f-9b29-8058203fd46d None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:54.344724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f265095-9ae3-475f-9b29-8058203fd46d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:54.344847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f265095-9ae3-475f-9b29-8058203fd46d None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:54.346574 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 442/859] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:54.351132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f265095-9ae3-475f-9b29-8058203fd46d None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:54.352710 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa1542-237b-4f9b-afb6-1ad9864da4fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:54.354377 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa1542-237b-4f9b-afb6-1ad9864da4fe None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-dffa1542-237b-4f9b-afb6-1ad9864da4fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:54.372190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:54.373248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:54.374186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:54.374186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:54.374186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:54.374361 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 418/860] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:54.375623 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647f2a3-126c-497c-b0bd-71d21c305cc4 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:54.375908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647f2a3-126c-497c-b0bd-71d21c305cc4 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:54.376176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647f2a3-126c-497c-b0bd-71d21c305cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:54.394851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-1647f2a3-126c-497c-b0bd-71d21c305cc4 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:54.395948 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1647f2a3-126c-497c-b0bd-71d21c305cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:54.418408 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:54.431843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:54.464769 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f265095-9ae3-475f-9b29-8058203fd46d None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:54.468372 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 419/861] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:54.469275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647f2a3-126c-497c-b0bd-71d21c305cc4 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:54.513782 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e54fb5-9c40-4b7c-a29a-15d518addb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:54.514922 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e54fb5-9c40-4b7c-a29a-15d518addb28 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:54.515413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e54fb5-9c40-4b7c-a29a-15d518addb28 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:54.515920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e54fb5-9c40-4b7c-a29a-15d518addb28 None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:54.517220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e54fb5-9c40-4b7c-a29a-15d518addb28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:54.517502 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e54fb5-9c40-4b7c-a29a-15d518addb28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:54.518957 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e54fb5-9c40-4b7c-a29a-15d518addb28 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:54.536139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 443/862] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:54.542368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e54fb5-9c40-4b7c-a29a-15d518addb28 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:54.604659 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647f2a3-126c-497c-b0bd-71d21c305cc4 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:54.643249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95809607-4469-4b48-8a59-dbd288ba4f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:54.644234 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95809607-4469-4b48-8a59-dbd288ba4f9d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:54.645163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95809607-4469-4b48-8a59-dbd288ba4f9d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:54.645964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95809607-4469-4b48-8a59-dbd288ba4f9d None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:54.646759 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95809607-4469-4b48-8a59-dbd288ba4f9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:54.647240 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95809607-4469-4b48-8a59-dbd288ba4f9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:54.649192 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95809607-4469-4b48-8a59-dbd288ba4f9d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:54.663555 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 420/863] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:54.673040 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e54fb5-9c40-4b7c-a29a-15d518addb28 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:54.673224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95809607-4469-4b48-8a59-dbd288ba4f9d None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:54.700191 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:54.708031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:54.722119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c352602-aa1b-4319-abfb-348efb98a982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:54.723403 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c352602-aa1b-4319-abfb-348efb98a982 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:54.724158 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c352602-aa1b-4319-abfb-348efb98a982 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:54.724665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c352602-aa1b-4319-abfb-348efb98a982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:54.725932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c352602-aa1b-4319-abfb-348efb98a982 None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=f544d78f417844f68f3bd37863d24885) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:54.726890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c352602-aa1b-4319-abfb-348efb98a982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:54.729145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c352602-aa1b-4319-abfb-348efb98a982 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:54.738447 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 444/864] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:54 2022] GET /identity/v3/role_assignments?user.id=f544d78f417844f68f3bd37863d24885&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:54.740853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c352602-aa1b-4319-abfb-348efb98a982 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:54.807438 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95809607-4469-4b48-8a59-dbd288ba4f9d None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:54.865120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af0958-9244-495c-9636-cc0b21f0305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:54.865779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af0958-9244-495c-9636-cc0b21f0305f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:54.866068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af0958-9244-495c-9636-cc0b21f0305f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:54.866342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af0958-9244-495c-9636-cc0b21f0305f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:54.868118 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c352602-aa1b-4319-abfb-348efb98a982 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:54.877410 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af0958-9244-495c-9636-cc0b21f0305f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:54.878891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af0958-9244-495c-9636-cc0b21f0305f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-68af0958-9244-495c-9636-cc0b21f0305f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:54.897854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:54.898858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:54.899849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:54.899849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:54.899849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:54.899849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:54.899849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:54.899849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:54.899849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:54.899849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:54.899849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 08:39:54.899849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:54.907239 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 421/865] 10.222.0.76 () {56 vars in 1117 bytes} [Fri Aug 26 08:39:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:54.908560 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af0958-9244-495c-9636-cc0b21f0305f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:54.918679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299b4db-6de7-4993-8bb0-c8a71986a93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:54.919283 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299b4db-6de7-4993-8bb0-c8a71986a93d None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:54.919564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299b4db-6de7-4993-8bb0-c8a71986a93d None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:54.919832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299b4db-6de7-4993-8bb0-c8a71986a93d None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:54.920472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299b4db-6de7-4993-8bb0-c8a71986a93d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:54.923108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299b4db-6de7-4993-8bb0-c8a71986a93d None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:54.944819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 445/866] 10.222.0.76 () {60 vars in 1141 bytes} [Fri Aug 26 08:39:54 2022] POST /identity/v3/services => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:39:55.035184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:55.048362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af0958-9244-495c-9636-cc0b21f0305f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:55.093028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f78f4a-ecbe-41fe-931e-470174fd679f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:55.093644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f78f4a-ecbe-41fe-931e-470174fd679f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:55.093918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f78f4a-ecbe-41fe-931e-470174fd679f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:55.094187 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f78f4a-ecbe-41fe-931e-470174fd679f None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:55.094905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f78f4a-ecbe-41fe-931e-470174fd679f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:55.095204 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f78f4a-ecbe-41fe-931e-470174fd679f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:55.096609 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f78f4a-ecbe-41fe-931e-470174fd679f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:55.115591 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 422/867] 10.222.0.76 () {56 vars in 1149 bytes} [Fri Aug 26 08:39:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:55.121863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299b4db-6de7-4993-8bb0-c8a71986a93d None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:55.174751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:55.234213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299b4db-6de7-4993-8bb0-c8a71986a93d None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:55.270153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2538b3-2ba2-4914-bd1c-c2e4b95f227d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:55.270760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2538b3-2ba2-4914-bd1c-c2e4b95f227d None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:55.271037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2538b3-2ba2-4914-bd1c-c2e4b95f227d None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:55.271314 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2538b3-2ba2-4914-bd1c-c2e4b95f227d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:55.342282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2538b3-2ba2-4914-bd1c-c2e4b95f227d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:55.343723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2538b3-2ba2-4914-bd1c-c2e4b95f227d None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:55.367085 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713e8c3-9d4b-4483-9446-1b5071de8e7b None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:55.367610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713e8c3-9d4b-4483-9446-1b5071de8e7b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:55.367842 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713e8c3-9d4b-4483-9446-1b5071de8e7b None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:55.369989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 423/868] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:55.380213 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b741d-15f8-4ba1-a453-f99a316f309b None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:55.380639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b741d-15f8-4ba1-a453-f99a316f309b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:55.381257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b741d-15f8-4ba1-a453-f99a316f309b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:55.392957 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:55.406957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-d64b741d-15f8-4ba1-a453-f99a316f309b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:55.409165 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d64b741d-15f8-4ba1-a453-f99a316f309b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:55.452873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 446/869] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:55 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 08:39:55.458263 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2538b3-2ba2-4914-bd1c-c2e4b95f227d None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:55.504572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 424/870] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:55 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:55.564349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2538b3-2ba2-4914-bd1c-c2e4b95f227d None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:55.597842 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2319d21-1824-41d0-a79c-37f7ae4dd5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:55.598521 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319d21-1824-41d0-a79c-37f7ae4dd5b5 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:55.598800 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319d21-1824-41d0-a79c-37f7ae4dd5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:55.599118 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319d21-1824-41d0-a79c-37f7ae4dd5b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:55.609576 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2319d21-1824-41d0-a79c-37f7ae4dd5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:55.610998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2319d21-1824-41d0-a79c-37f7ae4dd5b5 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:55.613552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-a2319d21-1824-41d0-a79c-37f7ae4dd5b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:55.627082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:55.628053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:55.629282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:55.629282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:55.629282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:55.629282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 447/871] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:55.634102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b741d-15f8-4ba1-a453-f99a316f309b None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:55.710566 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:55.736851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b741d-15f8-4ba1-a453-f99a316f309b None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:55.771209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51a571-917c-44de-ae7a-98e9289eb791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:55.771819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51a571-917c-44de-ae7a-98e9289eb791 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:55.772099 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51a571-917c-44de-ae7a-98e9289eb791 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:55.772373 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51a571-917c-44de-ae7a-98e9289eb791 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:55.773031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51a571-917c-44de-ae7a-98e9289eb791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:55.773342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51a571-917c-44de-ae7a-98e9289eb791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:55.774755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51a571-917c-44de-ae7a-98e9289eb791 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:55.786840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 425/872] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:55.792308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2319d21-1824-41d0-a79c-37f7ae4dd5b5 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:55.819970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51a571-917c-44de-ae7a-98e9289eb791 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:55.904559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2319d21-1824-41d0-a79c-37f7ae4dd5b5 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:55.926207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51a571-917c-44de-ae7a-98e9289eb791 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:55.941971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c9e69-5994-499b-8000-5e651461a2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:55.942992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c9e69-5994-499b-8000-5e651461a2e6 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:55.943576 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c9e69-5994-499b-8000-5e651461a2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:55.944079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c9e69-5994-499b-8000-5e651461a2e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:55.951368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c9e69-5994-499b-8000-5e651461a2e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:55.953362 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c9e69-5994-499b-8000-5e651461a2e6 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:55.960338 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a266bd-244a-4933-8afc-4e8cc46c4ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:55.961018 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a266bd-244a-4933-8afc-4e8cc46c4ca4 None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:55.961274 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a266bd-244a-4933-8afc-4e8cc46c4ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:55.961558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a266bd-244a-4933-8afc-4e8cc46c4ca4 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:55.962241 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a266bd-244a-4933-8afc-4e8cc46c4ca4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:55.963732 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a266bd-244a-4933-8afc-4e8cc46c4ca4 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:55.968287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:55.969761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-236c9e69-5994-499b-8000-5e651461a2e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:55.969761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:55.969761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:55.969761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:55.969761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:55.969761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:55.969761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:55.969761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:55.969761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:55.969761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:55.969761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:55.969761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:55.969761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:39:55.969761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:39:55.969761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:55.970757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:55.971947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:39:55.971947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:39:55.971947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:39:55.971947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:39:55.971947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:39:55.971947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:39:55.971947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:39:55.971947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:55.974508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 448/873] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:39:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:55.981280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c9e69-5994-499b-8000-5e651461a2e6 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:55.995503 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 426/874] 10.222.0.76 () {60 vars in 1141 bytes} [Fri Aug 26 08:39:55 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:39:56.050955 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:56.101825 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c9e69-5994-499b-8000-5e651461a2e6 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:56.147192 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b30eb-35a4-43cd-bc5d-bf83d2a6e833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:56.147871 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b30eb-35a4-43cd-bc5d-bf83d2a6e833 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:56.148108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b30eb-35a4-43cd-bc5d-bf83d2a6e833 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:56.148349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b30eb-35a4-43cd-bc5d-bf83d2a6e833 None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:56.149124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b30eb-35a4-43cd-bc5d-bf83d2a6e833 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:56.149435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b30eb-35a4-43cd-bc5d-bf83d2a6e833 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:56.150922 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b30eb-35a4-43cd-bc5d-bf83d2a6e833 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:56.164375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 449/875] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:39:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:56.170404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a266bd-244a-4933-8afc-4e8cc46c4ca4 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:56.279956 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a266bd-244a-4933-8afc-4e8cc46c4ca4 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:56.314876 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb393b-fb99-4744-a1fc-51ad163feca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:56.315487 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb393b-fb99-4744-a1fc-51ad163feca7 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:56.315773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb393b-fb99-4744-a1fc-51ad163feca7 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:56.316049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb393b-fb99-4744-a1fc-51ad163feca7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:56.316780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb393b-fb99-4744-a1fc-51ad163feca7 None admin] RBAC: Adding query filter params (role.id=7aef270090c546a0aff3f62f1fcf517a, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=c50a6fa776a849cfbb0173ce24616906) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:56.317117 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb393b-fb99-4744-a1fc-51ad163feca7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:56.318553 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb393b-fb99-4744-a1fc-51ad163feca7 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:56.325574 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 427/876] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:39:56 2022] GET /identity/v3/role_assignments?user.id=c50a6fa776a849cfbb0173ce24616906&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=7aef270090c546a0aff3f62f1fcf517a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:56.816833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ba528-dd81-4c50-ae2f-42762d2e2aab None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:56.817228 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ba528-dd81-4c50-ae2f-42762d2e2aab None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:56.817429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ba528-dd81-4c50-ae2f-42762d2e2aab None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:56.819024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 450/877] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:56.824841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def3c56-f285-493c-8a56-ba6175308d12 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:56.825331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def3c56-f285-493c-8a56-ba6175308d12 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:56.825412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def3c56-f285-493c-8a56-ba6175308d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:56.844403 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-3def3c56-f285-493c-8a56-ba6175308d12 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:56.845795 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3def3c56-f285-493c-8a56-ba6175308d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:56.902341 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:56.916400 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 428/878] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:56 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:57.004861 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb9e03-7f22-473c-9525-da1e84333cbd None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:57.005186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb9e03-7f22-473c-9525-da1e84333cbd None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:57.005450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb9e03-7f22-473c-9525-da1e84333cbd None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:57.007092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 451/879] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:57.012390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1626128-ac3c-4e56-bab5-aaf62617a696 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:57.012898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1626128-ac3c-4e56-bab5-aaf62617a696 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:57.013399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1626128-ac3c-4e56-bab5-aaf62617a696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:57.031685 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-c1626128-ac3c-4e56-bab5-aaf62617a696 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:57.033272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c1626128-ac3c-4e56-bab5-aaf62617a696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:57.104801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 429/880] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:57.197394 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb9e03-7f22-473c-9525-da1e84333cbd None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:57.306262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb9e03-7f22-473c-9525-da1e84333cbd None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:57.332022 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:57.342024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e22ce9-852a-4676-8e8e-52c1cf833d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:57.342657 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e22ce9-852a-4676-8e8e-52c1cf833d3d None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:57.342940 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e22ce9-852a-4676-8e8e-52c1cf833d3d None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:57.344069 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e22ce9-852a-4676-8e8e-52c1cf833d3d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:57.344666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e22ce9-852a-4676-8e8e-52c1cf833d3d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:57.346055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e22ce9-852a-4676-8e8e-52c1cf833d3d None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-a6e22ce9-852a-4676-8e8e-52c1cf833d3d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:57.354873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:57.356438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:57.357338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:57.357338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:57.357338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:57.357338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:57.357338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:57.357338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:57.357338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:57.357338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:57.357338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:57.357338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:57.357338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:39:57.357338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:57.357338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 08:39:57.357338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:57.357338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 452/881] 10.222.0.76 () {56 vars in 1126 bytes} [Fri Aug 26 08:39:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:57.366489 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1626128-ac3c-4e56-bab5-aaf62617a696 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:57.387710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e22ce9-852a-4676-8e8e-52c1cf833d3d None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:57.488663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1626128-ac3c-4e56-bab5-aaf62617a696 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:57.510421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e22ce9-852a-4676-8e8e-52c1cf833d3d None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:57.525415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:57.527642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be85c12-bc24-41f6-8f92-7b35e65d1a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:57.528518 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be85c12-bc24-41f6-8f92-7b35e65d1a8a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:57.529031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be85c12-bc24-41f6-8f92-7b35e65d1a8a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:57.529465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be85c12-bc24-41f6-8f92-7b35e65d1a8a None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:57.530462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be85c12-bc24-41f6-8f92-7b35e65d1a8a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:57.530871 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be85c12-bc24-41f6-8f92-7b35e65d1a8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:57.533165 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be85c12-bc24-41f6-8f92-7b35e65d1a8a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:57.540247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 430/882] 10.222.0.76 () {56 vars in 1122 bytes} [Fri Aug 26 08:39:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:57.545730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be85c12-bc24-41f6-8f92-7b35e65d1a8a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:57.558175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be455f-2af3-4189-8796-586093109e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:57.559090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be455f-2af3-4189-8796-586093109e60 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:57.559090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be455f-2af3-4189-8796-586093109e60 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:57.559384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be455f-2af3-4189-8796-586093109e60 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:57.560017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be455f-2af3-4189-8796-586093109e60 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:57.561446 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be455f-2af3-4189-8796-586093109e60 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-a2be455f-2af3-4189-8796-586093109e60 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:57.570915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:57.571954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:57.572819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:57.572819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:57.572819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:57.572819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:57.572819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:57.572819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:57.572819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:57.572819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:57.572819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:57.572819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:57.572819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:39:57.572819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:57.572819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 08:39:57.572819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:57.572819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 453/883] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:39:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:57.584313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be455f-2af3-4189-8796-586093109e60 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:57.631345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:57.676097 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be85c12-bc24-41f6-8f92-7b35e65d1a8a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:57.693627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be455f-2af3-4189-8796-586093109e60 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:57.716256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de92e1-e221-483b-acf6-7d5fe870bd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:57.717016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de92e1-e221-483b-acf6-7d5fe870bd8a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:57.717440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de92e1-e221-483b-acf6-7d5fe870bd8a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:57.717805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de92e1-e221-483b-acf6-7d5fe870bd8a None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:57.718532 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de92e1-e221-483b-acf6-7d5fe870bd8a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:57.718938 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de92e1-e221-483b-acf6-7d5fe870bd8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:57.720600 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de92e1-e221-483b-acf6-7d5fe870bd8a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:57.733028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 431/884] 10.222.0.76 () {56 vars in 1122 bytes} [Fri Aug 26 08:39:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:39:57.738869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea81630-ce69-48af-82ee-cbf397852202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:57.739499 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea81630-ce69-48af-82ee-cbf397852202 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:57.739785 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea81630-ce69-48af-82ee-cbf397852202 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:57.740059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea81630-ce69-48af-82ee-cbf397852202 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:57.740695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea81630-ce69-48af-82ee-cbf397852202 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:57.741015 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea81630-ce69-48af-82ee-cbf397852202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:57.742526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea81630-ce69-48af-82ee-cbf397852202 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:57.748623 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 454/885] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:39:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:57.754718 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de92e1-e221-483b-acf6-7d5fe870bd8a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:57.822693 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:57.887508 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de92e1-e221-483b-acf6-7d5fe870bd8a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:57.923941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00651365-1eae-465d-b2b0-b5eb91e2d537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:57.924552 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00651365-1eae-465d-b2b0-b5eb91e2d537 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:57.924845 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00651365-1eae-465d-b2b0-b5eb91e2d537 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:57.925128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00651365-1eae-465d-b2b0-b5eb91e2d537 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:57.925819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00651365-1eae-465d-b2b0-b5eb91e2d537 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:57.926126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00651365-1eae-465d-b2b0-b5eb91e2d537 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:57.927479 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00651365-1eae-465d-b2b0-b5eb91e2d537 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:57.937133 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 432/886] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:39:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:57.938954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea81630-ce69-48af-82ee-cbf397852202 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:57.999310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032dc4b-2305-41fb-b4c5-ba60073bd554 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:57.999614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032dc4b-2305-41fb-b4c5-ba60073bd554 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:57.999858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032dc4b-2305-41fb-b4c5-ba60073bd554 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:58.001474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 433/887] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:39:58.014722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cf2c8-005d-46f0-9010-412dbfa68808 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:58.015138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cf2c8-005d-46f0-9010-412dbfa68808 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:58.015512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cf2c8-005d-46f0-9010-412dbfa68808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:58.034273 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-e53cf2c8-005d-46f0-9010-412dbfa68808 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:58.035671 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-e53cf2c8-005d-46f0-9010-412dbfa68808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:58.048876 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea81630-ce69-48af-82ee-cbf397852202 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:58.051270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:58.085925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c5db4-fdce-4b98-808a-6cd6bd19cd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:58.086539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c5db4-fdce-4b98-808a-6cd6bd19cd86 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:58.086814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c5db4-fdce-4b98-808a-6cd6bd19cd86 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:58.087083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c5db4-fdce-4b98-808a-6cd6bd19cd86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:58.087776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c5db4-fdce-4b98-808a-6cd6bd19cd86 None admin] RBAC: Adding query filter params (interface=public, service_id=b7592b59bd2446caa68c7030efd532af, region_id=RegionOne) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:58.088081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c5db4-fdce-4b98-808a-6cd6bd19cd86 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:58.089851 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c5db4-fdce-4b98-808a-6cd6bd19cd86 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:58.095454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 455/888] 10.222.0.76 () {56 vars in 1251 bytes} [Fri Aug 26 08:39:57 2022] GET /identity/v3/endpoints?service_id=b7592b59bd2446caa68c7030efd532af&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:58.101216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c5db4-fdce-4b98-808a-6cd6bd19cd86 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:58.121368 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 434/889] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:58.205629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c5db4-fdce-4b98-808a-6cd6bd19cd86 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:58.241748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8586e5-3043-4588-8636-1006e2ac6e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:58.242513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8586e5-3043-4588-8636-1006e2ac6e59 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:58.242830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8586e5-3043-4588-8636-1006e2ac6e59 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:58.243177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8586e5-3043-4588-8636-1006e2ac6e59 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:58.243849 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8586e5-3043-4588-8636-1006e2ac6e59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:58.245322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8586e5-3043-4588-8636-1006e2ac6e59 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:58.252039 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 456/890] 10.222.0.76 () {56 vars in 1087 bytes} [Fri Aug 26 08:39:58 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:39:58.345853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341d3ba-de98-472e-bc8f-9ee393b4ae79 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:58.346148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341d3ba-de98-472e-bc8f-9ee393b4ae79 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:58.346429 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341d3ba-de98-472e-bc8f-9ee393b4ae79 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:58.348045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 435/891] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:39:58.353725 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49224de7-9528-4d0d-9aeb-5e31604a8a1f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:58.354015 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49224de7-9528-4d0d-9aeb-5e31604a8a1f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:58.354291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49224de7-9528-4d0d-9aeb-5e31604a8a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:58.374440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-49224de7-9528-4d0d-9aeb-5e31604a8a1f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:58.375659 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-49224de7-9528-4d0d-9aeb-5e31604a8a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:58.386031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341d3ba-de98-472e-bc8f-9ee393b4ae79 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:58.403663 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:58.460089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 457/892] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:39:58.461353 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:58.512329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341d3ba-de98-472e-bc8f-9ee393b4ae79 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:58.549547 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeb9f3-7f3d-4305-b52f-1f4f52fe5cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:58.550480 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeb9f3-7f3d-4305-b52f-1f4f52fe5cb1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:58.550903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeb9f3-7f3d-4305-b52f-1f4f52fe5cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:58.551365 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeb9f3-7f3d-4305-b52f-1f4f52fe5cb1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:58.552086 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceeb9f3-7f3d-4305-b52f-1f4f52fe5cb1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:58.553723 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceeb9f3-7f3d-4305-b52f-1f4f52fe5cb1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-5ceeb9f3-7f3d-4305-b52f-1f4f52fe5cb1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:58.563511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:58.564670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:58.565794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:58.565794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:58.565794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:58.565794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:58.565794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:58.565794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:58.565794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:58.565794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:58.565794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:58.565794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:58.565794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:39:58.565794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:39:58.565794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 08:39:58.565794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:58.568306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 436/893] 10.222.0.76 () {56 vars in 1132 bytes} [Fri Aug 26 08:39:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:58.573882 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49224de7-9528-4d0d-9aeb-5e31604a8a1f None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:58.676302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49224de7-9528-4d0d-9aeb-5e31604a8a1f None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:58.710883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439508db-bfb1-42b4-8018-02bd3f90f341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:58.711424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439508db-bfb1-42b4-8018-02bd3f90f341 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:58.711737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439508db-bfb1-42b4-8018-02bd3f90f341 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:58.712004 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439508db-bfb1-42b4-8018-02bd3f90f341 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:58.712678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439508db-bfb1-42b4-8018-02bd3f90f341 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:58.712980 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439508db-bfb1-42b4-8018-02bd3f90f341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:58.715195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439508db-bfb1-42b4-8018-02bd3f90f341 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:58.720188 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 458/894] 10.222.0.76 () {56 vars in 1126 bytes} [Fri Aug 26 08:39:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:58.725775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeb9f3-7f3d-4305-b52f-1f4f52fe5cb1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:58.736323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439508db-bfb1-42b4-8018-02bd3f90f341 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:58.765900 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:58.847155 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439508db-bfb1-42b4-8018-02bd3f90f341 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:58.863427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeb9f3-7f3d-4305-b52f-1f4f52fe5cb1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:58.866811 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:58.884692 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789a5ee-9ef8-4451-87d5-943b1b89f912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:58.885356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789a5ee-9ef8-4451-87d5-943b1b89f912 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:58.885634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789a5ee-9ef8-4451-87d5-943b1b89f912 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:58.885909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789a5ee-9ef8-4451-87d5-943b1b89f912 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:58.897586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789a5ee-9ef8-4451-87d5-943b1b89f912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-e789a5ee-9ef8-4451-87d5-943b1b89f912 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:39:58.902564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:58.903558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:58.904421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:58.904421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:58.904421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:58.904421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:58.904421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:39:58.904421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:39:58.904421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:39:58.904421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:39:58.904421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:39:58.904421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:39:58.904421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 08:39:58.904421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:58.908902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 459/895] 10.222.0.76 () {56 vars in 1120 bytes} [Fri Aug 26 08:39:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:39:58.909966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789a5ee-9ef8-4451-87d5-943b1b89f912 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:58.916584 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4bf9c-260d-454a-b5a0-0611013a200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:58.917953 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4bf9c-260d-454a-b5a0-0611013a200a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:58.918430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4bf9c-260d-454a-b5a0-0611013a200a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:58.918895 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4bf9c-260d-454a-b5a0-0611013a200a None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:58.919736 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4bf9c-260d-454a-b5a0-0611013a200a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:58.920823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4bf9c-260d-454a-b5a0-0611013a200a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:58.922887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4bf9c-260d-454a-b5a0-0611013a200a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:58.932282 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 437/896] 10.222.0.76 () {56 vars in 1126 bytes} [Fri Aug 26 08:39:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:58.942195 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4bf9c-260d-454a-b5a0-0611013a200a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:59.004568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:59.022086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789a5ee-9ef8-4451-87d5-943b1b89f912 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:59.060528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4bf9c-260d-454a-b5a0-0611013a200a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:59.062295 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d4212-26c2-4f86-b987-694dd2287a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:59.063814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d4212-26c2-4f86-b987-694dd2287a1c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:59.064166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d4212-26c2-4f86-b987-694dd2287a1c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:59.064510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d4212-26c2-4f86-b987-694dd2287a1c None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:59.065263 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d4212-26c2-4f86-b987-694dd2287a1c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:59.065633 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d4212-26c2-4f86-b987-694dd2287a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:59.067055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d4212-26c2-4f86-b987-694dd2287a1c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:59.079236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 460/897] 10.222.0.76 () {56 vars in 1115 bytes} [Fri Aug 26 08:39:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:59.086507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d4212-26c2-4f86-b987-694dd2287a1c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:59.100207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e21a2c-aa2f-437e-8b60-1bb950758a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:59.100860 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e21a2c-aa2f-437e-8b60-1bb950758a5e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:59.101176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e21a2c-aa2f-437e-8b60-1bb950758a5e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:59.101452 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e21a2c-aa2f-437e-8b60-1bb950758a5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:59.102255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e21a2c-aa2f-437e-8b60-1bb950758a5e None admin] RBAC: Adding query filter params (interface=public, service_id=56720517b34840ceaa023ce218824a25, region_id=RegionOne) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:59.102565 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e21a2c-aa2f-437e-8b60-1bb950758a5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:59.104037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e21a2c-aa2f-437e-8b60-1bb950758a5e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:59.112477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 438/898] 10.222.0.76 () {56 vars in 1251 bytes} [Fri Aug 26 08:39:58 2022] GET /identity/v3/endpoints?service_id=56720517b34840ceaa023ce218824a25&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:59.117516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e21a2c-aa2f-437e-8b60-1bb950758a5e None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:59.151097 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:59.196456 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d4212-26c2-4f86-b987-694dd2287a1c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:59.226542 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e21a2c-aa2f-437e-8b60-1bb950758a5e None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:59.232016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822d102-2467-404f-a285-2735593be0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:59.232733 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822d102-2467-404f-a285-2735593be0ad None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:59.233091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822d102-2467-404f-a285-2735593be0ad None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:59.233429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822d102-2467-404f-a285-2735593be0ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:59.246184 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822d102-2467-404f-a285-2735593be0ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:59.247862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822d102-2467-404f-a285-2735593be0ad None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:59.256492 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-6822d102-2467-404f-a285-2735593be0ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:39:59.264699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:59.265695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:39:59.266608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:39:59.266608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:39:59.266608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:39:59.266800 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4455ea7-7a52-49d7-8f63-085cf5adc3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:59.267012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4455ea7-7a52-49d7-8f63-085cf5adc3ed None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:59.267258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4455ea7-7a52-49d7-8f63-085cf5adc3ed None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:59.267536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4455ea7-7a52-49d7-8f63-085cf5adc3ed None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:59.268145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4455ea7-7a52-49d7-8f63-085cf5adc3ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:59.269102 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 461/899] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:59.275927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4455ea7-7a52-49d7-8f63-085cf5adc3ed None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:59.276081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822d102-2467-404f-a285-2735593be0ad None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:59.276196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 439/900] 10.222.0.76 () {56 vars in 1087 bytes} [Fri Aug 26 08:39:59 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:39:59.394288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822d102-2467-404f-a285-2735593be0ad None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:59.431460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874d7ae-f22f-472f-b0e4-dca69ea06d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:59.432066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874d7ae-f22f-472f-b0e4-dca69ea06d53 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:59.432347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874d7ae-f22f-472f-b0e4-dca69ea06d53 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:59.432620 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874d7ae-f22f-472f-b0e4-dca69ea06d53 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:59.433856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874d7ae-f22f-472f-b0e4-dca69ea06d53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:59.434161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874d7ae-f22f-472f-b0e4-dca69ea06d53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:59.435524 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874d7ae-f22f-472f-b0e4-dca69ea06d53 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:59.448161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 462/901] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:59.454815 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4455ea7-7a52-49d7-8f63-085cf5adc3ed None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:59.556970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:59.563286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4455ea7-7a52-49d7-8f63-085cf5adc3ed None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:59.599841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa0e33-86c3-4ce4-a5b7-739cb521909e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:59.600468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa0e33-86c3-4ce4-a5b7-739cb521909e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:59.600748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa0e33-86c3-4ce4-a5b7-739cb521909e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:59.601042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa0e33-86c3-4ce4-a5b7-739cb521909e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:59.609099 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa0e33-86c3-4ce4-a5b7-739cb521909e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:59.610536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa0e33-86c3-4ce4-a5b7-739cb521909e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-cbfa0e33-86c3-4ce4-a5b7-739cb521909e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:39:59.622367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:39:59.623352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:39:59.624313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:39:59.624313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:39:59.624313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:39:59.624313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:39:59.624313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:39:59.624313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:39:59.624313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:39:59.624313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:39:59.624313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 08:39:59.624313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:39:59.624313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 440/902] 10.222.0.76 () {56 vars in 1117 bytes} [Fri Aug 26 08:39:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:39:59.629584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874d7ae-f22f-472f-b0e4-dca69ea06d53 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:59.695042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:59.739150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874d7ae-f22f-472f-b0e4-dca69ea06d53 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:59.774538 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96594a6-94f9-4723-8018-32b4e99189b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:59.775550 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96594a6-94f9-4723-8018-32b4e99189b8 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:59.776032 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96594a6-94f9-4723-8018-32b4e99189b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:59.776507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96594a6-94f9-4723-8018-32b4e99189b8 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:59.777992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96594a6-94f9-4723-8018-32b4e99189b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:39:59.778526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96594a6-94f9-4723-8018-32b4e99189b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:39:59.780158 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96594a6-94f9-4723-8018-32b4e99189b8 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:39:59.792152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d309afa-405d-4e10-a4ec-d1e5979b68ea None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:59.792505 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d309afa-405d-4e10-a4ec-d1e5979b68ea None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:59.793316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d309afa-405d-4e10-a4ec-d1e5979b68ea None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:59.794830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 441/903] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:39:59.801020 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed3c79-9949-439a-a90a-2506407938cd None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:59.801020 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed3c79-9949-439a-a90a-2506407938cd None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:59.801020 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed3c79-9949-439a-a90a-2506407938cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:39:59.801306 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 463/904] 10.222.0.76 () {56 vars in 1149 bytes} [Fri Aug 26 08:39:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:39:59.808605 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96594a6-94f9-4723-8018-32b4e99189b8 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:39:59.820063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-5bed3c79-9949-439a-a90a-2506407938cd None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:39:59.821477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5bed3c79-9949-439a-a90a-2506407938cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:39:59.921020 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 442/905] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:39:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:39:59.939557 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96594a6-94f9-4723-8018-32b4e99189b8 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:39:59.958080 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:39:59.977887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717c7c4-0df2-480f-9cf4-148751b5f420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:39:59.978500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717c7c4-0df2-480f-9cf4-148751b5f420 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:39:59.978774 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717c7c4-0df2-480f-9cf4-148751b5f420 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:39:59.979043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717c7c4-0df2-480f-9cf4-148751b5f420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:00.049105 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717c7c4-0df2-480f-9cf4-148751b5f420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:00.050545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717c7c4-0df2-480f-9cf4-148751b5f420 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:00.152860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 464/906] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:39:59 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 08:40:00.162092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed3c79-9949-439a-a90a-2506407938cd None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:00.189679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717c7c4-0df2-480f-9cf4-148751b5f420 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:00.209830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:00.264386 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:00.281867 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed3c79-9949-439a-a90a-2506407938cd None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:00.294590 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717c7c4-0df2-480f-9cf4-148751b5f420 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:00.320201 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28475a3f-19b5-4fdf-8467-fa529fb34e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:00.321284 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28475a3f-19b5-4fdf-8467-fa529fb34e00 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:00.321920 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28475a3f-19b5-4fdf-8467-fa529fb34e00 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:00.322293 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28475a3f-19b5-4fdf-8467-fa529fb34e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:00.329854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca21731-c96b-42cb-b47b-d7f3b7d99d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:00.330457 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca21731-c96b-42cb-b47b-d7f3b7d99d38 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:00.330737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca21731-c96b-42cb-b47b-d7f3b7d99d38 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:00.331014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca21731-c96b-42cb-b47b-d7f3b7d99d38 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:00.331655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca21731-c96b-42cb-b47b-d7f3b7d99d38 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:00.333031 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca21731-c96b-42cb-b47b-d7f3b7d99d38 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:00.333684 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28475a3f-19b5-4fdf-8467-fa529fb34e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:00.335269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28475a3f-19b5-4fdf-8467-fa529fb34e00 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:00.348816 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 465/907] 10.222.0.76 () {60 vars in 1141 bytes} [Fri Aug 26 08:40:00 2022] POST /identity/v3/services => generated 241 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:40:00.350077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670fc02-fd49-4c16-92ca-f670891f8c3a None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:00.350364 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670fc02-fd49-4c16-92ca-f670891f8c3a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:00.350639 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670fc02-fd49-4c16-92ca-f670891f8c3a None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:00.351837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 466/908] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-28475a3f-19b5-4fdf-8467-fa529fb34e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:40:00.352184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:00.353174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:40:00.354112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:40:00.354112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:00.354112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:00.358274 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 443/909] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:00.359474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670fc02-fd49-4c16-92ca-f670891f8c3a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:00.367162 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4e6bd-9974-45fe-b6e2-a85237b97e8b None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:00.367530 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4e6bd-9974-45fe-b6e2-a85237b97e8b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:00.367805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4e6bd-9974-45fe-b6e2-a85237b97e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:00.389881 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-87a4e6bd-9974-45fe-b6e2-a85237b97e8b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:00.391458 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-87a4e6bd-9974-45fe-b6e2-a85237b97e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:00.477460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:00.493418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 444/910] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:40:00.503976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670fc02-fd49-4c16-92ca-f670891f8c3a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:00.537555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3494e9c-6923-4e5e-b8fe-cd08d06d0e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:00.538164 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3494e9c-6923-4e5e-b8fe-cd08d06d0e8e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:00.538449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3494e9c-6923-4e5e-b8fe-cd08d06d0e8e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:00.538720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3494e9c-6923-4e5e-b8fe-cd08d06d0e8e None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:00.539355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3494e9c-6923-4e5e-b8fe-cd08d06d0e8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:00.539656 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3494e9c-6923-4e5e-b8fe-cd08d06d0e8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:00.541033 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3494e9c-6923-4e5e-b8fe-cd08d06d0e8e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:00.553099 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 467/911] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:00.559169 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4e6bd-9974-45fe-b6e2-a85237b97e8b None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:00.624725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:00.663199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4e6bd-9974-45fe-b6e2-a85237b97e8b None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:00.699122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f48a3-65fc-4eee-80e8-fb2b094448d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:00.699753 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f48a3-65fc-4eee-80e8-fb2b094448d5 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:00.700035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f48a3-65fc-4eee-80e8-fb2b094448d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:00.700312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f48a3-65fc-4eee-80e8-fb2b094448d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:00.707122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f48a3-65fc-4eee-80e8-fb2b094448d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:00.708584 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f48a3-65fc-4eee-80e8-fb2b094448d5 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:00.719993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-928f48a3-65fc-4eee-80e8-fb2b094448d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:40:00.719993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:00.719993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:00.719993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:00.719993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:00.719993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:00.719993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:00.719993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:00.719993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:00.719993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:00.719993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:00.719993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:00.719993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:40:00.719993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:40:00.719993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:00.720918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:00.722430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:40:00.722430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:40:00.722430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:40:00.722430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:40:00.722430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:40:00.722430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:40:00.722430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:40:00.722430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:00.722430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 445/912] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:00.727169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3494e9c-6923-4e5e-b8fe-cd08d06d0e8e None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:00.779765 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f48a3-65fc-4eee-80e8-fb2b094448d5 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:00.832060 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3494e9c-6923-4e5e-b8fe-cd08d06d0e8e None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:00.868191 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992573c-b1bb-4350-80c0-9c52ce6a3e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:00.868799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992573c-b1bb-4350-80c0-9c52ce6a3e2b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:00.869105 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992573c-b1bb-4350-80c0-9c52ce6a3e2b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:00.869377 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992573c-b1bb-4350-80c0-9c52ce6a3e2b None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:00.870070 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992573c-b1bb-4350-80c0-9c52ce6a3e2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:00.870370 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992573c-b1bb-4350-80c0-9c52ce6a3e2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:00.872371 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992573c-b1bb-4350-80c0-9c52ce6a3e2b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:00.879630 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:00.889050 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 468/913] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:40:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:00.893326 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992573c-b1bb-4350-80c0-9c52ce6a3e2b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:00.905424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f48a3-65fc-4eee-80e8-fb2b094448d5 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:00.931911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:00.944833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fab4c0-dba1-49a0-8c5d-501535c9f264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:00.945865 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fab4c0-dba1-49a0-8c5d-501535c9f264 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:00.946354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fab4c0-dba1-49a0-8c5d-501535c9f264 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:00.946829 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fab4c0-dba1-49a0-8c5d-501535c9f264 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:00.947711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fab4c0-dba1-49a0-8c5d-501535c9f264 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:00.949440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fab4c0-dba1-49a0-8c5d-501535c9f264 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-b3fab4c0-dba1-49a0-8c5d-501535c9f264 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:00.959080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:00.960104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:00.960979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:00.960979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:00.960979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:00.960979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:00.960979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:00.960979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:00.960979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:00.960979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:00.960979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:00.960979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:00.960979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:40:00.960979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:00.960979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 08:40:00.960979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:00.964192 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 446/914] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:40:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:00.970809 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fab4c0-dba1-49a0-8c5d-501535c9f264 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:01.006602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992573c-b1bb-4350-80c0-9c52ce6a3e2b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:01.043635 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152558f-bd09-43f5-854d-1812ac15e78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:01.044186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152558f-bd09-43f5-854d-1812ac15e78b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:01.044457 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152558f-bd09-43f5-854d-1812ac15e78b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:01.044722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152558f-bd09-43f5-854d-1812ac15e78b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:01.045585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152558f-bd09-43f5-854d-1812ac15e78b None admin] RBAC: Adding query filter params (role.id=75a13a03465940de85c2cbbcc2195510, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=c50a6fa776a849cfbb0173ce24616906) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:01.045895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152558f-bd09-43f5-854d-1812ac15e78b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:01.047429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152558f-bd09-43f5-854d-1812ac15e78b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:01.060371 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 469/915] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:40:00 2022] GET /identity/v3/role_assignments?user.id=c50a6fa776a849cfbb0173ce24616906&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=75a13a03465940de85c2cbbcc2195510 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:01.090334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fab4c0-dba1-49a0-8c5d-501535c9f264 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:01.127866 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e46a6-9be1-4ce6-8d3e-508794d3145a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:01.128537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e46a6-9be1-4ce6-8d3e-508794d3145a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:01.128818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e46a6-9be1-4ce6-8d3e-508794d3145a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:01.129115 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e46a6-9be1-4ce6-8d3e-508794d3145a None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:01.129885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e46a6-9be1-4ce6-8d3e-508794d3145a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:01.130187 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e46a6-9be1-4ce6-8d3e-508794d3145a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:01.131557 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e46a6-9be1-4ce6-8d3e-508794d3145a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:01.137608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 447/916] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:40:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:01.143406 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152558f-bd09-43f5-854d-1812ac15e78b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:01.213529 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:01.254829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152558f-bd09-43f5-854d-1812ac15e78b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:01.289938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346af7b-f748-4a34-987d-3459a742fe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:01.290540 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346af7b-f748-4a34-987d-3459a742fe29 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:01.290819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346af7b-f748-4a34-987d-3459a742fe29 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:01.291091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346af7b-f748-4a34-987d-3459a742fe29 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:01.291715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346af7b-f748-4a34-987d-3459a742fe29 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:01.292015 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346af7b-f748-4a34-987d-3459a742fe29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:01.294131 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346af7b-f748-4a34-987d-3459a742fe29 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:01.299559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 470/917] 10.222.0.76 () {56 vars in 1114 bytes} [Fri Aug 26 08:40:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:01.305276 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e46a6-9be1-4ce6-8d3e-508794d3145a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:01.308492 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb0a16-ad09-403b-82c4-dad4803cb611 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:01.308782 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb0a16-ad09-403b-82c4-dad4803cb611 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:01.309094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb0a16-ad09-403b-82c4-dad4803cb611 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:01.310673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 471/918] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:01.315648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb95948-2748-4c6c-97c0-ae7cbed9f127 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:01.315937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb95948-2748-4c6c-97c0-ae7cbed9f127 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:01.316214 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb95948-2748-4c6c-97c0-ae7cbed9f127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:01.336023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-beb95948-2748-4c6c-97c0-ae7cbed9f127 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:01.337272 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-beb95948-2748-4c6c-97c0-ae7cbed9f127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:01.368676 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:01.410069 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 472/919] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:40:01.425195 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e46a6-9be1-4ce6-8d3e-508794d3145a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:01.461489 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a8c75-04f6-49bb-b82b-d9eb6ac5d014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:01.462105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a8c75-04f6-49bb-b82b-d9eb6ac5d014 None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:01.462390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a8c75-04f6-49bb-b82b-d9eb6ac5d014 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:01.462668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a8c75-04f6-49bb-b82b-d9eb6ac5d014 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:01.463346 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a8c75-04f6-49bb-b82b-d9eb6ac5d014 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:01.465016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a8c75-04f6-49bb-b82b-d9eb6ac5d014 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:01.489052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 448/920] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:40:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:40:01.691216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb95948-2748-4c6c-97c0-ae7cbed9f127 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:01.753141 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:01.800448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb95948-2748-4c6c-97c0-ae7cbed9f127 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:01.843781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d92e1-7a42-4867-b455-530457004906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:01.844424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d92e1-7a42-4867-b455-530457004906 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:01.844707 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d92e1-7a42-4867-b455-530457004906 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:01.844978 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d92e1-7a42-4867-b455-530457004906 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:01.845589 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d92e1-7a42-4867-b455-530457004906 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:01.846952 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d92e1-7a42-4867-b455-530457004906 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-5c6d92e1-7a42-4867-b455-530457004906 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:01.856734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:01.857717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:01.858628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:01.858628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:01.858628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:01.858628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:01.858628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:01.858628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:01.858628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:01.858628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:01.858628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:01.858628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:01.858628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:40:01.858628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:01.858628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 08:40:01.858628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:01.858628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 473/921] 10.222.0.76 () {56 vars in 1132 bytes} [Fri Aug 26 08:40:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:01.866603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a8c75-04f6-49bb-b82b-d9eb6ac5d014 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:01.973875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a8c75-04f6-49bb-b82b-d9eb6ac5d014 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:01.984466 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:02.011008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7447a5a-59cd-4803-a8c4-24ffe108b67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:02.011655 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7447a5a-59cd-4803-a8c4-24ffe108b67f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:02.011932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7447a5a-59cd-4803-a8c4-24ffe108b67f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:02.012204 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7447a5a-59cd-4803-a8c4-24ffe108b67f None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:02.012835 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7447a5a-59cd-4803-a8c4-24ffe108b67f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:02.013179 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7447a5a-59cd-4803-a8c4-24ffe108b67f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:02.014549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7447a5a-59cd-4803-a8c4-24ffe108b67f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:02.019701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 449/922] 10.222.0.76 () {56 vars in 1126 bytes} [Fri Aug 26 08:40:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:02.025321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d92e1-7a42-4867-b455-530457004906 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:02.128042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d92e1-7a42-4867-b455-530457004906 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:02.145736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:02.164701 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5a093-e33f-48ff-923c-87ff9fa37986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:02.165336 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5a093-e33f-48ff-923c-87ff9fa37986 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:02.165614 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5a093-e33f-48ff-923c-87ff9fa37986 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:02.165887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5a093-e33f-48ff-923c-87ff9fa37986 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:02.166516 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5a093-e33f-48ff-923c-87ff9fa37986 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:02.166819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5a093-e33f-48ff-923c-87ff9fa37986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:02.168780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5a093-e33f-48ff-923c-87ff9fa37986 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:02.174146 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 474/923] 10.222.0.76 () {56 vars in 1126 bytes} [Fri Aug 26 08:40:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:02.179734 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7447a5a-59cd-4803-a8c4-24ffe108b67f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:02.281633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7447a5a-59cd-4803-a8c4-24ffe108b67f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:02.320286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09bf49-841b-407b-a152-149110e05a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:02.320776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09bf49-841b-407b-a152-149110e05a21 None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:02.321102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09bf49-841b-407b-a152-149110e05a21 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:02.321383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09bf49-841b-407b-a152-149110e05a21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:02.322075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09bf49-841b-407b-a152-149110e05a21 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:02.323476 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09bf49-841b-407b-a152-149110e05a21 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:02.347464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 450/924] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:40:02 2022] POST /identity/v3/endpoints => generated 347 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:40:02.404092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea8a3f-196b-4199-8e4c-1bfe8f1497fc None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:02.404603 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea8a3f-196b-4199-8e4c-1bfe8f1497fc None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:02.404603 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea8a3f-196b-4199-8e4c-1bfe8f1497fc None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:02.406280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 475/925] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:02.412022 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6bd68-0fe7-4e2a-ba0f-640d95e0ddd4 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:02.412632 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6bd68-0fe7-4e2a-ba0f-640d95e0ddd4 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:02.413151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6bd68-0fe7-4e2a-ba0f-640d95e0ddd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:02.434982 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-0ae6bd68-0fe7-4e2a-ba0f-640d95e0ddd4 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:02.436554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0ae6bd68-0fe7-4e2a-ba0f-640d95e0ddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:02.462699 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:02.525113 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 451/926] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:02.798837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea8a3f-196b-4199-8e4c-1bfe8f1497fc None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:02.909162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea8a3f-196b-4199-8e4c-1bfe8f1497fc None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:02.944012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632eb33-b751-4ea5-9e9a-0edc2cf61f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:02.945083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632eb33-b751-4ea5-9e9a-0edc2cf61f4e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:02.945641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632eb33-b751-4ea5-9e9a-0edc2cf61f4e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:02.946121 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632eb33-b751-4ea5-9e9a-0edc2cf61f4e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:02.946928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632eb33-b751-4ea5-9e9a-0edc2cf61f4e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:02.948512 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632eb33-b751-4ea5-9e9a-0edc2cf61f4e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-4632eb33-b751-4ea5-9e9a-0edc2cf61f4e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:02.958695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:02.959695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:02.960558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:02.960558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:02.960558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:02.960558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:02.960558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:02.960558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:02.960558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:02.960558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:02.960558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:02.960558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:02.960558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:40:02.960558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:02.960558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 08:40:02.960558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:02.963319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 476/927] 10.222.0.76 () {56 vars in 1126 bytes} [Fri Aug 26 08:40:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:02.970030 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6bd68-0fe7-4e2a-ba0f-640d95e0ddd4 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:03.072650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6bd68-0fe7-4e2a-ba0f-640d95e0ddd4 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:03.108192 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bb692-7914-42d2-8724-41ce4cd45c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:03.108796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bb692-7914-42d2-8724-41ce4cd45c75 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:03.109101 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bb692-7914-42d2-8724-41ce4cd45c75 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:03.109372 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bb692-7914-42d2-8724-41ce4cd45c75 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:03.110000 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bb692-7914-42d2-8724-41ce4cd45c75 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:03.110300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bb692-7914-42d2-8724-41ce4cd45c75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:03.111648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bb692-7914-42d2-8724-41ce4cd45c75 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:03.116796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 452/928] 10.222.0.76 () {56 vars in 1122 bytes} [Fri Aug 26 08:40:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:03.122562 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632eb33-b751-4ea5-9e9a-0edc2cf61f4e None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:03.174081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:03.233454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632eb33-b751-4ea5-9e9a-0edc2cf61f4e None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:03.238979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345d78e-92bf-412c-abb8-4ee6c94fe349 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:03.239505 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345d78e-92bf-412c-abb8-4ee6c94fe349 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:03.239993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345d78e-92bf-412c-abb8-4ee6c94fe349 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:03.245272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 453/929] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:40:03.247414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016443eb-a6ff-425a-921c-3183765c671e None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:03.247927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016443eb-a6ff-425a-921c-3183765c671e None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:03.248430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016443eb-a6ff-425a-921c-3183765c671e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:03.266762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-016443eb-a6ff-425a-921c-3183765c671e None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:03.268321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-016443eb-a6ff-425a-921c-3183765c671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:03.272480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6bf14-c235-4c62-bd8a-f64bd773da8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:03.273121 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6bf14-c235-4c62-bd8a-f64bd773da8f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:03.273407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6bf14-c235-4c62-bd8a-f64bd773da8f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:03.273684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6bf14-c235-4c62-bd8a-f64bd773da8f None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:03.274319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6bf14-c235-4c62-bd8a-f64bd773da8f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:03.274627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6bf14-c235-4c62-bd8a-f64bd773da8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:03.275984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6bf14-c235-4c62-bd8a-f64bd773da8f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:03.285948 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 477/930] 10.222.0.76 () {56 vars in 1122 bytes} [Fri Aug 26 08:40:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:03.287514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6bf14-c235-4c62-bd8a-f64bd773da8f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:03.287687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:03.365545 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 454/931] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:40:03.404081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6bf14-c235-4c62-bd8a-f64bd773da8f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:03.414093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:03.442021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdea7d-1837-4340-b2df-67a7dfab2ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:03.442630 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdea7d-1837-4340-b2df-67a7dfab2ddb None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:03.442912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdea7d-1837-4340-b2df-67a7dfab2ddb None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:03.443182 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdea7d-1837-4340-b2df-67a7dfab2ddb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:03.443943 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdea7d-1837-4340-b2df-67a7dfab2ddb None admin] RBAC: Adding query filter params (interface=public, service_id=23d5168b3d9f4ba199ddd54306d512e4, region_id=RegionOne) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:03.444314 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdea7d-1837-4340-b2df-67a7dfab2ddb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:03.445757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdea7d-1837-4340-b2df-67a7dfab2ddb None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:03.451938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 478/932] 10.222.0.76 () {56 vars in 1251 bytes} [Fri Aug 26 08:40:03 2022] GET /identity/v3/endpoints?service_id=23d5168b3d9f4ba199ddd54306d512e4&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:03.457292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016443eb-a6ff-425a-921c-3183765c671e None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:03.483089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb625967-e1b6-4553-ae72-dbea636c6bf3 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:03.483435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb625967-e1b6-4553-ae72-dbea636c6bf3 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:03.483647 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb625967-e1b6-4553-ae72-dbea636c6bf3 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:03.485343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 479/933] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:03.497596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f1e8e-e842-4f6f-8a60-3521fb3d258e None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:03.497878 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f1e8e-e842-4f6f-8a60-3521fb3d258e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:03.498237 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f1e8e-e842-4f6f-8a60-3521fb3d258e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:03.518702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-093f1e8e-e842-4f6f-8a60-3521fb3d258e None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:03.520200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-093f1e8e-e842-4f6f-8a60-3521fb3d258e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:03.585439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016443eb-a6ff-425a-921c-3183765c671e None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:03.603526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 480/934] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:03.630969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578654a-a490-4667-a74c-e065a4520ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:03.631519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578654a-a490-4667-a74c-e065a4520ba4 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:03.631799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578654a-a490-4667-a74c-e065a4520ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:03.632084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578654a-a490-4667-a74c-e065a4520ba4 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:03.632680 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578654a-a490-4667-a74c-e065a4520ba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:03.634090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578654a-a490-4667-a74c-e065a4520ba4 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:03.640448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 455/935] 10.222.0.76 () {56 vars in 1087 bytes} [Fri Aug 26 08:40:03 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:40:03.640737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f1e8e-e842-4f6f-8a60-3521fb3d258e None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:03.754883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f1e8e-e842-4f6f-8a60-3521fb3d258e None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:03.756610 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:03.792246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66fc5a-5f1b-4ee7-a3fd-33290637f9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:03.793444 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66fc5a-5f1b-4ee7-a3fd-33290637f9fd None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:03.793732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66fc5a-5f1b-4ee7-a3fd-33290637f9fd None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:03.794005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66fc5a-5f1b-4ee7-a3fd-33290637f9fd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:03.804898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66fc5a-5f1b-4ee7-a3fd-33290637f9fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-3a66fc5a-5f1b-4ee7-a3fd-33290637f9fd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:40:03.810256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:03.811271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:03.812854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:03.812854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:03.812854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:03.812854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:03.812854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:40:03.812854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:40:03.812854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:40:03.812854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:40:03.812854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:40:03.812854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:40:03.812854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 08:40:03.812854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:03.812854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 481/936] 10.222.0.76 () {56 vars in 1120 bytes} [Fri Aug 26 08:40:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:03.818097 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578654a-a490-4667-a74c-e065a4520ba4 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:03.833826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:03.880378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66fc5a-5f1b-4ee7-a3fd-33290637f9fd None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:03.936324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578654a-a490-4667-a74c-e065a4520ba4 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:03.978109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32352f8-565d-4df0-b18f-30f8a37d46c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:03.979409 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32352f8-565d-4df0-b18f-30f8a37d46c5 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:03.980445 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32352f8-565d-4df0-b18f-30f8a37d46c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:03.981137 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32352f8-565d-4df0-b18f-30f8a37d46c5 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:03.981961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32352f8-565d-4df0-b18f-30f8a37d46c5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:03.982674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32352f8-565d-4df0-b18f-30f8a37d46c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:03.984905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32352f8-565d-4df0-b18f-30f8a37d46c5 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:03.997732 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 456/937] 10.222.0.76 () {56 vars in 1115 bytes} [Fri Aug 26 08:40:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:04.006541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32352f8-565d-4df0-b18f-30f8a37d46c5 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:04.007369 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66fc5a-5f1b-4ee7-a3fd-33290637f9fd None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:04.048611 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52cf3b-d541-486e-b19c-6de85ccff71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:04.049612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52cf3b-d541-486e-b19c-6de85ccff71f None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:04.050120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52cf3b-d541-486e-b19c-6de85ccff71f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:04.050623 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52cf3b-d541-486e-b19c-6de85ccff71f None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:04.051463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52cf3b-d541-486e-b19c-6de85ccff71f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:04.053140 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52cf3b-d541-486e-b19c-6de85ccff71f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:04.055973 dv-cinder-852364-5-smb devstack@keystone.service[87893]: WARNING keystone.server.flask.common [None req-5f52cf3b-d541-486e-b19c-6de85ccff71f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 26 08:40:04.074252 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.sql.core [None req-5f52cf3b-d541-486e-b19c-6de85ccff71f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 08:40:04.074252 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 08:40:04.074252 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [parameters: {'id': 'aea17c695f924558836798e2a784b20c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 08:40:04.074252 dv-cinder-852364-5-smb devstack@keystone.service[87893]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87893) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 08:40:04.084335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-5f52cf3b-d541-486e-b19c-6de85ccff71f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aea17c695f924558836798e2a784b20c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aea17c695f924558836798e2a784b20c. Aug 26 08:40:04.084335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:04.084335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 08:40:04.084335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 08:40:04.084335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 08:40:04.084335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 08:40:04.084335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 08:40:04.084335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 08:40:04.084335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 08:40:04.084335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application conn.query(q) Aug 26 08:40:04.084335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 08:40:04.084335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 08:40:04.084335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application result.read() Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 26 08:40:04.085368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application next(self.gen) Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application yield resource Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application next(self.gen) Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise self.value Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application session.commit() Aug 26 08:40:04.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self.session.flush() Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application compat.raise_( Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 08:40:04.087687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 08:40:04.088817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 08:40:04.088817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 08:40:04.088817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 08:40:04.088817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 08:40:04.088817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 08:40:04.088817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 08:40:04.088817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 08:40:04.088817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 08:40:04.088817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 08:40:04.088817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 08:40:04.088817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 08:40:04.088817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 08:40:04.088817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 08:40:04.088817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 08:40:04.088817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application conn.query(q) Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application result.read() Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 08:40:04.090629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 08:40:04.091740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 08:40:04.091740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 08:40:04.091740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 08:40:04.091740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 08:40:04.091740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 08:40:04.091740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 08:40:04.091740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 08:40:04.091740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 08:40:04.091740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [parameters: {'id': 'aea17c695f924558836798e2a784b20c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 08:40:04.091740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 08:40:04.091740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:04.091740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:04.091740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:04.091740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:04.091740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:04.092755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:04.093977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:04.093977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 26 08:40:04.093977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 26 08:40:04.093977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:04.093977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:04.093977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 26 08:40:04.093977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 26 08:40:04.093977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aea17c695f924558836798e2a784b20c. Aug 26 08:40:04.093977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:04.096879 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 482/938] 10.222.0.76 () {60 vars in 1140 bytes} [Fri Aug 26 08:40:03 2022] POST /identity/v3/projects => generated 262 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:04.103946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52cf3b-d541-486e-b19c-6de85ccff71f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:04.112354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:04.128970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:04.145271 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32352f8-565d-4df0-b18f-30f8a37d46c5 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:04.189610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a850-a2f0-4adb-b6cb-efc195213eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:04.190220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a850-a2f0-4adb-b6cb-efc195213eef None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:04.190512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a850-a2f0-4adb-b6cb-efc195213eef None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:04.190789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a850-a2f0-4adb-b6cb-efc195213eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:04.205874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68a850-a2f0-4adb-b6cb-efc195213eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:04.207339 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68a850-a2f0-4adb-b6cb-efc195213eef None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-1c68a850-a2f0-4adb-b6cb-efc195213eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:40:04.223279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:04.224298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:40:04.225292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:40:04.225292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:04.225292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:04.225478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52cf3b-d541-486e-b19c-6de85ccff71f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:04.227685 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 457/939] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:04.233229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a850-a2f0-4adb-b6cb-efc195213eef None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:04.269047 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408eca8-c982-4bc0-bde4-aeeddc5f1174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:04.270519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408eca8-c982-4bc0-bde4-aeeddc5f1174 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:04.271215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408eca8-c982-4bc0-bde4-aeeddc5f1174 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:04.271689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408eca8-c982-4bc0-bde4-aeeddc5f1174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:04.280434 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408eca8-c982-4bc0-bde4-aeeddc5f1174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:04.282754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408eca8-c982-4bc0-bde4-aeeddc5f1174 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:04.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-d408eca8-c982-4bc0-bde4-aeeddc5f1174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:40:04.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:04.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:04.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:04.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:04.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:04.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:04.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:04.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:04.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:04.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:04.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:04.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:40:04.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:40:04.297567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:04.298670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:04.299750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:40:04.299750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:40:04.299750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:40:04.299750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:40:04.299750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:40:04.299750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:40:04.299750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:40:04.299750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:04.307191 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 483/940] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:04.307816 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408eca8-c982-4bc0-bde4-aeeddc5f1174 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:04.357814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a850-a2f0-4adb-b6cb-efc195213eef None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:04.385935 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:04.395830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:04.396661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ce83e-886f-4c4e-bd45-fe3d81cb5805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:04.397396 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ce83e-886f-4c4e-bd45-fe3d81cb5805 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:04.397775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ce83e-886f-4c4e-bd45-fe3d81cb5805 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:04.398201 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ce83e-886f-4c4e-bd45-fe3d81cb5805 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:04.398920 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ce83e-886f-4c4e-bd45-fe3d81cb5805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:04.399295 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ce83e-886f-4c4e-bd45-fe3d81cb5805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:04.400752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ce83e-886f-4c4e-bd45-fe3d81cb5805 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:04.417076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 458/941] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:04.417076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40003f08-c0e4-4de6-8c9a-6ae6002418f8 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:04.417076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40003f08-c0e4-4de6-8c9a-6ae6002418f8 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:04.417076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40003f08-c0e4-4de6-8c9a-6ae6002418f8 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:04.420350 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 459/942] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:04.421111 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40003f08-c0e4-4de6-8c9a-6ae6002418f8 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:04.424931 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408eca8-c982-4bc0-bde4-aeeddc5f1174 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:04.460921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26aeb36-4c4e-4939-b270-33b0dfea860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:04.461495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aeb36-4c4e-4939-b270-33b0dfea860a None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:04.461789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aeb36-4c4e-4939-b270-33b0dfea860a None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:04.462068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aeb36-4c4e-4939-b270-33b0dfea860a None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:04.462729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26aeb36-4c4e-4939-b270-33b0dfea860a None admin] RBAC: Adding query filter params (name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:04.463038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26aeb36-4c4e-4939-b270-33b0dfea860a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:04.464797 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26aeb36-4c4e-4939-b270-33b0dfea860a None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:04.486409 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 484/943] 10.222.0.76 () {56 vars in 1112 bytes} [Fri Aug 26 08:40:04 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:04.487649 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be2c9a-4617-430b-93a5-1b3500ca8a6c None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:04.487940 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be2c9a-4617-430b-93a5-1b3500ca8a6c None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:04.488220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be2c9a-4617-430b-93a5-1b3500ca8a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:04.511596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-e8be2c9a-4617-430b-93a5-1b3500ca8a6c None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:04.513896 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e8be2c9a-4617-430b-93a5-1b3500ca8a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:04.544430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40003f08-c0e4-4de6-8c9a-6ae6002418f8 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:04.584816 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee310552-c5fe-458b-9a0e-1b71f36808f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:04.585858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310552-c5fe-458b-9a0e-1b71f36808f0 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:04.586326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310552-c5fe-458b-9a0e-1b71f36808f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:04.586792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310552-c5fe-458b-9a0e-1b71f36808f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:04.596122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee310552-c5fe-458b-9a0e-1b71f36808f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:04.597931 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee310552-c5fe-458b-9a0e-1b71f36808f0 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:04.601562 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 485/944] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-ee310552-c5fe-458b-9a0e-1b71f36808f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:40:04.614741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:04.615794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:04.616761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:04.616761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:04.616761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:40:04.616761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:40:04.616761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:40:04.616761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:40:04.616761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:40:04.616761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:40:04.616761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 08:40:04.616761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:04.619258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 460/945] 10.222.0.76 () {56 vars in 1117 bytes} [Fri Aug 26 08:40:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:04.630404 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be2c9a-4617-430b-93a5-1b3500ca8a6c None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:04.704056 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:04.741370 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be2c9a-4617-430b-93a5-1b3500ca8a6c None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:04.776479 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2fd4c-1abf-469d-bf22-4ee293060142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:04.777663 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2fd4c-1abf-469d-bf22-4ee293060142 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:04.777953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2fd4c-1abf-469d-bf22-4ee293060142 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:04.778229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2fd4c-1abf-469d-bf22-4ee293060142 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:04.778960 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2fd4c-1abf-469d-bf22-4ee293060142 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:04.779269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2fd4c-1abf-469d-bf22-4ee293060142 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:04.780705 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2fd4c-1abf-469d-bf22-4ee293060142 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:04.799687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 486/946] 10.222.0.76 () {56 vars in 1149 bytes} [Fri Aug 26 08:40:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:04.805600 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee310552-c5fe-458b-9a0e-1b71f36808f0 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:04.857694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:04.878342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2fd4c-1abf-469d-bf22-4ee293060142 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:04.919259 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee310552-c5fe-458b-9a0e-1b71f36808f0 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:04.954881 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21254d85-b5a4-4ae4-8e81-94255c3d5c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:04.955518 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21254d85-b5a4-4ae4-8e81-94255c3d5c4f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:04.955802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21254d85-b5a4-4ae4-8e81-94255c3d5c4f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:04.956083 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21254d85-b5a4-4ae4-8e81-94255c3d5c4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:04.968520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21254d85-b5a4-4ae4-8e81-94255c3d5c4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:04.970055 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21254d85-b5a4-4ae4-8e81-94255c3d5c4f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-21254d85-b5a4-4ae4-8e81-94255c3d5c4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:40:04.985343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:04.986322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:40:04.987237 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:40:04.987237 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:04.987237 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:04.987237 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 461/947] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:04.988556 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2fd4c-1abf-469d-bf22-4ee293060142 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:04.992525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21254d85-b5a4-4ae4-8e81-94255c3d5c4f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:05.017413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:05.025025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3b812-1287-4952-a7d9-cf458c7542c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:05.025950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3b812-1287-4952-a7d9-cf458c7542c7 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:05.026457 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3b812-1287-4952-a7d9-cf458c7542c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:05.027534 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3b812-1287-4952-a7d9-cf458c7542c7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:05.028323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3b812-1287-4952-a7d9-cf458c7542c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:05.029917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3b812-1287-4952-a7d9-cf458c7542c7 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-97b3b812-1287-4952-a7d9-cf458c7542c7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:05.039266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:05.040310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:05.041317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:05.041317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:05.041317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:05.041317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:05.041317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:05.041317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:05.041317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:05.041317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:05.041317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:05.041317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:05.041317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:40:05.041317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:05.041317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 08:40:05.041317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:05.049021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 487/948] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:40:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:05.050011 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3b812-1287-4952-a7d9-cf458c7542c7 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:05.100800 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:05.105703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21254d85-b5a4-4ae4-8e81-94255c3d5c4f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:05.143248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64255e5f-3cda-4c7a-84be-90cb8553a8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:05.144548 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64255e5f-3cda-4c7a-84be-90cb8553a8af None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:05.145031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64255e5f-3cda-4c7a-84be-90cb8553a8af None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:05.145454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64255e5f-3cda-4c7a-84be-90cb8553a8af None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:05.146368 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64255e5f-3cda-4c7a-84be-90cb8553a8af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:05.146863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64255e5f-3cda-4c7a-84be-90cb8553a8af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:05.148472 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64255e5f-3cda-4c7a-84be-90cb8553a8af None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:05.155090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3b812-1287-4952-a7d9-cf458c7542c7 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:05.167828 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 462/949] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:05.168978 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64255e5f-3cda-4c7a-84be-90cb8553a8af None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:05.189641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29066096-a825-49ef-932c-c6441a881863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:05.190351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29066096-a825-49ef-932c-c6441a881863 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:05.190679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29066096-a825-49ef-932c-c6441a881863 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:05.191028 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29066096-a825-49ef-932c-c6441a881863 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:05.191815 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29066096-a825-49ef-932c-c6441a881863 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:05.192189 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29066096-a825-49ef-932c-c6441a881863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:05.193649 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29066096-a825-49ef-932c-c6441a881863 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:05.203808 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 488/950] 10.222.0.76 () {56 vars in 1112 bytes} [Fri Aug 26 08:40:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:05.204740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29066096-a825-49ef-932c-c6441a881863 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:05.279570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64255e5f-3cda-4c7a-84be-90cb8553a8af None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:05.301613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:05.314029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29066096-a825-49ef-932c-c6441a881863 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:05.320375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94573c-47da-412f-8c18-8c257f0351e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:05.321359 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94573c-47da-412f-8c18-8c257f0351e7 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:05.321872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94573c-47da-412f-8c18-8c257f0351e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:05.322351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94573c-47da-412f-8c18-8c257f0351e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:05.330575 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94573c-47da-412f-8c18-8c257f0351e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:05.332583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94573c-47da-412f-8c18-8c257f0351e7 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:05.345224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-ab94573c-47da-412f-8c18-8c257f0351e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:40:05.345224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:05.345224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:05.345224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:05.345224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:05.345224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:05.345224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:05.345224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:05.345224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:05.345224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:05.345224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:05.345224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:05.345224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:40:05.345224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:40:05.345224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:05.346129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:05.347072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:40:05.347072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:40:05.347072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:40:05.347072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:40:05.347072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:40:05.347072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:40:05.347072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:40:05.347072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:05.354147 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c3ff2-f27f-4d8d-a1b3-74c655cef834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:05.354442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 463/951] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:40:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:05.354853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c3ff2-f27f-4d8d-a1b3-74c655cef834 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:05.355141 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c3ff2-f27f-4d8d-a1b3-74c655cef834 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:05.355418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c3ff2-f27f-4d8d-a1b3-74c655cef834 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:05.356041 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c3ff2-f27f-4d8d-a1b3-74c655cef834 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:05.356350 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c3ff2-f27f-4d8d-a1b3-74c655cef834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:05.356653 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94573c-47da-412f-8c18-8c257f0351e7 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:05.357841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c3ff2-f27f-4d8d-a1b3-74c655cef834 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:05.362513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 489/952] 10.222.0.76 () {56 vars in 1112 bytes} [Fri Aug 26 08:40:05 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:05.379363 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:05.474397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94573c-47da-412f-8c18-8c257f0351e7 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:05.513381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dd7dd-e639-4b72-8872-e9f0a8a37a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:05.514403 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dd7dd-e639-4b72-8872-e9f0a8a37a46 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:05.514893 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dd7dd-e639-4b72-8872-e9f0a8a37a46 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:05.515370 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dd7dd-e639-4b72-8872-e9f0a8a37a46 None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:05.516268 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dd7dd-e639-4b72-8872-e9f0a8a37a46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:05.516798 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dd7dd-e639-4b72-8872-e9f0a8a37a46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:05.518448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dd7dd-e639-4b72-8872-e9f0a8a37a46 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:05.531708 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 464/953] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:40:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:05.537992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c3ff2-f27f-4d8d-a1b3-74c655cef834 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:05.654603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f6471-d38a-441b-b756-f55623652f64 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:05.655264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f6471-d38a-441b-b756-f55623652f64 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:05.655745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f6471-d38a-441b-b756-f55623652f64 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:05.657549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 465/954] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:05.660961 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c3ff2-f27f-4d8d-a1b3-74c655cef834 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:05.663292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4622a88-cba3-4586-b647-27c543d844fd None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:05.663797 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4622a88-cba3-4586-b647-27c543d844fd None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:05.664280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4622a88-cba3-4586-b647-27c543d844fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:05.679632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:05.683451 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-b4622a88-cba3-4586-b647-27c543d844fd None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:05.684944 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b4622a88-cba3-4586-b647-27c543d844fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:05.700253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dff231-28a6-46ab-9e6e-0e1163a7f4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:05.700919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dff231-28a6-46ab-9e6e-0e1163a7f4d0 None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:05.701229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dff231-28a6-46ab-9e6e-0e1163a7f4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:05.701506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dff231-28a6-46ab-9e6e-0e1163a7f4d0 None admin] PATH_INFO: `/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/c50a6fa776a849cfbb0173ce24616906/roles/75a13a03465940de85c2cbbcc2195510` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:05.703882 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dff231-28a6-46ab-9e6e-0e1163a7f4d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=35aafba89a1d47cd86cef1eb0a11e507, user_id=c50a6fa776a849cfbb0173ce24616906, role_id=75a13a03465940de85c2cbbcc2195510)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:05.705360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dff231-28a6-46ab-9e6e-0e1163a7f4d0 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:05.729552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 490/955] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:40:05 2022] PUT /identity/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/c50a6fa776a849cfbb0173ce24616906/roles/75a13a03465940de85c2cbbcc2195510 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:40:05.773196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 466/956] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:40:06.050428 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dff231-28a6-46ab-9e6e-0e1163a7f4d0 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:06.155959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dff231-28a6-46ab-9e6e-0e1163a7f4d0 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:06.192239 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfe7dd-e79f-4ebb-8641-05c8c451a9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:06.192881 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfe7dd-e79f-4ebb-8641-05c8c451a9b0 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:06.193190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfe7dd-e79f-4ebb-8641-05c8c451a9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:06.193469 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfe7dd-e79f-4ebb-8641-05c8c451a9b0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:06.194058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfe7dd-e79f-4ebb-8641-05c8c451a9b0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:06.195427 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfe7dd-e79f-4ebb-8641-05c8c451a9b0 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-68cfe7dd-e79f-4ebb-8641-05c8c451a9b0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:06.204509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:06.205679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:06.206593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:06.206593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:06.206593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:06.206593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:06.206593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:06.206593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:06.206593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:06.206593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:06.206593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:06.206593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:06.206593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:40:06.206593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:06.206593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 08:40:06.206593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:06.206593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 491/957] 10.222.0.76 () {56 vars in 1126 bytes} [Fri Aug 26 08:40:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:06.213924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4622a88-cba3-4586-b647-27c543d844fd None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:06.225895 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:06.319530 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4622a88-cba3-4586-b647-27c543d844fd None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:06.355703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91261015-7608-4c53-88a2-58e1b6725554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:06.356775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91261015-7608-4c53-88a2-58e1b6725554 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:06.357303 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91261015-7608-4c53-88a2-58e1b6725554 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:06.357784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91261015-7608-4c53-88a2-58e1b6725554 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:06.358636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91261015-7608-4c53-88a2-58e1b6725554 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:06.359152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91261015-7608-4c53-88a2-58e1b6725554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:06.360718 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91261015-7608-4c53-88a2-58e1b6725554 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:06.366270 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 467/958] 10.222.0.76 () {56 vars in 1122 bytes} [Fri Aug 26 08:40:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:06.371555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfe7dd-e79f-4ebb-8641-05c8c451a9b0 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:06.418872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:06.478077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfe7dd-e79f-4ebb-8641-05c8c451a9b0 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:06.515140 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a2c83-530b-47a7-857b-bcbd5d391cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:06.515760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a2c83-530b-47a7-857b-bcbd5d391cdd None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:06.516044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a2c83-530b-47a7-857b-bcbd5d391cdd None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:06.516323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a2c83-530b-47a7-857b-bcbd5d391cdd None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:06.516959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a2c83-530b-47a7-857b-bcbd5d391cdd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:06.517298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a2c83-530b-47a7-857b-bcbd5d391cdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:06.518658 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a2c83-530b-47a7-857b-bcbd5d391cdd None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:06.523868 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 492/959] 10.222.0.76 () {56 vars in 1122 bytes} [Fri Aug 26 08:40:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:06.530063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91261015-7608-4c53-88a2-58e1b6725554 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:06.558338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb326373-6745-4f56-80e0-e47960b897ff None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:06.558854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb326373-6745-4f56-80e0-e47960b897ff None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:06.558964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb326373-6745-4f56-80e0-e47960b897ff None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:06.560330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 493/960] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:40:06.566824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316a27c-20fc-4c7b-86c7-8a2b17a0af92 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:06.567354 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316a27c-20fc-4c7b-86c7-8a2b17a0af92 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:06.567842 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316a27c-20fc-4c7b-86c7-8a2b17a0af92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:06.596178 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0316a27c-20fc-4c7b-86c7-8a2b17a0af92 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:06.596178 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0316a27c-20fc-4c7b-86c7-8a2b17a0af92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:06.615769 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:06.655010 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91261015-7608-4c53-88a2-58e1b6725554 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:06.673123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 494/961] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:06.699076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21974a4-37b5-46b8-92ad-5a7c10b6dade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:06.699968 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21974a4-37b5-46b8-92ad-5a7c10b6dade None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:06.700479 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21974a4-37b5-46b8-92ad-5a7c10b6dade None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:06.700937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21974a4-37b5-46b8-92ad-5a7c10b6dade None admin] PATH_INFO: `/v3/endpoints` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:06.701849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21974a4-37b5-46b8-92ad-5a7c10b6dade None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:06.703488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21974a4-37b5-46b8-92ad-5a7c10b6dade None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:06.727170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 468/962] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:40:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:40:06.948850 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316a27c-20fc-4c7b-86c7-8a2b17a0af92 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:06.986321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:07.055593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316a27c-20fc-4c7b-86c7-8a2b17a0af92 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:07.097057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fd837-c84a-4c54-b5c2-d3767881c832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:07.097668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fd837-c84a-4c54-b5c2-d3767881c832 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:07.097952 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fd837-c84a-4c54-b5c2-d3767881c832 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:07.098225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fd837-c84a-4c54-b5c2-d3767881c832 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:07.098859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fd837-c84a-4c54-b5c2-d3767881c832 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:07.100360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fd837-c84a-4c54-b5c2-d3767881c832 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:07.117526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.sql.core [None req-111fd837-c84a-4c54-b5c2-d3767881c832 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 08:40:07.117526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 08:40:07.117526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [parameters: {'user_id': '2b9e92ebfd8a4884b78a106c8f3defdc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 08:40:07.117526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87893) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 08:40:07.124454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-111fd837-c84a-4c54-b5c2-d3767881c832 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 08:40:07.124454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:07.124454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 08:40:07.124454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 08:40:07.124454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 08:40:07.124454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 08:40:07.124454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 08:40:07.124454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 08:40:07.124454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 08:40:07.124454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application conn.query(q) Aug 26 08:40:07.124454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 08:40:07.124454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 08:40:07.124454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 08:40:07.124454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application result.read() Aug 26 08:40:07.124454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 08:40:07.125425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application next(self.gen) Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application yield resource Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application next(self.gen) Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise self.value Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application session.commit() Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 08:40:07.126429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self.session.flush() Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application compat.raise_( Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 08:40:07.127358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 08:40:07.128273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application conn.query(q) Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application result.read() Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 08:40:07.129171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 08:40:07.130038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 08:40:07.130038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 08:40:07.130038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 08:40:07.130038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 08:40:07.130038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 08:40:07.130038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 08:40:07.130038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [parameters: {'user_id': '2b9e92ebfd8a4884b78a106c8f3defdc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 08:40:07.130038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 08:40:07.130038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:07.130038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:07.130038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:07.130038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:07.130038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:07.130038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:07.130038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 26 08:40:07.130869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 26 08:40:07.131804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 26 08:40:07.131804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 26 08:40:07.131804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 08:40:07.131804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 08:40:07.131804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 08:40:07.131804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:07.131804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 495/963] 10.222.0.76 () {60 vars in 1131 bytes} [Fri Aug 26 08:40:06 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:07.132209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21974a4-37b5-46b8-92ad-5a7c10b6dade None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:07.245361 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21974a4-37b5-46b8-92ad-5a7c10b6dade None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:07.272921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:07.282662 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd3176-2cff-41bc-b8dd-22682e65ce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:07.283299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd3176-2cff-41bc-b8dd-22682e65ce36 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:07.283585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd3176-2cff-41bc-b8dd-22682e65ce36 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:07.283866 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd3176-2cff-41bc-b8dd-22682e65ce36 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:07.292861 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd3176-2cff-41bc-b8dd-22682e65ce36 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:07.294561 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd3176-2cff-41bc-b8dd-22682e65ce36 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-a1cd3176-2cff-41bc-b8dd-22682e65ce36 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:40:07.305947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:07.308142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:07.310441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:07.310441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:07.310441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:40:07.310441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:40:07.310441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:40:07.310441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:40:07.310441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:40:07.310441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:40:07.310441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 08:40:07.310441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:07.310441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 469/964] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:40:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:07.314766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fd837-c84a-4c54-b5c2-d3767881c832 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:07.373034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc15c23-0a99-410d-b9ae-1a6e221d8a13 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:07.373376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc15c23-0a99-410d-b9ae-1a6e221d8a13 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:07.373569 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc15c23-0a99-410d-b9ae-1a6e221d8a13 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:07.375024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 470/965] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:40:07.380104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b707b5-e353-4e8d-afd2-c247ab89d69d None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:07.380621 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b707b5-e353-4e8d-afd2-c247ab89d69d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:07.381145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b707b5-e353-4e8d-afd2-c247ab89d69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:07.399945 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-d1b707b5-e353-4e8d-afd2-c247ab89d69d None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:07.401509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d1b707b5-e353-4e8d-afd2-c247ab89d69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:07.424591 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:07.433553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fd837-c84a-4c54-b5c2-d3767881c832 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:07.474827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f0ef2-34c2-4f9b-885d-e8afccfffcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:07.475436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f0ef2-34c2-4f9b-885d-e8afccfffcaa None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:07.475722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f0ef2-34c2-4f9b-885d-e8afccfffcaa None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:07.476000 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f0ef2-34c2-4f9b-885d-e8afccfffcaa None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:07.476689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f0ef2-34c2-4f9b-885d-e8afccfffcaa None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:07.477016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f0ef2-34c2-4f9b-885d-e8afccfffcaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:07.483042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f0ef2-34c2-4f9b-885d-e8afccfffcaa None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:07.483572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 471/966] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:40:07.517480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 496/967] 10.222.0.76 () {56 vars in 1101 bytes} [Fri Aug 26 08:40:07 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:07.744522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db38048-883a-4075-a3c9-153299116145 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:07.744869 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db38048-883a-4075-a3c9-153299116145 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:07.745108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db38048-883a-4075-a3c9-153299116145 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:07.747263 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 472/968] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:07.752724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c2ccb-a4d9-40d2-815a-4ed41159f98a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:07.753228 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c2ccb-a4d9-40d2-815a-4ed41159f98a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:07.753308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c2ccb-a4d9-40d2-815a-4ed41159f98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:07.763196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db38048-883a-4075-a3c9-153299116145 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:07.773221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-a01c2ccb-a4d9-40d2-815a-4ed41159f98a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:07.774673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a01c2ccb-a4d9-40d2-815a-4ed41159f98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:07.847259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 497/969] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:07.866274 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db38048-883a-4075-a3c9-153299116145 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:07.883989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:07.903320 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07177eb-6641-448a-af80-0fed05c1dbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:07.903939 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07177eb-6641-448a-af80-0fed05c1dbcf None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:07.904219 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07177eb-6641-448a-af80-0fed05c1dbcf None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:07.904491 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07177eb-6641-448a-af80-0fed05c1dbcf None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:07.905175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07177eb-6641-448a-af80-0fed05c1dbcf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:07.906539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07177eb-6641-448a-af80-0fed05c1dbcf None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:07.922876 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 473/970] 10.222.0.76 () {60 vars in 1141 bytes} [Fri Aug 26 08:40:07 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:40:08.119771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c2ccb-a4d9-40d2-815a-4ed41159f98a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:08.200384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:08.219408 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c2ccb-a4d9-40d2-815a-4ed41159f98a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:08.260170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666fa8f-5dd9-4414-9c04-196e11502ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:08.260802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666fa8f-5dd9-4414-9c04-196e11502ccf None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:08.261208 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666fa8f-5dd9-4414-9c04-196e11502ccf None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:08.261479 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666fa8f-5dd9-4414-9c04-196e11502ccf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:08.271682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666fa8f-5dd9-4414-9c04-196e11502ccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-9666fa8f-5dd9-4414-9c04-196e11502ccf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:40:08.276359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:08.277520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:08.278382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:08.278382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:08.278382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:08.278382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:08.278382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:40:08.278382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:40:08.278382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:40:08.278382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:40:08.278382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:40:08.278382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:40:08.278382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 08:40:08.278382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:08.281071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 498/971] 10.222.0.76 () {56 vars in 1120 bytes} [Fri Aug 26 08:40:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:08.283745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07177eb-6641-448a-af80-0fed05c1dbcf None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:08.385138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07177eb-6641-448a-af80-0fed05c1dbcf None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:08.418372 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e143008-9408-4771-a0a7-8fc7ce476292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:08.418979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e143008-9408-4771-a0a7-8fc7ce476292 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:08.419255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e143008-9408-4771-a0a7-8fc7ce476292 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:08.419522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e143008-9408-4771-a0a7-8fc7ce476292 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:08.420179 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e143008-9408-4771-a0a7-8fc7ce476292 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:08.420477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e143008-9408-4771-a0a7-8fc7ce476292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:08.421848 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e143008-9408-4771-a0a7-8fc7ce476292 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:08.433444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 474/972] 10.222.0.76 () {56 vars in 1115 bytes} [Fri Aug 26 08:40:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:08.436744 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666fa8f-5dd9-4414-9c04-196e11502ccf None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:08.539291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666fa8f-5dd9-4414-9c04-196e11502ccf None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:08.576133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc090ed1-8b95-41c4-8d95-1815fcbba769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:08.576790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc090ed1-8b95-41c4-8d95-1815fcbba769 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:08.577097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc090ed1-8b95-41c4-8d95-1815fcbba769 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:08.577375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc090ed1-8b95-41c4-8d95-1815fcbba769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:08.590631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc090ed1-8b95-41c4-8d95-1815fcbba769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:08.591397 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:08.593245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc090ed1-8b95-41c4-8d95-1815fcbba769 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-dc090ed1-8b95-41c4-8d95-1815fcbba769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:40:08.609341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:08.610323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:40:08.611248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:40:08.611248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:08.611248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:08.613399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 499/973] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:08.616321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e143008-9408-4771-a0a7-8fc7ce476292 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:08.659777 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:08.720268 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e143008-9408-4771-a0a7-8fc7ce476292 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:08.730926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cea4d-edbf-487e-9205-f2ea7afeb011 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:08.731218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cea4d-edbf-487e-9205-f2ea7afeb011 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:08.731492 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cea4d-edbf-487e-9205-f2ea7afeb011 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:08.732958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 500/974] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:40:08.737624 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed848e46-d2c2-4fbc-a111-33ed6621ca99 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:08.737917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed848e46-d2c2-4fbc-a111-33ed6621ca99 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:08.738193 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed848e46-d2c2-4fbc-a111-33ed6621ca99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:08.755600 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-ed848e46-d2c2-4fbc-a111-33ed6621ca99 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:08.756231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db882c-ff6f-41e9-a109-4238c2066b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:08.756453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db882c-ff6f-41e9-a109-4238c2066b97 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:08.756703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db882c-ff6f-41e9-a109-4238c2066b97 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:08.756803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ed848e46-d2c2-4fbc-a111-33ed6621ca99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:08.756971 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db882c-ff6f-41e9-a109-4238c2066b97 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:08.757650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db882c-ff6f-41e9-a109-4238c2066b97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:08.757956 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db882c-ff6f-41e9-a109-4238c2066b97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:08.759316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db882c-ff6f-41e9-a109-4238c2066b97 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:08.771726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 475/975] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:08.777887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db882c-ff6f-41e9-a109-4238c2066b97 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:08.845035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 501/976] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:40:08.884650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:08.888662 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db882c-ff6f-41e9-a109-4238c2066b97 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:08.924291 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3badd-68b3-4bdf-96c2-6e394b773bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:08.924986 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3badd-68b3-4bdf-96c2-6e394b773bea None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:08.925393 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3badd-68b3-4bdf-96c2-6e394b773bea None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:08.925789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3badd-68b3-4bdf-96c2-6e394b773bea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:08.933195 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3badd-68b3-4bdf-96c2-6e394b773bea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:08.934730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3badd-68b3-4bdf-96c2-6e394b773bea None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-5ab3badd-68b3-4bdf-96c2-6e394b773bea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:40:08.946145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:08.947297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:08.949048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:08.949048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:08.949048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:40:08.949048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:40:08.949048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:40:08.949048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:40:08.949048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:40:08.949048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:40:08.949048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 08:40:08.949048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:08.955097 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 476/977] 10.222.0.76 () {56 vars in 1117 bytes} [Fri Aug 26 08:40:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:08.956293 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed848e46-d2c2-4fbc-a111-33ed6621ca99 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:09.060016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed848e46-d2c2-4fbc-a111-33ed6621ca99 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:09.079910 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:09.095343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4cde8-fa6d-45a7-a590-8feca81a291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:09.096009 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4cde8-fa6d-45a7-a590-8feca81a291e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:09.096353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4cde8-fa6d-45a7-a590-8feca81a291e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:09.096686 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4cde8-fa6d-45a7-a590-8feca81a291e None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:09.097496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4cde8-fa6d-45a7-a590-8feca81a291e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:09.097869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4cde8-fa6d-45a7-a590-8feca81a291e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:09.099342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4cde8-fa6d-45a7-a590-8feca81a291e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:09.116061 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 502/978] 10.222.0.76 () {56 vars in 1149 bytes} [Fri Aug 26 08:40:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:09.118951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3badd-68b3-4bdf-96c2-6e394b773bea None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:09.121387 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4cde8-fa6d-45a7-a590-8feca81a291e None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:09.227812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3badd-68b3-4bdf-96c2-6e394b773bea None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:09.243791 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4cde8-fa6d-45a7-a590-8feca81a291e None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:09.263906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c49a25-d69e-4fc2-afca-9a543eb7c6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:09.264533 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c49a25-d69e-4fc2-afca-9a543eb7c6e6 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:09.264816 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c49a25-d69e-4fc2-afca-9a543eb7c6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:09.265139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c49a25-d69e-4fc2-afca-9a543eb7c6e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:09.265728 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c49a25-d69e-4fc2-afca-9a543eb7c6e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:09.267093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c49a25-d69e-4fc2-afca-9a543eb7c6e6 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-96c49a25-d69e-4fc2-afca-9a543eb7c6e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:09.275691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:09.276880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:09.278534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:09.278534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:09.278534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:09.278534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:09.278534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:09.278534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:09.278534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:09.278534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:09.278534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:09.278534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:09.278534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:40:09.278534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:09.278534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 08:40:09.278534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:09.278534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 477/979] 10.222.0.76 () {56 vars in 1126 bytes} [Fri Aug 26 08:40:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:09.282562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c49a25-d69e-4fc2-afca-9a543eb7c6e6 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:09.283969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33386a8-8140-4ffc-953d-3e04fedfb326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:09.284582 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33386a8-8140-4ffc-953d-3e04fedfb326 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:09.284866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33386a8-8140-4ffc-953d-3e04fedfb326 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:09.285189 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33386a8-8140-4ffc-953d-3e04fedfb326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:09.310293 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:09.334578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:09.359501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33386a8-8140-4ffc-953d-3e04fedfb326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:09.361080 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33386a8-8140-4ffc-953d-3e04fedfb326 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:09.393833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c49a25-d69e-4fc2-afca-9a543eb7c6e6 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:09.429627 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db22415-9ce3-4c9b-98f1-146cd1f39b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:09.430241 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db22415-9ce3-4c9b-98f1-146cd1f39b09 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:09.430523 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db22415-9ce3-4c9b-98f1-146cd1f39b09 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:09.430799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db22415-9ce3-4c9b-98f1-146cd1f39b09 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:09.431486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db22415-9ce3-4c9b-98f1-146cd1f39b09 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:09.431797 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db22415-9ce3-4c9b-98f1-146cd1f39b09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:09.433758 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db22415-9ce3-4c9b-98f1-146cd1f39b09 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:09.443463 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 478/980] 10.222.0.76 () {56 vars in 1122 bytes} [Fri Aug 26 08:40:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:09.446216 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db22415-9ce3-4c9b-98f1-146cd1f39b09 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:09.463943 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 503/981] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:40:09 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 08:40:09.469843 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33386a8-8140-4ffc-953d-3e04fedfb326 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:09.544744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:09.552934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:09.560776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db22415-9ce3-4c9b-98f1-146cd1f39b09 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:09.580411 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33386a8-8140-4ffc-953d-3e04fedfb326 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:09.597787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025aef73-e1b8-4311-a227-58d3cafb93a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:09.598399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025aef73-e1b8-4311-a227-58d3cafb93a5 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:09.598850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025aef73-e1b8-4311-a227-58d3cafb93a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:09.599131 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025aef73-e1b8-4311-a227-58d3cafb93a5 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:09.600142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025aef73-e1b8-4311-a227-58d3cafb93a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:09.600635 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025aef73-e1b8-4311-a227-58d3cafb93a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:09.601998 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025aef73-e1b8-4311-a227-58d3cafb93a5 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:09.607612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 479/982] 10.222.0.76 () {56 vars in 1122 bytes} [Fri Aug 26 08:40:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:09.613053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025aef73-e1b8-4311-a227-58d3cafb93a5 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:09.623735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad112204-27dc-4152-84bb-a96ddc701910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:09.624667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad112204-27dc-4152-84bb-a96ddc701910 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:09.625128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad112204-27dc-4152-84bb-a96ddc701910 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:09.625704 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad112204-27dc-4152-84bb-a96ddc701910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:09.636880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad112204-27dc-4152-84bb-a96ddc701910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:09.638595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad112204-27dc-4152-84bb-a96ddc701910 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-ad112204-27dc-4152-84bb-a96ddc701910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:40:09.653748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:09.654714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:40:09.655613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:40:09.655613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:09.655613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:09.655613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 504/983] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:09.660558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad112204-27dc-4152-84bb-a96ddc701910 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:09.715437 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025aef73-e1b8-4311-a227-58d3cafb93a5 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:09.750619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835b07c-10b9-4ce9-b5ab-5529646bd186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:09.751230 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835b07c-10b9-4ce9-b5ab-5529646bd186 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:09.751514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835b07c-10b9-4ce9-b5ab-5529646bd186 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:09.751789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835b07c-10b9-4ce9-b5ab-5529646bd186 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:09.752508 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835b07c-10b9-4ce9-b5ab-5529646bd186 None admin] RBAC: Adding query filter params (interface=admin, service_id=23d5168b3d9f4ba199ddd54306d512e4, region_id=RegionOne) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:09.752839 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835b07c-10b9-4ce9-b5ab-5529646bd186 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:09.754205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835b07c-10b9-4ce9-b5ab-5529646bd186 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:09.759319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 480/984] 10.222.0.76 () {56 vars in 1249 bytes} [Fri Aug 26 08:40:09 2022] GET /identity/v3/endpoints?service_id=23d5168b3d9f4ba199ddd54306d512e4&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:09.764673 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835b07c-10b9-4ce9-b5ab-5529646bd186 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:09.777864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad112204-27dc-4152-84bb-a96ddc701910 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:09.783789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:09.814426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:09.820877 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73f69a-9760-404c-8477-7cbda787bf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:09.821520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73f69a-9760-404c-8477-7cbda787bf24 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:09.821803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73f69a-9760-404c-8477-7cbda787bf24 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:09.822076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73f69a-9760-404c-8477-7cbda787bf24 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:09.822719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73f69a-9760-404c-8477-7cbda787bf24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:09.823025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73f69a-9760-404c-8477-7cbda787bf24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:09.824414 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73f69a-9760-404c-8477-7cbda787bf24 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:09.837157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 505/985] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:09.838484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c5a5c-075f-48c1-82c7-62f698551672 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:09.838772 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c5a5c-075f-48c1-82c7-62f698551672 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:09.839342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c5a5c-075f-48c1-82c7-62f698551672 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:09.840642 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 506/986] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:09.842910 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c5a5c-075f-48c1-82c7-62f698551672 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:09.868954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835b07c-10b9-4ce9-b5ab-5529646bd186 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:09.901324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ca127-11a4-4f0b-adbb-0990a56f29c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:09.901952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ca127-11a4-4f0b-adbb-0990a56f29c5 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:09.902232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ca127-11a4-4f0b-adbb-0990a56f29c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:09.902503 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ca127-11a4-4f0b-adbb-0990a56f29c5 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:09.903097 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ca127-11a4-4f0b-adbb-0990a56f29c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:09.904444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ca127-11a4-4f0b-adbb-0990a56f29c5 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:09.910399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 481/987] 10.222.0.76 () {56 vars in 1087 bytes} [Fri Aug 26 08:40:09 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:40:09.911496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f94aa7-462f-4719-8549-b79e5d6e9932 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:09.911776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f94aa7-462f-4719-8549-b79e5d6e9932 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:09.912048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f94aa7-462f-4719-8549-b79e5d6e9932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:09.941164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-46f94aa7-462f-4719-8549-b79e5d6e9932 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:09.942407 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-46f94aa7-462f-4719-8549-b79e5d6e9932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:09.949817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c5a5c-075f-48c1-82c7-62f698551672 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:09.992552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a5510-318f-4f63-bf23-deaa4ad4bd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:09.993231 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a5510-318f-4f63-bf23-deaa4ad4bd13 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:09.993832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a5510-318f-4f63-bf23-deaa4ad4bd13 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:09.994119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a5510-318f-4f63-bf23-deaa4ad4bd13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:10.004781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a5510-318f-4f63-bf23-deaa4ad4bd13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:10.006732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a5510-318f-4f63-bf23-deaa4ad4bd13 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:10.017805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 482/988] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:10.021491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-8c1a5510-318f-4f63-bf23-deaa4ad4bd13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:40:10.021491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:10.021491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:10.021491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:10.021491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:10.021491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:10.021491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:10.021491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:10.021491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:10.021491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:10.021491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:10.021491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:10.021491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:40:10.021491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:40:10.021491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:10.022449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:10.023339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:40:10.023339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:40:10.023339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:40:10.023339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:40:10.023339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:40:10.023339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:40:10.023339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:40:10.023339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:10.023339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 507/989] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:40:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:10.029261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f94aa7-462f-4719-8549-b79e5d6e9932 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:10.042763 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:10.134112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f94aa7-462f-4719-8549-b79e5d6e9932 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:10.169521 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d5eca-4e04-4ba1-a6ed-0dedec325b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:10.170129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d5eca-4e04-4ba1-a6ed-0dedec325b7d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:10.170412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d5eca-4e04-4ba1-a6ed-0dedec325b7d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:10.170688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d5eca-4e04-4ba1-a6ed-0dedec325b7d None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:10.171381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d5eca-4e04-4ba1-a6ed-0dedec325b7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:10.171683 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d5eca-4e04-4ba1-a6ed-0dedec325b7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:10.173146 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d5eca-4e04-4ba1-a6ed-0dedec325b7d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:10.184875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 483/990] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:40:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:10.190682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a5510-318f-4f63-bf23-deaa4ad4bd13 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:10.242501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:10.287690 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d5eca-4e04-4ba1-a6ed-0dedec325b7d None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:10.294378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a5510-318f-4f63-bf23-deaa4ad4bd13 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:10.332833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40493274-ae59-4e80-a0d0-00aabb9e330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:10.333468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40493274-ae59-4e80-a0d0-00aabb9e330d None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:10.333951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40493274-ae59-4e80-a0d0-00aabb9e330d None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:10.334061 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40493274-ae59-4e80-a0d0-00aabb9e330d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:10.334854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40493274-ae59-4e80-a0d0-00aabb9e330d None admin] RBAC: Adding query filter params (role.id=75a13a03465940de85c2cbbcc2195510, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=c50a6fa776a849cfbb0173ce24616906) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:10.335165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40493274-ae59-4e80-a0d0-00aabb9e330d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:10.336587 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40493274-ae59-4e80-a0d0-00aabb9e330d None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:10.343486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 508/991] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:40:10 2022] GET /identity/v3/role_assignments?user.id=c50a6fa776a849cfbb0173ce24616906&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=75a13a03465940de85c2cbbcc2195510 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:10.363655 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:10.399850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d5eca-4e04-4ba1-a6ed-0dedec325b7d None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:10.437477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdf484-1a7e-45a3-87fd-81798122b7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:10.438124 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdf484-1a7e-45a3-87fd-81798122b7c3 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:10.438401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdf484-1a7e-45a3-87fd-81798122b7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:10.438674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdf484-1a7e-45a3-87fd-81798122b7c3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:10.439273 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdf484-1a7e-45a3-87fd-81798122b7c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:10.440655 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdf484-1a7e-45a3-87fd-81798122b7c3 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-efcdf484-1a7e-45a3-87fd-81798122b7c3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:10.450715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:10.451827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:10.452701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:10.452701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:10.452701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:10.452701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:10.452701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:10.452701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:10.452701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:10.452701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:10.452701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:10.452701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:10.452701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:40:10.452701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:10.452701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 08:40:10.452701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:10.456977 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 484/992] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:40:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:10.458128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40493274-ae59-4e80-a0d0-00aabb9e330d None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:10.563952 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40493274-ae59-4e80-a0d0-00aabb9e330d None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:10.581380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:10.605647 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9c7d2-ab7c-43eb-a93e-1b9eba85fbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:10.606613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9c7d2-ab7c-43eb-a93e-1b9eba85fbdb None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:10.607049 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9c7d2-ab7c-43eb-a93e-1b9eba85fbdb None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:10.607486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9c7d2-ab7c-43eb-a93e-1b9eba85fbdb None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:10.608271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9c7d2-ab7c-43eb-a93e-1b9eba85fbdb None admin] RBAC: Adding query filter params (name=compute) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:10.608726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9c7d2-ab7c-43eb-a93e-1b9eba85fbdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:10.610261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9c7d2-ab7c-43eb-a93e-1b9eba85fbdb None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:10.615714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 509/993] 10.222.0.76 () {56 vars in 1112 bytes} [Fri Aug 26 08:40:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:10.621036 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdf484-1a7e-45a3-87fd-81798122b7c3 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:10.727766 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdf484-1a7e-45a3-87fd-81798122b7c3 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:10.763159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b4aed-b9c5-40c7-bce5-eaa70b0f95a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:10.763769 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b4aed-b9c5-40c7-bce5-eaa70b0f95a2 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:10.764052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b4aed-b9c5-40c7-bce5-eaa70b0f95a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:10.764327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b4aed-b9c5-40c7-bce5-eaa70b0f95a2 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:10.764963 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b4aed-b9c5-40c7-bce5-eaa70b0f95a2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:10.765290 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b4aed-b9c5-40c7-bce5-eaa70b0f95a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:10.766644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b4aed-b9c5-40c7-bce5-eaa70b0f95a2 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:10.767930 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:10.777021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 485/994] 10.222.0.76 () {56 vars in 1112 bytes} [Fri Aug 26 08:40:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:10.779278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9c7d2-ab7c-43eb-a93e-1b9eba85fbdb None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:10.882012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9c7d2-ab7c-43eb-a93e-1b9eba85fbdb None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:10.919145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32beca-d21f-484f-8311-d63766313894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:10.919751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32beca-d21f-484f-8311-d63766313894 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:10.920033 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32beca-d21f-484f-8311-d63766313894 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:10.920306 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32beca-d21f-484f-8311-d63766313894 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:10.921019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32beca-d21f-484f-8311-d63766313894 None admin] RBAC: Adding query filter params (interface=public, service_id=05f6bb2f66d94972a3e355edabf575ce, region_id=RegionOne) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:10.921328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32beca-d21f-484f-8311-d63766313894 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:10.922678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32beca-d21f-484f-8311-d63766313894 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:10.927873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 510/995] 10.222.0.76 () {56 vars in 1251 bytes} [Fri Aug 26 08:40:10 2022] GET /identity/v3/endpoints?service_id=05f6bb2f66d94972a3e355edabf575ce&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:10.933816 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b4aed-b9c5-40c7-bce5-eaa70b0f95a2 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:11.038505 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b4aed-b9c5-40c7-bce5-eaa70b0f95a2 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:11.071630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a82a2f-e287-4990-9e1c-8147e80e488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:11.072230 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82a2f-e287-4990-9e1c-8147e80e488f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:11.072514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82a2f-e287-4990-9e1c-8147e80e488f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:11.072790 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82a2f-e287-4990-9e1c-8147e80e488f None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:11.073474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a82a2f-e287-4990-9e1c-8147e80e488f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:11.075323 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a82a2f-e287-4990-9e1c-8147e80e488f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:11.081619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 486/996] 10.222.0.76 () {56 vars in 1087 bytes} [Fri Aug 26 08:40:10 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:40:11.833970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5656a-5809-4aae-a3a7-4b3eb9931ba0 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:11.834496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5656a-5809-4aae-a3a7-4b3eb9931ba0 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:11.834496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5656a-5809-4aae-a3a7-4b3eb9931ba0 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:11.835912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 511/997] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:11.841266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd337df-82ad-4d4e-bbea-f883096fa7b7 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:11.841720 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd337df-82ad-4d4e-bbea-f883096fa7b7 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:11.841867 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd337df-82ad-4d4e-bbea-f883096fa7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:11.860815 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ebd337df-82ad-4d4e-bbea-f883096fa7b7 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:11.862038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ebd337df-82ad-4d4e-bbea-f883096fa7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:11.919194 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:11.930690 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 487/998] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:12.196884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5656a-5809-4aae-a3a7-4b3eb9931ba0 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:12.242337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:12.284498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539fa62-1353-4e15-a428-7a09accab3cb None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:12.284787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539fa62-1353-4e15-a428-7a09accab3cb None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:12.285092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539fa62-1353-4e15-a428-7a09accab3cb None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:12.286551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 488/999] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:12.291244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5876e9-043d-4b02-8a4d-3dc4a1a0b86b None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:12.291528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5876e9-043d-4b02-8a4d-3dc4a1a0b86b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:12.291805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5876e9-043d-4b02-8a4d-3dc4a1a0b86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:12.303803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5656a-5809-4aae-a3a7-4b3eb9931ba0 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:12.310379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-8a5876e9-043d-4b02-8a4d-3dc4a1a0b86b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:12.311564 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-8a5876e9-043d-4b02-8a4d-3dc4a1a0b86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:12.340919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99b93a-9dac-4753-8f0d-750756c03f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:12.341569 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99b93a-9dac-4753-8f0d-750756c03f9b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:12.341851 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99b93a-9dac-4753-8f0d-750756c03f9b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:12.342183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99b93a-9dac-4753-8f0d-750756c03f9b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:12.342695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99b93a-9dac-4753-8f0d-750756c03f9b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:12.344050 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99b93a-9dac-4753-8f0d-750756c03f9b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-eb99b93a-9dac-4753-8f0d-750756c03f9b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:12.352750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:12.353763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:12.354641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:12.354641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:12.354641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:12.354641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:12.354641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:12.354641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:12.354641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:12.354641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:12.354641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:12.354641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:12.354641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:40:12.354641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:12.354641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 08:40:12.354641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:12.358921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 512/1000] 10.222.0.76 () {56 vars in 1126 bytes} [Fri Aug 26 08:40:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:12.359644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99b93a-9dac-4753-8f0d-750756c03f9b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:12.386569 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 489/1001] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:40:12.463042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99b93a-9dac-4753-8f0d-750756c03f9b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:12.470615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:12.498807 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55377d2d-d9de-4bc4-82ac-bd3677ea03df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:12.499414 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55377d2d-d9de-4bc4-82ac-bd3677ea03df None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:12.499700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55377d2d-d9de-4bc4-82ac-bd3677ea03df None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:12.499978 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55377d2d-d9de-4bc4-82ac-bd3677ea03df None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:12.500620 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55377d2d-d9de-4bc4-82ac-bd3677ea03df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:12.500915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55377d2d-d9de-4bc4-82ac-bd3677ea03df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:12.502297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55377d2d-d9de-4bc4-82ac-bd3677ea03df None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:12.507376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 513/1002] 10.222.0.76 () {56 vars in 1122 bytes} [Fri Aug 26 08:40:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:12.513467 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5876e9-043d-4b02-8a4d-3dc4a1a0b86b None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:12.623531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5876e9-043d-4b02-8a4d-3dc4a1a0b86b None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:12.646014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:12.651605 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55377d2d-d9de-4bc4-82ac-bd3677ea03df None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:12.660888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404459e-df04-4262-bb4b-23146c60c08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:12.661720 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404459e-df04-4262-bb4b-23146c60c08c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:12.662006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404459e-df04-4262-bb4b-23146c60c08c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:12.662281 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404459e-df04-4262-bb4b-23146c60c08c None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:12.662922 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404459e-df04-4262-bb4b-23146c60c08c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:12.663233 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404459e-df04-4262-bb4b-23146c60c08c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:12.664599 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404459e-df04-4262-bb4b-23146c60c08c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:12.674788 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 490/1003] 10.222.0.76 () {56 vars in 1122 bytes} [Fri Aug 26 08:40:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:12.675997 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404459e-df04-4262-bb4b-23146c60c08c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:12.767563 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55377d2d-d9de-4bc4-82ac-bd3677ea03df None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:12.783065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404459e-df04-4262-bb4b-23146c60c08c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:12.803579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c362fcf-1de3-4c71-a79f-7fbe76833489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:12.804194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c362fcf-1de3-4c71-a79f-7fbe76833489 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:12.804478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c362fcf-1de3-4c71-a79f-7fbe76833489 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:12.805031 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c362fcf-1de3-4c71-a79f-7fbe76833489 None admin] PATH_INFO: `/v3/services/image` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:12.805384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c362fcf-1de3-4c71-a79f-7fbe76833489 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:12.806740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c362fcf-1de3-4c71-a79f-7fbe76833489 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-9c362fcf-1de3-4c71-a79f-7fbe76833489 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:12.816079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:12.817139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:12.818014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:12.818014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:12.818014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:12.818014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:12.818014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:12.818014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:12.818014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:12.818014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:12.818014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:12.818014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:12.818014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:40:12.818014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:12.818014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 08:40:12.818014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:12.818014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 514/1004] 10.222.0.76 () {56 vars in 1105 bytes} [Fri Aug 26 08:40:12 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:12.822894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17202585-3d70-43df-a090-bbd6b6c6c4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:12.823025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c362fcf-1de3-4c71-a79f-7fbe76833489 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:12.823607 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17202585-3d70-43df-a090-bbd6b6c6c4ab None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:12.823961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17202585-3d70-43df-a090-bbd6b6c6c4ab None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:12.824314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17202585-3d70-43df-a090-bbd6b6c6c4ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:12.825087 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17202585-3d70-43df-a090-bbd6b6c6c4ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:12.826529 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17202585-3d70-43df-a090-bbd6b6c6c4ab None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:12.844551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 491/1005] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:40:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:40:12.867091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:12.944932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c362fcf-1de3-4c71-a79f-7fbe76833489 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:12.986186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935027c-d78b-4b35-879c-1a94ab8e7878 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:12.987249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935027c-d78b-4b35-879c-1a94ab8e7878 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:12.987533 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935027c-d78b-4b35-879c-1a94ab8e7878 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:12.988863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 492/1006] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:12.993930 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9020e-ca8f-4bef-b472-f50997b41643 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:12.994218 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9020e-ca8f-4bef-b472-f50997b41643 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:12.994495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9020e-ca8f-4bef-b472-f50997b41643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:13.004064 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61989c77-54e0-4681-92d2-5f8f98ff65c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:13.004678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61989c77-54e0-4681-92d2-5f8f98ff65c9 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:13.004964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61989c77-54e0-4681-92d2-5f8f98ff65c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:13.005970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61989c77-54e0-4681-92d2-5f8f98ff65c9 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:13.005970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61989c77-54e0-4681-92d2-5f8f98ff65c9 None admin] RBAC: Adding query filter params (name=image) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:13.006254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61989c77-54e0-4681-92d2-5f8f98ff65c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:13.007614 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61989c77-54e0-4681-92d2-5f8f98ff65c9 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:13.012657 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 515/1007] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:13.014760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-7ba9020e-ca8f-4bef-b472-f50997b41643 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:13.015974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7ba9020e-ca8f-4bef-b472-f50997b41643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:13.018568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61989c77-54e0-4681-92d2-5f8f98ff65c9 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:13.063384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:13.093853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 493/1008] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:12 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:40:13.129584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:13.137287 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61989c77-54e0-4681-92d2-5f8f98ff65c9 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:13.172211 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748e0d0-d015-4919-95c9-ab1a631d8f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:13.172865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e0d0-d015-4919-95c9-ab1a631d8f86 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:13.173173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e0d0-d015-4919-95c9-ab1a631d8f86 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:13.173445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e0d0-d015-4919-95c9-ab1a631d8f86 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:13.174066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e0d0-d015-4919-95c9-ab1a631d8f86 None admin] RBAC: Adding query filter params (type=image) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:13.174367 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e0d0-d015-4919-95c9-ab1a631d8f86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:13.175710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e0d0-d015-4919-95c9-ab1a631d8f86 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:13.185406 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 516/1009] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:13.365382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9020e-ca8f-4bef-b472-f50997b41643 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:13.467361 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9020e-ca8f-4bef-b472-f50997b41643 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:13.501614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83c041-8aa7-4637-8182-b01d104a81e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:13.502257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83c041-8aa7-4637-8182-b01d104a81e4 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:13.502540 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83c041-8aa7-4637-8182-b01d104a81e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:13.502818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83c041-8aa7-4637-8182-b01d104a81e4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:13.503411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83c041-8aa7-4637-8182-b01d104a81e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:13.504771 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83c041-8aa7-4637-8182-b01d104a81e4 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-db83c041-8aa7-4637-8182-b01d104a81e4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:13.514306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:13.515343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:13.516220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:13.516220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:13.516220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:13.516220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:13.516220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:13.516220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:13.516220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:13.516220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:13.516220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:13.516220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:13.516220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:40:13.516220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:13.516220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 08:40:13.516220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:13.517600 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 494/1010] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:40:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:13.522027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748e0d0-d015-4919-95c9-ab1a631d8f86 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:13.630905 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748e0d0-d015-4919-95c9-ab1a631d8f86 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:13.665792 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae017f-7768-45d6-b231-145eab18c266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:13.666397 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae017f-7768-45d6-b231-145eab18c266 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:13.666682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae017f-7768-45d6-b231-145eab18c266 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:13.666984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae017f-7768-45d6-b231-145eab18c266 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:13.667614 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae017f-7768-45d6-b231-145eab18c266 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:13.667920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae017f-7768-45d6-b231-145eab18c266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:13.669307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae017f-7768-45d6-b231-145eab18c266 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:13.678829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 517/1011] 10.222.0.76 () {56 vars in 1112 bytes} [Fri Aug 26 08:40:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:13.680261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83c041-8aa7-4637-8182-b01d104a81e4 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:13.725463 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:13.785364 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83c041-8aa7-4637-8182-b01d104a81e4 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:13.819040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88717c2-2388-4452-a4bd-34adcc0c1ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:13.819615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88717c2-2388-4452-a4bd-34adcc0c1ac9 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:13.819897 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88717c2-2388-4452-a4bd-34adcc0c1ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:13.820175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88717c2-2388-4452-a4bd-34adcc0c1ac9 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:13.820867 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88717c2-2388-4452-a4bd-34adcc0c1ac9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:13.821205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88717c2-2388-4452-a4bd-34adcc0c1ac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:13.822614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88717c2-2388-4452-a4bd-34adcc0c1ac9 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:13.829240 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 495/1012] 10.222.0.76 () {56 vars in 1112 bytes} [Fri Aug 26 08:40:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:13.834789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae017f-7768-45d6-b231-145eab18c266 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:13.859909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:13.937591 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae017f-7768-45d6-b231-145eab18c266 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:13.972650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27d3e2-4b27-45d5-a91d-5214377c6076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:13.973273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27d3e2-4b27-45d5-a91d-5214377c6076 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:13.973553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27d3e2-4b27-45d5-a91d-5214377c6076 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:13.973821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27d3e2-4b27-45d5-a91d-5214377c6076 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:13.974466 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27d3e2-4b27-45d5-a91d-5214377c6076 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:13.975818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27d3e2-4b27-45d5-a91d-5214377c6076 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:14.001043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 518/1013] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:40:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:40:14.780441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff05dc-26ed-43c5-b4c8-5b23b5e73838 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:14.781167 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff05dc-26ed-43c5-b4c8-5b23b5e73838 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:14.781167 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff05dc-26ed-43c5-b4c8-5b23b5e73838 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:14.782572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 496/1014] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:14.787748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eac9c-f2a4-4536-b055-3af5ad7166ac None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:14.788113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eac9c-f2a4-4536-b055-3af5ad7166ac None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:14.788466 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eac9c-f2a4-4536-b055-3af5ad7166ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:14.807090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-a24eac9c-f2a4-4536-b055-3af5ad7166ac None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:14.808594 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a24eac9c-f2a4-4536-b055-3af5ad7166ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:14.882752 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 519/1015] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:14 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:15.069472 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a639d8-c4ac-4289-b892-c7d6fcb307fc None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:15.069792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a639d8-c4ac-4289-b892-c7d6fcb307fc None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:15.070037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a639d8-c4ac-4289-b892-c7d6fcb307fc None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:15.071501 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 497/1016] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:15.077438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb92cc-5cb5-4458-a4a6-31ee0763526d None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:15.077885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb92cc-5cb5-4458-a4a6-31ee0763526d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:15.078051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb92cc-5cb5-4458-a4a6-31ee0763526d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:15.085223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:15.098091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-4adb92cc-5cb5-4458-a4a6-31ee0763526d None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:15.099295 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4adb92cc-5cb5-4458-a4a6-31ee0763526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:15.152273 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a639d8-c4ac-4289-b892-c7d6fcb307fc None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:15.166481 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 520/1017] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:15 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:15.258899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a639d8-c4ac-4289-b892-c7d6fcb307fc None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:15.262851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:15.295021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdadbe-7d3d-4c22-9099-1f7e994a99aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:15.295643 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdadbe-7d3d-4c22-9099-1f7e994a99aa None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:15.295924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdadbe-7d3d-4c22-9099-1f7e994a99aa None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:15.296261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdadbe-7d3d-4c22-9099-1f7e994a99aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:15.297392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdadbe-7d3d-4c22-9099-1f7e994a99aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:15.298807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdadbe-7d3d-4c22-9099-1f7e994a99aa None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:15.301023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 498/1018] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:15.306445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb92cc-5cb5-4458-a4a6-31ee0763526d None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:15.408687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb92cc-5cb5-4458-a4a6-31ee0763526d None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:15.433541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdadbe-7d3d-4c22-9099-1f7e994a99aa None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:15.444102 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d13e6-4106-40d1-86b5-d31f54ec9767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:15.444714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d13e6-4106-40d1-86b5-d31f54ec9767 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:15.445019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d13e6-4106-40d1-86b5-d31f54ec9767 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:15.445420 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d13e6-4106-40d1-86b5-d31f54ec9767 None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:15.446071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d13e6-4106-40d1-86b5-d31f54ec9767 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:15.447507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d13e6-4106-40d1-86b5-d31f54ec9767 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:15.452880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:15.477021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 521/1019] 10.222.0.76 () {60 vars in 1141 bytes} [Fri Aug 26 08:40:15 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:40:15.553775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdadbe-7d3d-4c22-9099-1f7e994a99aa None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:15.595990 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc163f-35fc-4339-9f5a-71673d335d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:15.596609 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc163f-35fc-4339-9f5a-71673d335d77 None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:15.596914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc163f-35fc-4339-9f5a-71673d335d77 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:15.597218 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc163f-35fc-4339-9f5a-71673d335d77 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:15.597880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc163f-35fc-4339-9f5a-71673d335d77 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:15.599259 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc163f-35fc-4339-9f5a-71673d335d77 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:15.620124 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 499/1020] 10.222.0.76 () {60 vars in 1141 bytes} [Fri Aug 26 08:40:15 2022] POST /identity/v3/services => generated 242 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:40:16.012401 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a6693-5301-4953-ae21-fb82179bbab8 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:16.012791 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a6693-5301-4953-ae21-fb82179bbab8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:16.012972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a6693-5301-4953-ae21-fb82179bbab8 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:16.014381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 522/1021] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:16.019562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36511d-1732-4318-a6ed-979580f3a88c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:16.020049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36511d-1732-4318-a6ed-979580f3a88c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:16.020132 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36511d-1732-4318-a6ed-979580f3a88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:16.038515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-0e36511d-1732-4318-a6ed-979580f3a88c None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:16.039702 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0e36511d-1732-4318-a6ed-979580f3a88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:16.066890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:16.117034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 500/1022] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:16.379740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a6693-5301-4953-ae21-fb82179bbab8 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:16.480128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a6693-5301-4953-ae21-fb82179bbab8 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:16.514001 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dce6a-ef44-4532-aa40-7a143236f02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:16.514625 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dce6a-ef44-4532-aa40-7a143236f02b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:16.514904 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dce6a-ef44-4532-aa40-7a143236f02b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:16.515177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dce6a-ef44-4532-aa40-7a143236f02b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:16.525142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6dce6a-ef44-4532-aa40-7a143236f02b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-0b6dce6a-ef44-4532-aa40-7a143236f02b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:40:16.530385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:16.531393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:16.532285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:16.532285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:16.532285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:16.532285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:16.532285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:40:16.532285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:40:16.532285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:40:16.532285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:40:16.532285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:40:16.532285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:40:16.532285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 08:40:16.532285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:16.539487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 523/1023] 10.222.0.76 () {56 vars in 1120 bytes} [Fri Aug 26 08:40:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:16.539622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36511d-1732-4318-a6ed-979580f3a88c None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:16.644579 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36511d-1732-4318-a6ed-979580f3a88c None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:16.678155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17706e3d-f618-448b-ad5c-2f2d15fb0983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:16.678754 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17706e3d-f618-448b-ad5c-2f2d15fb0983 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:16.679033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17706e3d-f618-448b-ad5c-2f2d15fb0983 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:16.679302 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17706e3d-f618-448b-ad5c-2f2d15fb0983 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:16.679957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17706e3d-f618-448b-ad5c-2f2d15fb0983 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:16.680255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17706e3d-f618-448b-ad5c-2f2d15fb0983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:16.681625 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17706e3d-f618-448b-ad5c-2f2d15fb0983 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:16.693865 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 501/1024] 10.222.0.76 () {56 vars in 1115 bytes} [Fri Aug 26 08:40:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:16.695150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dce6a-ef44-4532-aa40-7a143236f02b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:16.744766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:16.798933 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dce6a-ef44-4532-aa40-7a143236f02b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:16.832349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7131ab-b80c-4581-b6ce-ed79c126b053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:16.833006 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7131ab-b80c-4581-b6ce-ed79c126b053 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:16.833267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7131ab-b80c-4581-b6ce-ed79c126b053 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:16.833535 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7131ab-b80c-4581-b6ce-ed79c126b053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:16.843463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7131ab-b80c-4581-b6ce-ed79c126b053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:16.844887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7131ab-b80c-4581-b6ce-ed79c126b053 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-ee7131ab-b80c-4581-b6ce-ed79c126b053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:40:16.858796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:16.859750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:40:16.865549 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:40:16.865549 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:16.865549 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:16.865549 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 524/1025] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:16.865793 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17706e3d-f618-448b-ad5c-2f2d15fb0983 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:16.888856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:16.967352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17706e3d-f618-448b-ad5c-2f2d15fb0983 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:17.001711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42498c4e-6844-4a62-9440-1ea5418b7b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:17.002404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42498c4e-6844-4a62-9440-1ea5418b7b41 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:17.002748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42498c4e-6844-4a62-9440-1ea5418b7b41 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:17.003081 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42498c4e-6844-4a62-9440-1ea5418b7b41 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:17.003787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42498c4e-6844-4a62-9440-1ea5418b7b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:17.004152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42498c4e-6844-4a62-9440-1ea5418b7b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:17.005597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42498c4e-6844-4a62-9440-1ea5418b7b41 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:17.022467 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 502/1026] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:17.023628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7131ab-b80c-4581-b6ce-ed79c126b053 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:17.120596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:17.125459 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7131ab-b80c-4581-b6ce-ed79c126b053 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:17.158655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e3675-8766-49c0-877e-abf8912928f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:17.159278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e3675-8766-49c0-877e-abf8912928f0 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:17.159556 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e3675-8766-49c0-877e-abf8912928f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:17.159824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e3675-8766-49c0-877e-abf8912928f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:17.167859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e3675-8766-49c0-877e-abf8912928f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:17.169303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e3675-8766-49c0-877e-abf8912928f0 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-396e3675-8766-49c0-877e-abf8912928f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:40:17.180117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:17.186753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:17.187777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:17.187777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:17.187777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:40:17.187777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:40:17.187777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:40:17.187777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:40:17.187777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:40:17.187777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:40:17.187777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:40:17.187777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:17.187777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 525/1027] 10.222.0.76 () {56 vars in 1093 bytes} [Fri Aug 26 08:40:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:17.188412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42498c4e-6844-4a62-9440-1ea5418b7b41 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:17.269325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:17.288942 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42498c4e-6844-4a62-9440-1ea5418b7b41 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:17.323255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07149b9-d22b-4203-a37a-85755c2c0666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:17.323865 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07149b9-d22b-4203-a37a-85755c2c0666 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:17.324144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07149b9-d22b-4203-a37a-85755c2c0666 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:17.324416 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07149b9-d22b-4203-a37a-85755c2c0666 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:17.325168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07149b9-d22b-4203-a37a-85755c2c0666 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:17.325472 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07149b9-d22b-4203-a37a-85755c2c0666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:17.326886 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07149b9-d22b-4203-a37a-85755c2c0666 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:17.348958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 503/1028] 10.222.0.76 () {56 vars in 1133 bytes} [Fri Aug 26 08:40:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:17.350116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e3675-8766-49c0-877e-abf8912928f0 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:17.450257 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e3675-8766-49c0-877e-abf8912928f0 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:17.470930 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e264e05-0a21-4f36-91b9-1decf30db346 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:17.471229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e264e05-0a21-4f36-91b9-1decf30db346 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:17.471495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e264e05-0a21-4f36-91b9-1decf30db346 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:17.473055 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 504/1029] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:40:17.477788 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45463622-ba5f-48cd-a064-16f721b75e09 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:17.478075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45463622-ba5f-48cd-a064-16f721b75e09 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:17.478348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45463622-ba5f-48cd-a064-16f721b75e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:17.487674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8737240-671f-4fce-bcd2-dc394e7f4a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:17.488278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8737240-671f-4fce-bcd2-dc394e7f4a93 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:17.488560 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8737240-671f-4fce-bcd2-dc394e7f4a93 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:17.488834 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8737240-671f-4fce-bcd2-dc394e7f4a93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:17.496330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-45463622-ba5f-48cd-a064-16f721b75e09 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:17.497598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-45463622-ba5f-48cd-a064-16f721b75e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:17.519220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:17.565046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8737240-671f-4fce-bcd2-dc394e7f4a93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:17.565639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 505/1030] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:40:17.566971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8737240-671f-4fce-bcd2-dc394e7f4a93 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:17.569626 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34869ae4-f981-45fa-8b44-b29cca5addcc None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:17.570079 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34869ae4-f981-45fa-8b44-b29cca5addcc None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:17.570359 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34869ae4-f981-45fa-8b44-b29cca5addcc None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:17.571842 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 506/1031] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:17.578762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abee3e-66c9-4664-900a-72626f29e12d None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:17.579067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abee3e-66c9-4664-900a-72626f29e12d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:17.579352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abee3e-66c9-4664-900a-72626f29e12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:17.602063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-41abee3e-66c9-4664-900a-72626f29e12d None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:17.603254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-41abee3e-66c9-4664-900a-72626f29e12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:17.666558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:17.674113 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 507/1032] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:17.681625 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 526/1033] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:40:17 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:40:17.682689 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abee3e-66c9-4664-900a-72626f29e12d None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:17.781940 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abee3e-66c9-4664-900a-72626f29e12d None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:17.815247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fe1ae-2bd0-42d0-a7fd-5c95cbfa60eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:17.815795 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fe1ae-2bd0-42d0-a7fd-5c95cbfa60eb None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:17.816071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fe1ae-2bd0-42d0-a7fd-5c95cbfa60eb None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:17.816341 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fe1ae-2bd0-42d0-a7fd-5c95cbfa60eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:17.826599 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fe1ae-2bd0-42d0-a7fd-5c95cbfa60eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:17.828045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fe1ae-2bd0-42d0-a7fd-5c95cbfa60eb None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-484fe1ae-2bd0-42d0-a7fd-5c95cbfa60eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:40:17.842654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:17.843624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:40:17.849546 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:40:17.849546 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:17.849546 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:17.849546 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 508/1034] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:17.849804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8737240-671f-4fce-bcd2-dc394e7f4a93 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:17.849883 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fe1ae-2bd0-42d0-a7fd-5c95cbfa60eb None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:17.904827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:17.909512 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:17.952664 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8737240-671f-4fce-bcd2-dc394e7f4a93 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:17.957955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fe1ae-2bd0-42d0-a7fd-5c95cbfa60eb None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:17.987269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52094cfb-a0dc-409f-9291-20e368b32ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:17.987893 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52094cfb-a0dc-409f-9291-20e368b32ff3 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:17.988178 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52094cfb-a0dc-409f-9291-20e368b32ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:17.988454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52094cfb-a0dc-409f-9291-20e368b32ff3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:17.989565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52094cfb-a0dc-409f-9291-20e368b32ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:17.990989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52094cfb-a0dc-409f-9291-20e368b32ff3 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:17.991102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95371d-e85f-45aa-ba0e-4275138ab0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:17.991597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95371d-e85f-45aa-ba0e-4275138ab0dd None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:17.991880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95371d-e85f-45aa-ba0e-4275138ab0dd None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:17.992154 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95371d-e85f-45aa-ba0e-4275138ab0dd None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:17.992549 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 527/1035] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:17.992792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95371d-e85f-45aa-ba0e-4275138ab0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:17.993123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95371d-e85f-45aa-ba0e-4275138ab0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:17.994475 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95371d-e85f-45aa-ba0e-4275138ab0dd None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:17.996679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52094cfb-a0dc-409f-9291-20e368b32ff3 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:18.009873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 509/1036] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:18.009873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95371d-e85f-45aa-ba0e-4275138ab0dd None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:18.099736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52094cfb-a0dc-409f-9291-20e368b32ff3 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:18.105929 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95371d-e85f-45aa-ba0e-4275138ab0dd None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:18.116203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:18.124923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:18.134233 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffa1b5-3c19-4fc6-a4bc-475c61a64344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:18.134852 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffa1b5-3c19-4fc6-a4bc-475c61a64344 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:18.135131 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffa1b5-3c19-4fc6-a4bc-475c61a64344 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:18.135416 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffa1b5-3c19-4fc6-a4bc-475c61a64344 None admin] PATH_INFO: `/v3/services/image` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:18.136526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffa1b5-3c19-4fc6-a4bc-475c61a64344 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:18.137930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffa1b5-3c19-4fc6-a4bc-475c61a64344 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:18.140590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872b463-de22-49d5-a637-96e4543dfbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:18.141227 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872b463-de22-49d5-a637-96e4543dfbf9 None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:18.141510 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872b463-de22-49d5-a637-96e4543dfbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:18.141785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872b463-de22-49d5-a637-96e4543dfbf9 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:18.142416 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872b463-de22-49d5-a637-96e4543dfbf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:18.143827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872b463-de22-49d5-a637-96e4543dfbf9 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-acffa1b5-3c19-4fc6-a4bc-475c61a64344 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:18.146317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:18.147421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:18.148308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:18.148308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:18.148308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:18.148308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:18.148308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:18.148308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:18.148308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:18.148308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:18.148308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:18.148308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:18.148308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:40:18.148308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:18.148308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 08:40:18.148308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:18.148308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 528/1037] 10.222.0.76 () {56 vars in 1105 bytes} [Fri Aug 26 08:40:17 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:18.150019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffa1b5-3c19-4fc6-a4bc-475c61a64344 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:18.168455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 510/1038] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:40:18 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:40:18.169423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872b463-de22-49d5-a637-96e4543dfbf9 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:18.255932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffa1b5-3c19-4fc6-a4bc-475c61a64344 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:18.292902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ae14b-7864-4ae0-aa67-10d892912496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:18.293579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ae14b-7864-4ae0-aa67-10d892912496 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:18.293861 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ae14b-7864-4ae0-aa67-10d892912496 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:18.294165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ae14b-7864-4ae0-aa67-10d892912496 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:18.297011 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872b463-de22-49d5-a637-96e4543dfbf9 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:18.301459 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ae14b-7864-4ae0-aa67-10d892912496 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:18.303166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ae14b-7864-4ae0-aa67-10d892912496 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:18.316970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-0b0ae14b-7864-4ae0-aa67-10d892912496 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:40:18.316970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:18.316970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:18.316970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:18.316970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:18.316970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:18.316970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:18.316970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:18.316970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:18.316970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:18.316970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:18.316970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:18.316970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:40:18.316970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:40:18.316970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:18.317937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:18.318863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:40:18.318863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:40:18.318863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:40:18.318863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:40:18.318863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:40:18.318863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:40:18.318863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:40:18.318863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:18.318863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 529/1039] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:40:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:18.324738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ae14b-7864-4ae0-aa67-10d892912496 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:18.340199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305c74b-8bfc-407e-9224-828b08b5027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:18.340898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305c74b-8bfc-407e-9224-828b08b5027f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:18.341219 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305c74b-8bfc-407e-9224-828b08b5027f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:18.341497 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305c74b-8bfc-407e-9224-828b08b5027f None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:18.342126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305c74b-8bfc-407e-9224-828b08b5027f None admin] RBAC: Adding query filter params (name=image) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:18.342428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305c74b-8bfc-407e-9224-828b08b5027f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:18.343788 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305c74b-8bfc-407e-9224-828b08b5027f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:18.349964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 511/1040] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:18.355551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305c74b-8bfc-407e-9224-828b08b5027f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:18.389300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:18.392304 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:18.445471 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ae14b-7864-4ae0-aa67-10d892912496 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:18.467656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305c74b-8bfc-407e-9224-828b08b5027f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:18.481788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5df465-01d0-4d46-b3b5-86da0d30ca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:18.482679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5df465-01d0-4d46-b3b5-86da0d30ca3d None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:18.482679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5df465-01d0-4d46-b3b5-86da0d30ca3d None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:18.482972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5df465-01d0-4d46-b3b5-86da0d30ca3d None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:18.483610 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5df465-01d0-4d46-b3b5-86da0d30ca3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:18.483919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5df465-01d0-4d46-b3b5-86da0d30ca3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:18.485484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5df465-01d0-4d46-b3b5-86da0d30ca3d None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:18.498029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 530/1041] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:40:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:18.503823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5df465-01d0-4d46-b3b5-86da0d30ca3d None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:18.510111 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad3167-b18e-4d74-8a58-ed9d1ab70add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:18.511293 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad3167-b18e-4d74-8a58-ed9d1ab70add None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:18.511577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad3167-b18e-4d74-8a58-ed9d1ab70add None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:18.511849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad3167-b18e-4d74-8a58-ed9d1ab70add None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:18.512524 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad3167-b18e-4d74-8a58-ed9d1ab70add None admin] RBAC: Adding query filter params (type=image) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:18.512830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad3167-b18e-4d74-8a58-ed9d1ab70add None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:18.514233 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad3167-b18e-4d74-8a58-ed9d1ab70add None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:18.523814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 512/1042] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:18.524817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad3167-b18e-4d74-8a58-ed9d1ab70add None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:18.623161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5df465-01d0-4d46-b3b5-86da0d30ca3d None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:18.624165 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:18.632622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad3167-b18e-4d74-8a58-ed9d1ab70add None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:18.634724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:18.662071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c4caa-5107-4d0e-9448-a48e9eadd073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:18.662678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4caa-5107-4d0e-9448-a48e9eadd073 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:18.662960 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4caa-5107-4d0e-9448-a48e9eadd073 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:18.663306 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4caa-5107-4d0e-9448-a48e9eadd073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:18.663951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c4caa-5107-4d0e-9448-a48e9eadd073 None admin] RBAC: Adding query filter params (role.id=75a13a03465940de85c2cbbcc2195510, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=b63d6e588f6e4b598b75a2ec13bea25d) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:18.664258 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c4caa-5107-4d0e-9448-a48e9eadd073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:18.665712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c4caa-5107-4d0e-9448-a48e9eadd073 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:18.668045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70d89b-3ab3-4971-b74e-30ee49564b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:18.668648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70d89b-3ab3-4971-b74e-30ee49564b9c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:18.668931 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70d89b-3ab3-4971-b74e-30ee49564b9c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:18.669225 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70d89b-3ab3-4971-b74e-30ee49564b9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:18.669912 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70d89b-3ab3-4971-b74e-30ee49564b9c None admin] RBAC: Adding query filter params (interface=public, service_id=37add1e529c54157ab329e74b6af1f6b, region_id=RegionOne) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:18.670213 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70d89b-3ab3-4971-b74e-30ee49564b9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:18.671547 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70d89b-3ab3-4971-b74e-30ee49564b9c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:18.672126 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 531/1043] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:40:18 2022] GET /identity/v3/role_assignments?user.id=b63d6e588f6e4b598b75a2ec13bea25d&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=75a13a03465940de85c2cbbcc2195510 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:18.681047 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 513/1044] 10.222.0.76 () {56 vars in 1251 bytes} [Fri Aug 26 08:40:18 2022] GET /identity/v3/endpoints?service_id=37add1e529c54157ab329e74b6af1f6b&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:18.684595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c4caa-5107-4d0e-9448-a48e9eadd073 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:18.795012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c4caa-5107-4d0e-9448-a48e9eadd073 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:18.832767 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963299f6-0bdb-426f-89b8-d2c6da528c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:18.833410 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963299f6-0bdb-426f-89b8-d2c6da528c51 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:18.833691 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963299f6-0bdb-426f-89b8-d2c6da528c51 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:18.833963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963299f6-0bdb-426f-89b8-d2c6da528c51 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:18.834566 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963299f6-0bdb-426f-89b8-d2c6da528c51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:18.835916 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963299f6-0bdb-426f-89b8-d2c6da528c51 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:18.849040 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 532/1045] 10.222.0.76 () {56 vars in 1087 bytes} [Fri Aug 26 08:40:18 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:40:20.155249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478c075-b355-4fa2-98c1-3478402bf4d9 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:20.155785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478c075-b355-4fa2-98c1-3478402bf4d9 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:20.155785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478c075-b355-4fa2-98c1-3478402bf4d9 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:20.157194 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 514/1046] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:20.162443 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99783e-57ad-43bb-94f4-03620ef84eed None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:20.162887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99783e-57ad-43bb-94f4-03620ef84eed None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:20.163066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99783e-57ad-43bb-94f4-03620ef84eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:20.181179 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-cd99783e-57ad-43bb-94f4-03620ef84eed None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:20.182402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-cd99783e-57ad-43bb-94f4-03620ef84eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:20.213594 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:20.253033 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 533/1047] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:20.526685 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478c075-b355-4fa2-98c1-3478402bf4d9 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:20.556181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396cbe6-190e-4b09-85ef-1f14b3fca818 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:20.556785 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396cbe6-190e-4b09-85ef-1f14b3fca818 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:20.557291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396cbe6-190e-4b09-85ef-1f14b3fca818 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:20.559635 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 534/1048] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:40:20.564824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9495265-e998-4519-9060-a860d9507b39 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:20.565140 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9495265-e998-4519-9060-a860d9507b39 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:20.565418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9495265-e998-4519-9060-a860d9507b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:20.592490 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-e9495265-e998-4519-9060-a860d9507b39 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:20.593826 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e9495265-e998-4519-9060-a860d9507b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:20.641501 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478c075-b355-4fa2-98c1-3478402bf4d9 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:20.662170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 535/1049] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:40:20.677040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985151b-f17f-47e9-8aae-c5859fda1b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:20.677682 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985151b-f17f-47e9-8aae-c5859fda1b52 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:20.677966 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985151b-f17f-47e9-8aae-c5859fda1b52 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:20.678242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985151b-f17f-47e9-8aae-c5859fda1b52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:20.688825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985151b-f17f-47e9-8aae-c5859fda1b52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-5985151b-f17f-47e9-8aae-c5859fda1b52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:40:20.693493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:20.694417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:20.695310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:20.695310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:20.695310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:20.695310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:20.695310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:40:20.695310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:40:20.695310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:40:20.695310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:40:20.695310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:40:20.695310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:40:20.695310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:40:20.695310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:20.696622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 515/1050] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:40:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:20.701460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9495265-e998-4519-9060-a860d9507b39 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:20.744668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0ae22-d44b-4bdd-85ee-90bd018d2ec9 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:20.745492 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0ae22-d44b-4bdd-85ee-90bd018d2ec9 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:20.745784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0ae22-d44b-4bdd-85ee-90bd018d2ec9 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:20.747214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 516/1051] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:40:20.751794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31913d2f-325b-4cb7-b22a-32131e99c2db None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:20.752080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31913d2f-325b-4cb7-b22a-32131e99c2db None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:20.752355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31913d2f-325b-4cb7-b22a-32131e99c2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:20.770587 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-31913d2f-325b-4cb7-b22a-32131e99c2db None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:20.771897 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-31913d2f-325b-4cb7-b22a-32131e99c2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:20.787363 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:20.800792 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:20.805853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9495265-e998-4519-9060-a860d9507b39 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:20.843480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314f3c7-3a49-4897-919a-9e62c41f0c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:20.844083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314f3c7-3a49-4897-919a-9e62c41f0c9f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:20.844367 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314f3c7-3a49-4897-919a-9e62c41f0c9f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:20.844644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314f3c7-3a49-4897-919a-9e62c41f0c9f None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:20.845343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314f3c7-3a49-4897-919a-9e62c41f0c9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:20.845644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314f3c7-3a49-4897-919a-9e62c41f0c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:20.846998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314f3c7-3a49-4897-919a-9e62c41f0c9f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:20.852095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 517/1052] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:40:20.860493 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 536/1053] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:40:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:20.861841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31913d2f-325b-4cb7-b22a-32131e99c2db None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:20.930254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314f3c7-3a49-4897-919a-9e62c41f0c9f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:20.963263 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31913d2f-325b-4cb7-b22a-32131e99c2db None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:20.999025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be87fa-6cf2-4dbd-8a1c-ebaef6ae8f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:20.999663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be87fa-6cf2-4dbd-8a1c-ebaef6ae8f91 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:20.999970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be87fa-6cf2-4dbd-8a1c-ebaef6ae8f91 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:21.000319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be87fa-6cf2-4dbd-8a1c-ebaef6ae8f91 None admin] PATH_INFO: `/v3/users/e189d893ad434ca78c1b409057f83db0` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:21.015412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be87fa-6cf2-4dbd-8a1c-ebaef6ae8f91 None admin] RBAC: Authorizing `identity:get_user(user_id=e189d893ad434ca78c1b409057f83db0)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:21.017112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be87fa-6cf2-4dbd-8a1c-ebaef6ae8f91 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:21.018906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 518/1054] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:40:20 2022] GET /identity/v3/users/e189d893ad434ca78c1b409057f83db0 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:21.024605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be87fa-6cf2-4dbd-8a1c-ebaef6ae8f91 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:21.033702 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:21.048462 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314f3c7-3a49-4897-919a-9e62c41f0c9f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:21.083944 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08784df0-c95b-4545-a095-68f6ca37f3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:21.084574 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08784df0-c95b-4545-a095-68f6ca37f3a4 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:21.084859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08784df0-c95b-4545-a095-68f6ca37f3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:21.085163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08784df0-c95b-4545-a095-68f6ca37f3a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:21.100634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08784df0-c95b-4545-a095-68f6ca37f3a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-08784df0-c95b-4545-a095-68f6ca37f3a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:40:21.105921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:21.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:21.110029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:21.110029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:21.110029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:21.110029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:21.110029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:40:21.110029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:40:21.110029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:40:21.110029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:40:21.110029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:40:21.110029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:40:21.110029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 08:40:21.110029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:21.110029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 537/1055] 10.222.0.76 () {56 vars in 1120 bytes} [Fri Aug 26 08:40:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:21.112820 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08784df0-c95b-4545-a095-68f6ca37f3a4 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:21.137142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:21.137312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be87fa-6cf2-4dbd-8a1c-ebaef6ae8f91 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:21.172253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56de9d-c61f-4b45-ac1e-1939c4b5250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:21.172920 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56de9d-c61f-4b45-ac1e-1939c4b5250f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:21.173166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56de9d-c61f-4b45-ac1e-1939c4b5250f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:21.173445 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56de9d-c61f-4b45-ac1e-1939c4b5250f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:21.222417 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08784df0-c95b-4545-a095-68f6ca37f3a4 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:21.240520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56de9d-c61f-4b45-ac1e-1939c4b5250f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:21.242001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56de9d-c61f-4b45-ac1e-1939c4b5250f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:21.249502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:21.255837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143128b-e0a6-4933-afdb-6a1d7ecc6304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:21.256440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143128b-e0a6-4933-afdb-6a1d7ecc6304 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:21.256723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143128b-e0a6-4933-afdb-6a1d7ecc6304 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:21.257018 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143128b-e0a6-4933-afdb-6a1d7ecc6304 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:21.257678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143128b-e0a6-4933-afdb-6a1d7ecc6304 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:21.257983 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143128b-e0a6-4933-afdb-6a1d7ecc6304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:21.259335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143128b-e0a6-4933-afdb-6a1d7ecc6304 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:21.268405 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 538/1056] 10.222.0.76 () {56 vars in 1115 bytes} [Fri Aug 26 08:40:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:21.269918 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143128b-e0a6-4933-afdb-6a1d7ecc6304 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:21.341515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 519/1057] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:40:21 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 08:40:21.342358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56de9d-c61f-4b45-ac1e-1939c4b5250f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:21.355364 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:21.374531 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143128b-e0a6-4933-afdb-6a1d7ecc6304 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:21.409448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b956557-1cef-4c1e-88db-287430abc999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:21.410073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956557-1cef-4c1e-88db-287430abc999 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:21.410358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956557-1cef-4c1e-88db-287430abc999 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:21.410636 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956557-1cef-4c1e-88db-287430abc999 None admin] PATH_INFO: `/v3/services/image` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:21.411213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b956557-1cef-4c1e-88db-287430abc999 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:21.412599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b956557-1cef-4c1e-88db-287430abc999 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-6b956557-1cef-4c1e-88db-287430abc999 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:21.421923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:21.422937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:21.423790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:21.423790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:21.423790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:21.423790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:21.423790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:21.423790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:21.423790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:21.423790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:21.423790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:21.423790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:21.423790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:40:21.423790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:40:21.423790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 08:40:21.423790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:21.423790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 539/1058] 10.222.0.76 () {56 vars in 1105 bytes} [Fri Aug 26 08:40:21 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:21.424722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b956557-1cef-4c1e-88db-287430abc999 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:21.447404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56de9d-c61f-4b45-ac1e-1939c4b5250f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:21.454606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:21.482526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36db4e-1850-4418-9804-df95696724a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:21.483148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36db4e-1850-4418-9804-df95696724a6 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:21.483430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36db4e-1850-4418-9804-df95696724a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:21.483708 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36db4e-1850-4418-9804-df95696724a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:21.493482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36db4e-1850-4418-9804-df95696724a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:21.495038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36db4e-1850-4418-9804-df95696724a6 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-4a36db4e-1850-4418-9804-df95696724a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:40:21.509381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:21.510413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:40:21.511401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:40:21.511401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:21.511401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:21.511401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 520/1059] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:21.511401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36db4e-1850-4418-9804-df95696724a6 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:21.524674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b956557-1cef-4c1e-88db-287430abc999 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:21.558017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63359bf6-ef3a-4d66-ac42-1ecd64c3b99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:21.558632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63359bf6-ef3a-4d66-ac42-1ecd64c3b99c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:21.558913 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63359bf6-ef3a-4d66-ac42-1ecd64c3b99c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:21.559187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63359bf6-ef3a-4d66-ac42-1ecd64c3b99c None admin] PATH_INFO: `/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:21.560297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63359bf6-ef3a-4d66-ac42-1ecd64c3b99c None admin] RBAC: Authorizing `identity:get_project(project_id=0de93a8fd504402b8e0952e3b5e95ca3)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:21.561735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63359bf6-ef3a-4d66-ac42-1ecd64c3b99c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:21.563353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 540/1060] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:40:21 2022] GET /identity/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:21.563353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63359bf6-ef3a-4d66-ac42-1ecd64c3b99c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:21.584885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:21.612882 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36db4e-1850-4418-9804-df95696724a6 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:21.646628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944220cb-e92a-49e5-aa29-d99dd20cdeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:21.647238 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944220cb-e92a-49e5-aa29-d99dd20cdeab None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:21.647524 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944220cb-e92a-49e5-aa29-d99dd20cdeab None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:21.647801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944220cb-e92a-49e5-aa29-d99dd20cdeab None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:21.648432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944220cb-e92a-49e5-aa29-d99dd20cdeab None admin] RBAC: Adding query filter params (name=image) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:21.648741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944220cb-e92a-49e5-aa29-d99dd20cdeab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:21.650141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944220cb-e92a-49e5-aa29-d99dd20cdeab None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:21.655416 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 521/1061] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:21.656192 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944220cb-e92a-49e5-aa29-d99dd20cdeab None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:21.672977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63359bf6-ef3a-4d66-ac42-1ecd64c3b99c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:21.683305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:21.707588 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f7a5f-b737-46fe-838c-4631e1a6ae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:21.708223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f7a5f-b737-46fe-838c-4631e1a6ae2b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:21.708508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f7a5f-b737-46fe-838c-4631e1a6ae2b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:21.708785 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f7a5f-b737-46fe-838c-4631e1a6ae2b None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:21.709577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f7a5f-b737-46fe-838c-4631e1a6ae2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:21.709890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f7a5f-b737-46fe-838c-4631e1a6ae2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:21.711261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f7a5f-b737-46fe-838c-4631e1a6ae2b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:21.723935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 541/1062] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:21.724726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f7a5f-b737-46fe-838c-4631e1a6ae2b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:21.763315 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944220cb-e92a-49e5-aa29-d99dd20cdeab None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:21.796403 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031bbec-568b-4ac3-9959-68536ed9ae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:21.796902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:21.797052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031bbec-568b-4ac3-9959-68536ed9ae26 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:21.797371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031bbec-568b-4ac3-9959-68536ed9ae26 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:21.797647 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031bbec-568b-4ac3-9959-68536ed9ae26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:21.798369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031bbec-568b-4ac3-9959-68536ed9ae26 None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=0de93a8fd504402b8e0952e3b5e95ca3, user.id=e189d893ad434ca78c1b409057f83db0) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:21.798713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031bbec-568b-4ac3-9959-68536ed9ae26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:21.800095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031bbec-568b-4ac3-9959-68536ed9ae26 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:21.805333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 522/1063] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:40:21 2022] GET /identity/v3/role_assignments?user.id=e189d893ad434ca78c1b409057f83db0&scope.project.id=0de93a8fd504402b8e0952e3b5e95ca3&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:21.806100 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031bbec-568b-4ac3-9959-68536ed9ae26 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:21.824077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f7a5f-b737-46fe-838c-4631e1a6ae2b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:21.865139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f448a3-3ff1-47ec-aeb8-714716d7d0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:21.865676 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f448a3-3ff1-47ec-aeb8-714716d7d0f8 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:21.865971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f448a3-3ff1-47ec-aeb8-714716d7d0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:21.866250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f448a3-3ff1-47ec-aeb8-714716d7d0f8 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:21.866895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f448a3-3ff1-47ec-aeb8-714716d7d0f8 None admin] RBAC: Adding query filter params (type=image) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:21.867208 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f448a3-3ff1-47ec-aeb8-714716d7d0f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:21.868667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f448a3-3ff1-47ec-aeb8-714716d7d0f8 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:21.874142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 542/1064] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:21.879966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f448a3-3ff1-47ec-aeb8-714716d7d0f8 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:21.923550 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:21.939453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031bbec-568b-4ac3-9959-68536ed9ae26 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:21.979743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c544ec6-f535-4f63-a33c-13ce08222d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:21.980374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c544ec6-f535-4f63-a33c-13ce08222d3c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:21.980655 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c544ec6-f535-4f63-a33c-13ce08222d3c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:21.980928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c544ec6-f535-4f63-a33c-13ce08222d3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:21.988562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c544ec6-f535-4f63-a33c-13ce08222d3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:21.990091 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c544ec6-f535-4f63-a33c-13ce08222d3c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:21.997127 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f448a3-3ff1-47ec-aeb8-714716d7d0f8 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-1c544ec6-f535-4f63-a33c-13ce08222d3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:40:22.001752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:22.002885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:22.004062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:22.004062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:22.004062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:40:22.004062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:40:22.004062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:40:22.004062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:40:22.004062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:40:22.004062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:40:22.004062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:40:22.004062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:22.007556 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 523/1065] 10.222.0.76 () {56 vars in 1093 bytes} [Fri Aug 26 08:40:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:22.008349 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c544ec6-f535-4f63-a33c-13ce08222d3c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:22.038201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070429a-5fc9-4026-baff-7c7fcc19444a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:22.039287 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070429a-5fc9-4026-baff-7c7fcc19444a None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:22.039572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070429a-5fc9-4026-baff-7c7fcc19444a None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:22.039845 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070429a-5fc9-4026-baff-7c7fcc19444a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:22.040509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070429a-5fc9-4026-baff-7c7fcc19444a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:22.041918 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070429a-5fc9-4026-baff-7c7fcc19444a None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:22.050721 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:22.073596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 543/1066] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:40:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:40:22.126541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c544ec6-f535-4f63-a33c-13ce08222d3c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:22.169184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf982-5a27-42d0-b0c0-b497a40f77bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:22.169806 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf982-5a27-42d0-b0c0-b497a40f77bb None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:22.170082 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf982-5a27-42d0-b0c0-b497a40f77bb None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:22.170348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf982-5a27-42d0-b0c0-b497a40f77bb None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:22.171078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcf982-5a27-42d0-b0c0-b497a40f77bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:22.171374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcf982-5a27-42d0-b0c0-b497a40f77bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:22.172828 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcf982-5a27-42d0-b0c0-b497a40f77bb None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:22.188953 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:22.197406 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 524/1067] 10.222.0.76 () {56 vars in 1133 bytes} [Fri Aug 26 08:40:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:22.199981 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070429a-5fc9-4026-baff-7c7fcc19444a None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:22.310007 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070429a-5fc9-4026-baff-7c7fcc19444a None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:22.344780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2525b8-b067-49e6-ac8b-04876cf8656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:22.345443 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2525b8-b067-49e6-ac8b-04876cf8656e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:22.345728 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2525b8-b067-49e6-ac8b-04876cf8656e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:22.346000 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2525b8-b067-49e6-ac8b-04876cf8656e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:22.356536 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2525b8-b067-49e6-ac8b-04876cf8656e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:22.358014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2525b8-b067-49e6-ac8b-04876cf8656e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-ba2525b8-b067-49e6-ac8b-04876cf8656e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:40:22.371722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:22.372697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:40:22.373775 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:40:22.373775 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:22.373775 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:22.373775 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 544/1068] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:22.378613 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf982-5a27-42d0-b0c0-b497a40f77bb None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:22.480305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf982-5a27-42d0-b0c0-b497a40f77bb None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:22.513729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0883e-eb65-4fd4-8e74-a8d8a7c6df5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:22.514332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0883e-eb65-4fd4-8e74-a8d8a7c6df5e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:22.514614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0883e-eb65-4fd4-8e74-a8d8a7c6df5e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:22.514890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0883e-eb65-4fd4-8e74-a8d8a7c6df5e None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:22.515526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0883e-eb65-4fd4-8e74-a8d8a7c6df5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:22.515828 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0883e-eb65-4fd4-8e74-a8d8a7c6df5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:22.517212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0883e-eb65-4fd4-8e74-a8d8a7c6df5e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:22.533383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 525/1069] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:22.534849 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2525b8-b067-49e6-ac8b-04876cf8656e None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:22.586084 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:22.644340 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2525b8-b067-49e6-ac8b-04876cf8656e None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:22.677491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cf651-9cec-42e7-af98-192ea622c187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:22.678109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cf651-9cec-42e7-af98-192ea622c187 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:22.678386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cf651-9cec-42e7-af98-192ea622c187 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:22.678654 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cf651-9cec-42e7-af98-192ea622c187 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:22.685106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cf651-9cec-42e7-af98-192ea622c187 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:22.686528 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cf651-9cec-42e7-af98-192ea622c187 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:22.697365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-3e0cf651-9cec-42e7-af98-192ea622c187 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:40:22.697365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:22.697365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:22.697365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:22.697365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:22.697365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:22.697365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:22.697365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:22.697365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:22.697365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:22.697365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:22.697365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:22.697365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:40:22.697365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:40:22.697365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:22.698790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:22.704759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:40:22.704759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:40:22.704759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:40:22.704759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:40:22.704759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:40:22.704759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:40:22.704759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:40:22.704759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:22.704759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 545/1070] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:40:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:22.706571 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0883e-eb65-4fd4-8e74-a8d8a7c6df5e None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:22.769667 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:22.813164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0883e-eb65-4fd4-8e74-a8d8a7c6df5e None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:22.847820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd322cd-59da-46db-8ee9-7f8462679dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:22.848486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd322cd-59da-46db-8ee9-7f8462679dfa None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:22.848774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd322cd-59da-46db-8ee9-7f8462679dfa None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:22.849073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd322cd-59da-46db-8ee9-7f8462679dfa None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:22.849764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd322cd-59da-46db-8ee9-7f8462679dfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:22.850071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd322cd-59da-46db-8ee9-7f8462679dfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:22.851505 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd322cd-59da-46db-8ee9-7f8462679dfa None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:22.869043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 526/1071] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:40:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:22.870812 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cf651-9cec-42e7-af98-192ea622c187 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:22.973724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cf651-9cec-42e7-af98-192ea622c187 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:22.980580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:23.009042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526011c-c2cf-4eff-a63e-68e77b056567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:23.009701 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526011c-c2cf-4eff-a63e-68e77b056567 None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:23.009986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526011c-c2cf-4eff-a63e-68e77b056567 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:23.010261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526011c-c2cf-4eff-a63e-68e77b056567 None admin] PATH_INFO: `/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/b63d6e588f6e4b598b75a2ec13bea25d/roles/75a13a03465940de85c2cbbcc2195510` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:23.012927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526011c-c2cf-4eff-a63e-68e77b056567 None admin] RBAC: Authorizing `identity:create_grant(project_id=35aafba89a1d47cd86cef1eb0a11e507, user_id=b63d6e588f6e4b598b75a2ec13bea25d, role_id=75a13a03465940de85c2cbbcc2195510)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:23.014380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526011c-c2cf-4eff-a63e-68e77b056567 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:23.027032 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 546/1072] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:40:22 2022] PUT /identity/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/b63d6e588f6e4b598b75a2ec13bea25d/roles/75a13a03465940de85c2cbbcc2195510 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:40:23.715643 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a6bf8-647b-4aec-9659-98fc09ea241a None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:23.716182 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a6bf8-647b-4aec-9659-98fc09ea241a None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:23.716182 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a6bf8-647b-4aec-9659-98fc09ea241a None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:23.717701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 527/1073] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:40:23.722660 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533b3ae-bf36-41d5-8ca2-4498df56cacf None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:23.723109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533b3ae-bf36-41d5-8ca2-4498df56cacf None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:23.723257 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533b3ae-bf36-41d5-8ca2-4498df56cacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:23.742159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-5533b3ae-bf36-41d5-8ca2-4498df56cacf None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:23.743353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-5533b3ae-bf36-41d5-8ca2-4498df56cacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:23.811660 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 547/1074] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:24.009583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6e5c-cac6-4fec-8931-bc9a63b0f990 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:24.009968 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6e5c-cac6-4fec-8931-bc9a63b0f990 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:24.010165 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6e5c-cac6-4fec-8931-bc9a63b0f990 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:24.011636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 528/1075] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:24.016546 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4aa7c5-a062-4d22-a852-63649ab34b53 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:24.016837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4aa7c5-a062-4d22-a852-63649ab34b53 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:24.017146 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4aa7c5-a062-4d22-a852-63649ab34b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:24.034942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-aa4aa7c5-a062-4d22-a852-63649ab34b53 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:24.036115 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-aa4aa7c5-a062-4d22-a852-63649ab34b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:24.083773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6e5c-cac6-4fec-8931-bc9a63b0f990 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:24.106285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 548/1076] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:24.188658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6e5c-cac6-4fec-8931-bc9a63b0f990 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:24.208515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:24.224357 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178a103-6e43-4c4b-9739-e19a1cc7cff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:24.224980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178a103-6e43-4c4b-9739-e19a1cc7cff7 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:24.225290 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178a103-6e43-4c4b-9739-e19a1cc7cff7 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:24.225623 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178a103-6e43-4c4b-9739-e19a1cc7cff7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:24.236537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178a103-6e43-4c4b-9739-e19a1cc7cff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-d178a103-6e43-4c4b-9739-e19a1cc7cff7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:40:24.241217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:24.242155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:24.243037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:24.243037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:24.243037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:24.243037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:24.243037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:40:24.243037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:40:24.243037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:40:24.243037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:40:24.243037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:40:24.243037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:40:24.243037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:40:24.243037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:24.245300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 529/1077] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:40:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:24.248354 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4aa7c5-a062-4d22-a852-63649ab34b53 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:24.274982 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:24.350528 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4aa7c5-a062-4d22-a852-63649ab34b53 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:24.372095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178a103-6e43-4c4b-9739-e19a1cc7cff7 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:24.385428 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4969f-1626-407c-8eb8-0d132b2290f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:24.386041 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4969f-1626-407c-8eb8-0d132b2290f9 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:24.386323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4969f-1626-407c-8eb8-0d132b2290f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:24.386597 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4969f-1626-407c-8eb8-0d132b2290f9 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:24.387264 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4969f-1626-407c-8eb8-0d132b2290f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:24.387575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4969f-1626-407c-8eb8-0d132b2290f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:24.388932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4969f-1626-407c-8eb8-0d132b2290f9 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:24.397658 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 549/1078] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:40:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:24.403438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4969f-1626-407c-8eb8-0d132b2290f9 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:24.487790 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178a103-6e43-4c4b-9739-e19a1cc7cff7 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:24.498123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:24.511570 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4969f-1626-407c-8eb8-0d132b2290f9 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:24.524966 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f4f56-4251-404a-ab94-ae5d458fb74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:24.525672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f4f56-4251-404a-ab94-ae5d458fb74c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:24.525893 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f4f56-4251-404a-ab94-ae5d458fb74c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:24.526670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f4f56-4251-404a-ab94-ae5d458fb74c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:24.550330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4930035-b534-4855-961f-3bfabd39682f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:24.550656 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4930035-b534-4855-961f-3bfabd39682f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:24.550940 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4930035-b534-4855-961f-3bfabd39682f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:24.551216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4930035-b534-4855-961f-3bfabd39682f None admin] PATH_INFO: `/v3/users/e189d893ad434ca78c1b409057f83db0` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:24.552353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4930035-b534-4855-961f-3bfabd39682f None admin] RBAC: Authorizing `identity:get_user(user_id=e189d893ad434ca78c1b409057f83db0)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:24.553920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4930035-b534-4855-961f-3bfabd39682f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:24.560282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 550/1079] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:40:24 2022] GET /identity/v3/users/e189d893ad434ca78c1b409057f83db0 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:24.560953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4930035-b534-4855-961f-3bfabd39682f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:24.585712 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:24.608702 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f4f56-4251-404a-ab94-ae5d458fb74c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:24.610178 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f4f56-4251-404a-ab94-ae5d458fb74c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:24.679038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4930035-b534-4855-961f-3bfabd39682f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:24.715799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77eeec5-8d79-49b3-9b09-7fcb68c46659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:24.716752 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77eeec5-8d79-49b3-9b09-7fcb68c46659 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:24.717231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 530/1080] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:40:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 08:40:24.722204 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77eeec5-8d79-49b3-9b09-7fcb68c46659 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:24.722291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77eeec5-8d79-49b3-9b09-7fcb68c46659 None admin] PATH_INFO: `/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:24.723053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f4f56-4251-404a-ab94-ae5d458fb74c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:24.723417 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77eeec5-8d79-49b3-9b09-7fcb68c46659 None admin] RBAC: Authorizing `identity:get_project(project_id=0de93a8fd504402b8e0952e3b5e95ca3)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:24.724951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77eeec5-8d79-49b3-9b09-7fcb68c46659 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:24.731415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 551/1081] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:40:24 2022] GET /identity/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:24.732781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77eeec5-8d79-49b3-9b09-7fcb68c46659 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:24.758239 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:24.811409 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:24.831674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f4f56-4251-404a-ab94-ae5d458fb74c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:24.841146 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77eeec5-8d79-49b3-9b09-7fcb68c46659 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:24.867730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01bf14-cbf6-4012-878c-d41a1fa17537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:24.868354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01bf14-cbf6-4012-878c-d41a1fa17537 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:24.868642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01bf14-cbf6-4012-878c-d41a1fa17537 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:24.868914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01bf14-cbf6-4012-878c-d41a1fa17537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:24.879202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01bf14-cbf6-4012-878c-d41a1fa17537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:24.880630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01bf14-cbf6-4012-878c-d41a1fa17537 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:24.882083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cf52f-c8ef-49cb-ace4-56b553a0c0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:24.883532 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cf52f-c8ef-49cb-ace4-56b553a0c0e0 None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:24.883994 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cf52f-c8ef-49cb-ace4-56b553a0c0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:24.884464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cf52f-c8ef-49cb-ace4-56b553a0c0e0 None admin] PATH_INFO: `/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3/users/e189d893ad434ca78c1b409057f83db0/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:24.887052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cf52f-c8ef-49cb-ace4-56b553a0c0e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0de93a8fd504402b8e0952e3b5e95ca3, user_id=e189d893ad434ca78c1b409057f83db0, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:24.889164 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cf52f-c8ef-49cb-ace4-56b553a0c0e0 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-9e01bf14-cbf6-4012-878c-d41a1fa17537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:40:24.896001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:24.897049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:40:24.897977 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:40:24.897977 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:24.897977 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:24.902823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 531/1082] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:24.903416 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01bf14-cbf6-4012-878c-d41a1fa17537 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:24.905837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 552/1083] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:40:24 2022] PUT /identity/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3/users/e189d893ad434ca78c1b409057f83db0/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:40:24.920449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c40ef-0c43-417c-a414-6fd9aa44c6e8 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:24.920813 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c40ef-0c43-417c-a414-6fd9aa44c6e8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:24.921446 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c40ef-0c43-417c-a414-6fd9aa44c6e8 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:24.922739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 553/1084] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:40:24.928758 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349682e4-a65a-4776-9dd5-083743fbf791 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:24.929082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349682e4-a65a-4776-9dd5-083743fbf791 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:24.929384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349682e4-a65a-4776-9dd5-083743fbf791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:24.949078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-349682e4-a65a-4776-9dd5-083743fbf791 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:24.950316 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-349682e4-a65a-4776-9dd5-083743fbf791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:25.024499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01bf14-cbf6-4012-878c-d41a1fa17537 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:25.027527 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 554/1085] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:40:25.059496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:25.065669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e35127-5748-4392-84cd-ba343412a8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:25.066285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e35127-5748-4392-84cd-ba343412a8ff None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:25.066568 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e35127-5748-4392-84cd-ba343412a8ff None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:25.066855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e35127-5748-4392-84cd-ba343412a8ff None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:25.067551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e35127-5748-4392-84cd-ba343412a8ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:25.067861 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e35127-5748-4392-84cd-ba343412a8ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:25.069256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e35127-5748-4392-84cd-ba343412a8ff None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:25.081991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 532/1086] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:25.297655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349682e4-a65a-4776-9dd5-083743fbf791 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:25.313322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:25.400824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349682e4-a65a-4776-9dd5-083743fbf791 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:25.434639 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa1570-b8a1-44c2-a0be-3b372d373483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:25.435255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa1570-b8a1-44c2-a0be-3b372d373483 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:25.435532 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa1570-b8a1-44c2-a0be-3b372d373483 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:25.435801 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa1570-b8a1-44c2-a0be-3b372d373483 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:25.445520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa1570-b8a1-44c2-a0be-3b372d373483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-54aa1570-b8a1-44c2-a0be-3b372d373483 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:40:25.450162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:25.451246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:25.452124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:25.452124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:25.452124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:25.452124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:25.452124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:40:25.452124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:40:25.452124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:40:25.452124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:40:25.452124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:40:25.452124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:40:25.452124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 08:40:25.452124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:25.452124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 555/1087] 10.222.0.76 () {56 vars in 1120 bytes} [Fri Aug 26 08:40:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:25.457291 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e35127-5748-4392-84cd-ba343412a8ff None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:25.553149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e35127-5748-4392-84cd-ba343412a8ff None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:25.587067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604732d0-98a9-41de-af08-f5e2be7eb69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:25.587668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604732d0-98a9-41de-af08-f5e2be7eb69a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:25.587944 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604732d0-98a9-41de-af08-f5e2be7eb69a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:25.588216 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604732d0-98a9-41de-af08-f5e2be7eb69a None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:25.588895 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604732d0-98a9-41de-af08-f5e2be7eb69a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:25.589483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604732d0-98a9-41de-af08-f5e2be7eb69a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:25.590840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604732d0-98a9-41de-af08-f5e2be7eb69a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:25.598490 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 533/1088] 10.222.0.76 () {56 vars in 1115 bytes} [Fri Aug 26 08:40:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:25.604797 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa1570-b8a1-44c2-a0be-3b372d373483 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:25.679418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:25.704686 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa1570-b8a1-44c2-a0be-3b372d373483 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:25.738406 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754224c-aba5-4765-abf9-3390a50a8148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:25.739029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754224c-aba5-4765-abf9-3390a50a8148 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:25.739294 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754224c-aba5-4765-abf9-3390a50a8148 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:25.739569 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754224c-aba5-4765-abf9-3390a50a8148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:25.749997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754224c-aba5-4765-abf9-3390a50a8148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:25.751503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754224c-aba5-4765-abf9-3390a50a8148 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-8754224c-aba5-4765-abf9-3390a50a8148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:40:25.765303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:25.766261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:40:25.767198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:40:25.767198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:25.767198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:25.767198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 556/1089] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:25.772223 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604732d0-98a9-41de-af08-f5e2be7eb69a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:25.826674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:25.873187 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604732d0-98a9-41de-af08-f5e2be7eb69a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:25.906362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c794af6-7e39-4d93-a6dd-74cc2008f4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:25.906964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c794af6-7e39-4d93-a6dd-74cc2008f4ff None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:25.907244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c794af6-7e39-4d93-a6dd-74cc2008f4ff None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:25.907513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c794af6-7e39-4d93-a6dd-74cc2008f4ff None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:25.908152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c794af6-7e39-4d93-a6dd-74cc2008f4ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:25.908453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c794af6-7e39-4d93-a6dd-74cc2008f4ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:25.909831 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c794af6-7e39-4d93-a6dd-74cc2008f4ff None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:25.921774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 534/1090] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:25.927591 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754224c-aba5-4765-abf9-3390a50a8148 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:26.027774 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754224c-aba5-4765-abf9-3390a50a8148 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:26.052278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:26.061324 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e931ff-b65d-4f15-a2b9-a10a1b42c030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:26.061948 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e931ff-b65d-4f15-a2b9-a10a1b42c030 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:26.062230 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e931ff-b65d-4f15-a2b9-a10a1b42c030 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:26.062508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e931ff-b65d-4f15-a2b9-a10a1b42c030 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:26.069711 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e931ff-b65d-4f15-a2b9-a10a1b42c030 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:26.071137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e931ff-b65d-4f15-a2b9-a10a1b42c030 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-b5e931ff-b65d-4f15-a2b9-a10a1b42c030 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:40:26.082473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:26.083474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:26.084436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:26.084436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:26.084436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:40:26.084436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:40:26.084436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:40:26.084436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:40:26.084436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:40:26.084436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:40:26.084436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 08:40:26.084436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:26.084436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 557/1091] 10.222.0.76 () {56 vars in 1093 bytes} [Fri Aug 26 08:40:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:26.091114 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c794af6-7e39-4d93-a6dd-74cc2008f4ff None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:26.186651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c794af6-7e39-4d93-a6dd-74cc2008f4ff None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:26.200550 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:26.220746 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9808d1-9515-4dc2-9a13-4b2471b26112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:26.221375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9808d1-9515-4dc2-9a13-4b2471b26112 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:26.221658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9808d1-9515-4dc2-9a13-4b2471b26112 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:26.221931 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9808d1-9515-4dc2-9a13-4b2471b26112 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:26.222655 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9808d1-9515-4dc2-9a13-4b2471b26112 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:26.222958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9808d1-9515-4dc2-9a13-4b2471b26112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:26.224376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9808d1-9515-4dc2-9a13-4b2471b26112 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:26.241011 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 535/1092] 10.222.0.76 () {56 vars in 1133 bytes} [Fri Aug 26 08:40:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:26.246829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e931ff-b65d-4f15-a2b9-a10a1b42c030 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:26.344751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e931ff-b65d-4f15-a2b9-a10a1b42c030 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:26.376815 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f28e2-5eff-437e-90f7-88f97f316e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:26.377443 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f28e2-5eff-437e-90f7-88f97f316e8c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:26.377727 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f28e2-5eff-437e-90f7-88f97f316e8c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:26.377998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f28e2-5eff-437e-90f7-88f97f316e8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:26.430493 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:26.444061 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f28e2-5eff-437e-90f7-88f97f316e8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:26.445531 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f28e2-5eff-437e-90f7-88f97f316e8c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:26.540322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 558/1093] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:40:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:40:26.546065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9808d1-9515-4dc2-9a13-4b2471b26112 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:26.648375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9808d1-9515-4dc2-9a13-4b2471b26112 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:26.681709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e48c7a-15bb-4d2b-8935-efdcb4789d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:26.682868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e48c7a-15bb-4d2b-8935-efdcb4789d14 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:26.683148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e48c7a-15bb-4d2b-8935-efdcb4789d14 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:26.683418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e48c7a-15bb-4d2b-8935-efdcb4789d14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:26.693313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e48c7a-15bb-4d2b-8935-efdcb4789d14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:26.694775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e48c7a-15bb-4d2b-8935-efdcb4789d14 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-12e48c7a-15bb-4d2b-8935-efdcb4789d14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:40:26.709515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:26.710485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:40:26.711444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:40:26.711444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:40:26.711444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:26.711444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 536/1094] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:26.716595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f28e2-5eff-437e-90f7-88f97f316e8c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:26.798036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:26.808540 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb10514-4527-4307-96ce-6faaf89dfb0d None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:26.809057 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb10514-4527-4307-96ce-6faaf89dfb0d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:26.809153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb10514-4527-4307-96ce-6faaf89dfb0d None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:26.810454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 537/1095] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:40:26.814200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f28e2-5eff-437e-90f7-88f97f316e8c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:26.815388 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f388-eeca-4727-882b-a9f6a856f9ac None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:26.815671 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f388-eeca-4727-882b-a9f6a856f9ac None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:26.815947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f388-eeca-4727-882b-a9f6a856f9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:26.833898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-d1b3f388-eeca-4727-882b-a9f6a856f9ac None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:26.835109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d1b3f388-eeca-4727-882b-a9f6a856f9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:26.849292 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3feeae-2dd0-4be4-86df-1c8e843b3d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:26.849886 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3feeae-2dd0-4be4-86df-1c8e843b3d18 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:26.850165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3feeae-2dd0-4be4-86df-1c8e843b3d18 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:26.850436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3feeae-2dd0-4be4-86df-1c8e843b3d18 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:26.851059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3feeae-2dd0-4be4-86df-1c8e843b3d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:26.851359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3feeae-2dd0-4be4-86df-1c8e843b3d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:26.852523 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:26.852708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3feeae-2dd0-4be4-86df-1c8e843b3d18 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:26.864233 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 559/1096] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:26.870555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3feeae-2dd0-4be4-86df-1c8e843b3d18 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:26.905826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 538/1097] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:40:26.966275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3feeae-2dd0-4be4-86df-1c8e843b3d18 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:27.000013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e226ef-bfb6-475c-8914-1fda673cba55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:27.000636 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e226ef-bfb6-475c-8914-1fda673cba55 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:27.000920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e226ef-bfb6-475c-8914-1fda673cba55 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:27.001266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e226ef-bfb6-475c-8914-1fda673cba55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:27.007777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e226ef-bfb6-475c-8914-1fda673cba55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:27.009235 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e226ef-bfb6-475c-8914-1fda673cba55 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:27.020322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-a3e226ef-bfb6-475c-8914-1fda673cba55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:40:27.020322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:27.020322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:27.020322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:27.020322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:27.020322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:27.020322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:27.020322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:27.020322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:27.020322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:27.020322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:27.020322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:27.020322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:40:27.020322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:40:27.020322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:27.021382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:27.022321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:40:27.022321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:40:27.022321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:40:27.022321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:40:27.022321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:40:27.022321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:40:27.022321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:40:27.022321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:27.022321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 560/1098] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:40:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:27.027477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3f388-eeca-4727-882b-a9f6a856f9ac None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:27.123949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3f388-eeca-4727-882b-a9f6a856f9ac None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:27.157261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09809af2-9d4d-4f0d-ad1b-97db85dee2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:27.157796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09809af2-9d4d-4f0d-ad1b-97db85dee2c4 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:27.158073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09809af2-9d4d-4f0d-ad1b-97db85dee2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:27.158343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09809af2-9d4d-4f0d-ad1b-97db85dee2c4 None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:27.159029 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09809af2-9d4d-4f0d-ad1b-97db85dee2c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:27.159333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09809af2-9d4d-4f0d-ad1b-97db85dee2c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:27.160748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09809af2-9d4d-4f0d-ad1b-97db85dee2c4 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:27.170830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e226ef-bfb6-475c-8914-1fda673cba55 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:27.171938 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 539/1099] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:27.179933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09809af2-9d4d-4f0d-ad1b-97db85dee2c4 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:27.180959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:27.196690 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:27.276306 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e226ef-bfb6-475c-8914-1fda673cba55 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:27.281418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09809af2-9d4d-4f0d-ad1b-97db85dee2c4 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:27.308935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7b5af-6a48-44c6-b8a8-1f58a66b3687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:27.309786 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7b5af-6a48-44c6-b8a8-1f58a66b3687 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:27.310071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7b5af-6a48-44c6-b8a8-1f58a66b3687 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:27.310346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7b5af-6a48-44c6-b8a8-1f58a66b3687 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:27.314344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c798dc-a83d-4010-b83b-7fe571dba937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:27.314946 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c798dc-a83d-4010-b83b-7fe571dba937 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:27.315225 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c798dc-a83d-4010-b83b-7fe571dba937 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:27.315495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c798dc-a83d-4010-b83b-7fe571dba937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:27.316214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c798dc-a83d-4010-b83b-7fe571dba937 None admin] RBAC: Adding query filter params (role.id=75a13a03465940de85c2cbbcc2195510, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=b63d6e588f6e4b598b75a2ec13bea25d) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:27.316522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c798dc-a83d-4010-b83b-7fe571dba937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:27.317974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c798dc-a83d-4010-b83b-7fe571dba937 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:27.320799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7b5af-6a48-44c6-b8a8-1f58a66b3687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:40:27.324144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 540/1100] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:40:27 2022] GET /identity/v3/role_assignments?user.id=b63d6e588f6e4b598b75a2ec13bea25d&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=75a13a03465940de85c2cbbcc2195510 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-e3b7b5af-6a48-44c6-b8a8-1f58a66b3687 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:40:27.326123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:27.327216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:27.328082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:27.328082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:27.328082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:27.328082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:27.328082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:40:27.328082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:40:27.328082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:40:27.328082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:40:27.328082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:40:27.328082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:40:27.328082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:40:27.328082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:27.328082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 561/1101] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:40:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:40:27.333403 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c798dc-a83d-4010-b83b-7fe571dba937 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:27.419253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:27.442722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c798dc-a83d-4010-b83b-7fe571dba937 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:27.478360 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c561e6e-cc17-4d85-9d7c-f7e7e834c276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:27.478969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c561e6e-cc17-4d85-9d7c-f7e7e834c276 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:27.479308 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c561e6e-cc17-4d85-9d7c-f7e7e834c276 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:27.479585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c561e6e-cc17-4d85-9d7c-f7e7e834c276 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:27.480250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c561e6e-cc17-4d85-9d7c-f7e7e834c276 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:27.480556 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c561e6e-cc17-4d85-9d7c-f7e7e834c276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:27.481949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c561e6e-cc17-4d85-9d7c-f7e7e834c276 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:27.490785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 541/1102] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:40:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:27.496906 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7b5af-6a48-44c6-b8a8-1f58a66b3687 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:27.563314 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:27.603342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7b5af-6a48-44c6-b8a8-1f58a66b3687 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:27.638827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdd6c2-c8d5-4d70-88d5-b42525869bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:27.639463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdd6c2-c8d5-4d70-88d5-b42525869bef None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:27.639749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdd6c2-c8d5-4d70-88d5-b42525869bef None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:27.640025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdd6c2-c8d5-4d70-88d5-b42525869bef None admin] PATH_INFO: `/v3/users/e189d893ad434ca78c1b409057f83db0` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:27.641192 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cdd6c2-c8d5-4d70-88d5-b42525869bef None admin] RBAC: Authorizing `identity:get_user(user_id=e189d893ad434ca78c1b409057f83db0)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:27.642626 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cdd6c2-c8d5-4d70-88d5-b42525869bef None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:27.644223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 562/1103] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:40:27 2022] GET /identity/v3/users/e189d893ad434ca78c1b409057f83db0 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:27.650330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c561e6e-cc17-4d85-9d7c-f7e7e834c276 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:27.751477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c561e6e-cc17-4d85-9d7c-f7e7e834c276 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:27.785354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28c637-b302-4281-951f-dc8729fa04cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:27.785957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28c637-b302-4281-951f-dc8729fa04cd None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:27.786235 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28c637-b302-4281-951f-dc8729fa04cd None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:27.786504 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28c637-b302-4281-951f-dc8729fa04cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:27.797474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:27.853824 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28c637-b302-4281-951f-dc8729fa04cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:27.855772 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28c637-b302-4281-951f-dc8729fa04cd None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:27.952104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 542/1104] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:40:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:40:27.958119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdd6c2-c8d5-4d70-88d5-b42525869bef None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:28.061879 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdd6c2-c8d5-4d70-88d5-b42525869bef None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:28.095558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87b574-fa2e-4966-b8c7-a477ad49e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:28.096189 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87b574-fa2e-4966-b8c7-a477ad49e6ae None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:28.096473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87b574-fa2e-4966-b8c7-a477ad49e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:28.096751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87b574-fa2e-4966-b8c7-a477ad49e6ae None admin] PATH_INFO: `/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:28.097919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87b574-fa2e-4966-b8c7-a477ad49e6ae None admin] RBAC: Authorizing `identity:get_project(project_id=0de93a8fd504402b8e0952e3b5e95ca3)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:28.099375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87b574-fa2e-4966-b8c7-a477ad49e6ae None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:28.101024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 563/1105] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:40:27 2022] GET /identity/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:28.108812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28c637-b302-4281-951f-dc8729fa04cd None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:28.155060 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:28.212748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28c637-b302-4281-951f-dc8729fa04cd None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:28.246215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73512992-0aee-4da7-a329-9f3c9b140d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:28.246811 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73512992-0aee-4da7-a329-9f3c9b140d99 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:28.247091 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73512992-0aee-4da7-a329-9f3c9b140d99 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:28.247364 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73512992-0aee-4da7-a329-9f3c9b140d99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:28.248079 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73512992-0aee-4da7-a329-9f3c9b140d99 None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=0de93a8fd504402b8e0952e3b5e95ca3, user.id=e189d893ad434ca78c1b409057f83db0) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:28.248387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73512992-0aee-4da7-a329-9f3c9b140d99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:28.249830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73512992-0aee-4da7-a329-9f3c9b140d99 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:28.255329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 543/1106] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:40:28 2022] GET /identity/v3/role_assignments?user.id=e189d893ad434ca78c1b409057f83db0&scope.project.id=0de93a8fd504402b8e0952e3b5e95ca3&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:30.155368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35023e0-39c8-4a02-a33b-59047b3ef900 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:30.155902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35023e0-39c8-4a02-a33b-59047b3ef900 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:30.155902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35023e0-39c8-4a02-a33b-59047b3ef900 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:30.157261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 564/1107] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:30.162355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d794de-d489-449f-bc05-ee90df8fbc9f None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:30.162732 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d794de-d489-449f-bc05-ee90df8fbc9f None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:30.162917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d794de-d489-449f-bc05-ee90df8fbc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:30.181114 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-e3d794de-d489-449f-bc05-ee90df8fbc9f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:30.182296 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-e3d794de-d489-449f-bc05-ee90df8fbc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:30.246189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 544/1108] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:30.514188 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35023e0-39c8-4a02-a33b-59047b3ef900 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:30.516982 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:30.615177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35023e0-39c8-4a02-a33b-59047b3ef900 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:30.647932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1ba44-9363-4eb7-8f53-99697fed27c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:30.648542 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1ba44-9363-4eb7-8f53-99697fed27c8 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:30.648822 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1ba44-9363-4eb7-8f53-99697fed27c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:30.649126 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1ba44-9363-4eb7-8f53-99697fed27c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:30.650213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1ba44-9363-4eb7-8f53-99697fed27c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:30.651627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1ba44-9363-4eb7-8f53-99697fed27c8 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:30.653186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 565/1109] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:30.658876 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d794de-d489-449f-bc05-ee90df8fbc9f None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:30.692038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:30.756200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d794de-d489-449f-bc05-ee90df8fbc9f None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:30.788166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d622c-1b49-4941-b86c-fb8ad6d8020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:30.788694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d622c-1b49-4941-b86c-fb8ad6d8020d None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:30.788975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d622c-1b49-4941-b86c-fb8ad6d8020d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:30.789277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d622c-1b49-4941-b86c-fb8ad6d8020d None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:30.789921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d622c-1b49-4941-b86c-fb8ad6d8020d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:30.791323 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d622c-1b49-4941-b86c-fb8ad6d8020d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:30.812206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 545/1110] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:40:30 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:40:32.715788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8597ce-d0f7-4dc2-b53d-63baa59c09a4 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:32.716297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8597ce-d0f7-4dc2-b53d-63baa59c09a4 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:32.716386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8597ce-d0f7-4dc2-b53d-63baa59c09a4 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:32.717691 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 566/1111] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:32.722906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbc683-3d0c-4dce-a3d4-8ea8f6e8c5b9 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:32.723342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbc683-3d0c-4dce-a3d4-8ea8f6e8c5b9 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:32.723469 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbc683-3d0c-4dce-a3d4-8ea8f6e8c5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:32.742288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-dadbc683-3d0c-4dce-a3d4-8ea8f6e8c5b9 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:32.743474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-dadbc683-3d0c-4dce-a3d4-8ea8f6e8c5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:32.806988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 546/1112] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:33.074394 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8597ce-d0f7-4dc2-b53d-63baa59c09a4 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:33.142152 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:33.174047 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8597ce-d0f7-4dc2-b53d-63baa59c09a4 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:33.206367 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1895e-24e7-4785-9372-750a23767c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:33.206980 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1895e-24e7-4785-9372-750a23767c83 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:33.207263 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1895e-24e7-4785-9372-750a23767c83 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:33.207540 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1895e-24e7-4785-9372-750a23767c83 None admin] PATH_INFO: `/v3/roles/222316862a15450198a3b454c14558c4` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:33.208922 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1895e-24e7-4785-9372-750a23767c83 None admin] RBAC: Authorizing `identity:get_role(role_id=222316862a15450198a3b454c14558c4)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:33.210306 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1895e-24e7-4785-9372-750a23767c83 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:33.211630 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 567/1113] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:40:33 2022] GET /identity/v3/roles/222316862a15450198a3b454c14558c4 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:33.218165 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbc683-3d0c-4dce-a3d4-8ea8f6e8c5b9 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:33.238734 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:33.315153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbc683-3d0c-4dce-a3d4-8ea8f6e8c5b9 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:33.347971 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd45898-7a77-46e6-8e00-30ef79ec7dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:33.348583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd45898-7a77-46e6-8e00-30ef79ec7dcf None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:33.348859 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd45898-7a77-46e6-8e00-30ef79ec7dcf None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:33.349156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd45898-7a77-46e6-8e00-30ef79ec7dcf None admin] PATH_INFO: `/v3/users/87f37d9137fa4ed0937867d01d0b3c54` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:33.361572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd45898-7a77-46e6-8e00-30ef79ec7dcf None admin] RBAC: Authorizing `identity:get_user(user_id=87f37d9137fa4ed0937867d01d0b3c54)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:33.362989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd45898-7a77-46e6-8e00-30ef79ec7dcf None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:33.364532 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 547/1114] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:40:33 2022] GET /identity/v3/users/87f37d9137fa4ed0937867d01d0b3c54 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:33.370973 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1895e-24e7-4785-9372-750a23767c83 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:33.468543 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1895e-24e7-4785-9372-750a23767c83 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:33.501365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72179200-07e7-492a-add9-58fb4b3e42eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:33.501959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179200-07e7-492a-add9-58fb4b3e42eb None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:33.502244 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179200-07e7-492a-add9-58fb4b3e42eb None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:33.502524 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179200-07e7-492a-add9-58fb4b3e42eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:33.510819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:33.567839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72179200-07e7-492a-add9-58fb4b3e42eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:33.569298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72179200-07e7-492a-add9-58fb4b3e42eb None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:33.663319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 568/1115] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:40:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:40:33.669650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd45898-7a77-46e6-8e00-30ef79ec7dcf None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:33.745871 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:33.767368 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd45898-7a77-46e6-8e00-30ef79ec7dcf None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:33.800331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556508ec-585e-467f-98b9-f303fdd2e3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:33.800948 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556508ec-585e-467f-98b9-f303fdd2e3b8 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:33.801265 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556508ec-585e-467f-98b9-f303fdd2e3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:33.801543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556508ec-585e-467f-98b9-f303fdd2e3b8 None admin] PATH_INFO: `/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:33.802647 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556508ec-585e-467f-98b9-f303fdd2e3b8 None admin] RBAC: Authorizing `identity:get_project(project_id=0de93a8fd504402b8e0952e3b5e95ca3)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:33.804106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556508ec-585e-467f-98b9-f303fdd2e3b8 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:33.805729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 548/1116] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:40:33 2022] GET /identity/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:33.811905 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72179200-07e7-492a-add9-58fb4b3e42eb None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:33.850518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:33.909827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72179200-07e7-492a-add9-58fb4b3e42eb None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:33.942164 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f4457-51a2-4a75-9fe9-1486b7eaa598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:33.942700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f4457-51a2-4a75-9fe9-1486b7eaa598 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:33.942982 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f4457-51a2-4a75-9fe9-1486b7eaa598 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:33.943256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f4457-51a2-4a75-9fe9-1486b7eaa598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:33.943974 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f4457-51a2-4a75-9fe9-1486b7eaa598 None admin] RBAC: Adding query filter params (role.id=222316862a15450198a3b454c14558c4, scope.project.id=0de93a8fd504402b8e0952e3b5e95ca3, user.id=87f37d9137fa4ed0937867d01d0b3c54) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:33.944285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f4457-51a2-4a75-9fe9-1486b7eaa598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:33.945726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f4457-51a2-4a75-9fe9-1486b7eaa598 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:33.951391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 569/1117] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:40:33 2022] GET /identity/v3/role_assignments?user.id=87f37d9137fa4ed0937867d01d0b3c54&scope.project.id=0de93a8fd504402b8e0952e3b5e95ca3&role.id=222316862a15450198a3b454c14558c4 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:40:35.786642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152ff20-1375-49f1-ab93-74f2ce5d7f45 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:35.787205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152ff20-1375-49f1-ab93-74f2ce5d7f45 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:35.787205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152ff20-1375-49f1-ab93-74f2ce5d7f45 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:35.788510 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 549/1118] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:35.794067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d367cd-5e88-41d8-bf87-b28ebedaa05d None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:35.794460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d367cd-5e88-41d8-bf87-b28ebedaa05d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:35.794619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d367cd-5e88-41d8-bf87-b28ebedaa05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:35.811975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-43d367cd-5e88-41d8-bf87-b28ebedaa05d None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:35.813172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-43d367cd-5e88-41d8-bf87-b28ebedaa05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:35.877349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 570/1119] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:36.145087 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152ff20-1375-49f1-ab93-74f2ce5d7f45 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:36.242833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152ff20-1375-49f1-ab93-74f2ce5d7f45 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:36.276730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c7eab-6b8e-451a-8fdc-e19a0ffe2b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:36.277368 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7eab-6b8e-451a-8fdc-e19a0ffe2b33 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:36.277652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7eab-6b8e-451a-8fdc-e19a0ffe2b33 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:36.277927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7eab-6b8e-451a-8fdc-e19a0ffe2b33 None admin] PATH_INFO: `/v3/roles/222316862a15450198a3b454c14558c4` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:36.279307 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c7eab-6b8e-451a-8fdc-e19a0ffe2b33 None admin] RBAC: Authorizing `identity:get_role(role_id=222316862a15450198a3b454c14558c4)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:36.280669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c7eab-6b8e-451a-8fdc-e19a0ffe2b33 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:36.281970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 550/1120] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:40:36 2022] GET /identity/v3/roles/222316862a15450198a3b454c14558c4 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:36.287553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d367cd-5e88-41d8-bf87-b28ebedaa05d None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:36.316961 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:36.383038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d367cd-5e88-41d8-bf87-b28ebedaa05d None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:36.415153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be12fa4-f503-46ae-8c9c-51a95616b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:36.415710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be12fa4-f503-46ae-8c9c-51a95616b81b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:36.415985 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be12fa4-f503-46ae-8c9c-51a95616b81b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:36.416279 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be12fa4-f503-46ae-8c9c-51a95616b81b None admin] PATH_INFO: `/v3/users/87f37d9137fa4ed0937867d01d0b3c54` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:36.417387 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be12fa4-f503-46ae-8c9c-51a95616b81b None admin] RBAC: Authorizing `identity:get_user(user_id=87f37d9137fa4ed0937867d01d0b3c54)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:36.418796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be12fa4-f503-46ae-8c9c-51a95616b81b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:36.420324 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 571/1121] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:40:36 2022] GET /identity/v3/users/87f37d9137fa4ed0937867d01d0b3c54 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:36.426008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c7eab-6b8e-451a-8fdc-e19a0ffe2b33 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:36.441864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:36.524094 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c7eab-6b8e-451a-8fdc-e19a0ffe2b33 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:36.556443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a64891-4291-460d-9e61-0ad4bc16d93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:36.557611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64891-4291-460d-9e61-0ad4bc16d93e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:36.557891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64891-4291-460d-9e61-0ad4bc16d93e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:36.558165 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64891-4291-460d-9e61-0ad4bc16d93e None admin] PATH_INFO: `/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:36.559279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a64891-4291-460d-9e61-0ad4bc16d93e None admin] RBAC: Authorizing `identity:get_project(project_id=0de93a8fd504402b8e0952e3b5e95ca3)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:36.560695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a64891-4291-460d-9e61-0ad4bc16d93e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:36.562311 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 551/1122] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:40:36 2022] GET /identity/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:36.568297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be12fa4-f503-46ae-8c9c-51a95616b81b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:36.662085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:36.664940 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be12fa4-f503-46ae-8c9c-51a95616b81b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:36.698777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb560b18-19a6-43f2-8ef5-7cca339bfffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:36.699366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb560b18-19a6-43f2-8ef5-7cca339bfffd None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:36.699653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb560b18-19a6-43f2-8ef5-7cca339bfffd None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:36.699933 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb560b18-19a6-43f2-8ef5-7cca339bfffd None admin] PATH_INFO: `/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3/users/87f37d9137fa4ed0937867d01d0b3c54/roles/222316862a15450198a3b454c14558c4` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:36.702088 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb560b18-19a6-43f2-8ef5-7cca339bfffd None admin] RBAC: Authorizing `identity:create_grant(project_id=0de93a8fd504402b8e0952e3b5e95ca3, user_id=87f37d9137fa4ed0937867d01d0b3c54, role_id=222316862a15450198a3b454c14558c4)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:36.703507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb560b18-19a6-43f2-8ef5-7cca339bfffd None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:36.715549 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 572/1123] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:40:36 2022] PUT /identity/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3/users/87f37d9137fa4ed0937867d01d0b3c54/roles/222316862a15450198a3b454c14558c4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:40:38.555136 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411586f-4607-4a1b-b6e6-27db74b0b835 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:38.555696 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411586f-4607-4a1b-b6e6-27db74b0b835 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:38.555696 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411586f-4607-4a1b-b6e6-27db74b0b835 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:38.557055 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 552/1124] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:38.562136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda16ab-21b3-4260-8c8c-b5928ff68a35 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:38.562519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda16ab-21b3-4260-8c8c-b5928ff68a35 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:38.562697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda16ab-21b3-4260-8c8c-b5928ff68a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:38.580381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-8fda16ab-21b3-4260-8c8c-b5928ff68a35 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:38.581609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-8fda16ab-21b3-4260-8c8c-b5928ff68a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:38.646689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 573/1125] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:38.910689 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411586f-4607-4a1b-b6e6-27db74b0b835 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:38.991143 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:39.010335 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411586f-4607-4a1b-b6e6-27db74b0b835 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:39.044503 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa6d1d-502c-46f5-9424-9d446e19c005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:39.045151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa6d1d-502c-46f5-9424-9d446e19c005 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:39.045438 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa6d1d-502c-46f5-9424-9d446e19c005 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:39.045717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa6d1d-502c-46f5-9424-9d446e19c005 None admin] PATH_INFO: `/v3/roles/222316862a15450198a3b454c14558c4` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:39.047118 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa6d1d-502c-46f5-9424-9d446e19c005 None admin] RBAC: Authorizing `identity:get_role(role_id=222316862a15450198a3b454c14558c4)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:39.048470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa6d1d-502c-46f5-9424-9d446e19c005 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:39.049796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 553/1126] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:40:38 2022] GET /identity/v3/roles/222316862a15450198a3b454c14558c4 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:39.055731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda16ab-21b3-4260-8c8c-b5928ff68a35 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:39.141896 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:39.152865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda16ab-21b3-4260-8c8c-b5928ff68a35 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:39.184524 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c17f0c-a317-41fb-842d-68056f490378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:39.185097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c17f0c-a317-41fb-842d-68056f490378 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:39.185375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c17f0c-a317-41fb-842d-68056f490378 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:39.185646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c17f0c-a317-41fb-842d-68056f490378 None admin] PATH_INFO: `/v3/users/87f37d9137fa4ed0937867d01d0b3c54` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:39.186733 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c17f0c-a317-41fb-842d-68056f490378 None admin] RBAC: Authorizing `identity:get_user(user_id=87f37d9137fa4ed0937867d01d0b3c54)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:39.188144 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c17f0c-a317-41fb-842d-68056f490378 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:39.189715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 574/1127] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:40:39 2022] GET /identity/v3/users/87f37d9137fa4ed0937867d01d0b3c54 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:39.195428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa6d1d-502c-46f5-9424-9d446e19c005 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:39.291641 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa6d1d-502c-46f5-9424-9d446e19c005 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:39.324623 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09277dbd-1d5d-466e-a123-c249023b27c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:39.325244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09277dbd-1d5d-466e-a123-c249023b27c7 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:39.325521 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09277dbd-1d5d-466e-a123-c249023b27c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:39.325788 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09277dbd-1d5d-466e-a123-c249023b27c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:39.343269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:39.390804 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09277dbd-1d5d-466e-a123-c249023b27c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:39.392225 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09277dbd-1d5d-466e-a123-c249023b27c7 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:39.484669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 554/1128] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:40:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:40:39.490654 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c17f0c-a317-41fb-842d-68056f490378 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:39.586503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c17f0c-a317-41fb-842d-68056f490378 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:39.620262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ae49e-2bc3-4332-8370-7f134147563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:39.620870 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ae49e-2bc3-4332-8370-7f134147563f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:39.621186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ae49e-2bc3-4332-8370-7f134147563f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:39.621464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ae49e-2bc3-4332-8370-7f134147563f None admin] PATH_INFO: `/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:39.622567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ae49e-2bc3-4332-8370-7f134147563f None admin] RBAC: Authorizing `identity:get_project(project_id=0de93a8fd504402b8e0952e3b5e95ca3)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:39.623983 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ae49e-2bc3-4332-8370-7f134147563f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:39.625633 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 575/1129] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:40:39 2022] GET /identity/v3/projects/0de93a8fd504402b8e0952e3b5e95ca3 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:39.631639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09277dbd-1d5d-466e-a123-c249023b27c7 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:39.678919 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:39.726965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09277dbd-1d5d-466e-a123-c249023b27c7 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:39.759833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19694771-161c-42f3-916a-0580b53c7c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:39.760407 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19694771-161c-42f3-916a-0580b53c7c39 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:39.760685 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19694771-161c-42f3-916a-0580b53c7c39 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:39.760955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19694771-161c-42f3-916a-0580b53c7c39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:39.761686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19694771-161c-42f3-916a-0580b53c7c39 None admin] RBAC: Adding query filter params (role.id=222316862a15450198a3b454c14558c4, scope.project.id=0de93a8fd504402b8e0952e3b5e95ca3, user.id=87f37d9137fa4ed0937867d01d0b3c54) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:39.761992 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19694771-161c-42f3-916a-0580b53c7c39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:39.763397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19694771-161c-42f3-916a-0580b53c7c39 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:39.768855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 555/1130] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:40:39 2022] GET /identity/v3/role_assignments?user.id=87f37d9137fa4ed0937867d01d0b3c54&scope.project.id=0de93a8fd504402b8e0952e3b5e95ca3&role.id=222316862a15450198a3b454c14558c4 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:41.643432 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81eb65-0808-4d9a-83bb-3e77d5f3d88d None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:41.643957 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81eb65-0808-4d9a-83bb-3e77d5f3d88d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:41.643957 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81eb65-0808-4d9a-83bb-3e77d5f3d88d None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:41.645343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 576/1131] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:41.650533 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b05c57-38ce-45d7-88f3-6ed6d66c5c1f None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:41.650960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b05c57-38ce-45d7-88f3-6ed6d66c5c1f None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:41.651105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b05c57-38ce-45d7-88f3-6ed6d66c5c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:41.669146 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-93b05c57-38ce-45d7-88f3-6ed6d66c5c1f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:41.670313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-93b05c57-38ce-45d7-88f3-6ed6d66c5c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:41.733590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 556/1132] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:41.999919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81eb65-0808-4d9a-83bb-3e77d5f3d88d None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:42.026634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:42.098776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81eb65-0808-4d9a-83bb-3e77d5f3d88d None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:42.132715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f3a4a-1f2b-4db4-88d5-df3c11f1642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:42.133353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f3a4a-1f2b-4db4-88d5-df3c11f1642d None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:42.133637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f3a4a-1f2b-4db4-88d5-df3c11f1642d None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:42.133909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f3a4a-1f2b-4db4-88d5-df3c11f1642d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:42.135029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f3a4a-1f2b-4db4-88d5-df3c11f1642d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:42.136449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f3a4a-1f2b-4db4-88d5-df3c11f1642d None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:42.138001 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 577/1133] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:42.143663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b05c57-38ce-45d7-88f3-6ed6d66c5c1f None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:42.187237 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:42.239324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b05c57-38ce-45d7-88f3-6ed6d66c5c1f None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:42.271446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591c847-3027-4623-a95b-52f00e1a0a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:42.271980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591c847-3027-4623-a95b-52f00e1a0a8e None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:42.272260 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591c847-3027-4623-a95b-52f00e1a0a8e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:42.272531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591c847-3027-4623-a95b-52f00e1a0a8e None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:42.273354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591c847-3027-4623-a95b-52f00e1a0a8e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:42.274763 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591c847-3027-4623-a95b-52f00e1a0a8e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:42.300656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 557/1134] 10.222.0.76 () {60 vars in 1141 bytes} [Fri Aug 26 08:40:42 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:40:44.206912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bfffe-26e0-4ae8-8ba3-e51ffcbb2264 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:44.207475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bfffe-26e0-4ae8-8ba3-e51ffcbb2264 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:44.207475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bfffe-26e0-4ae8-8ba3-e51ffcbb2264 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:44.208802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 578/1135] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:44.214799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959965d2-18e4-496f-8800-bc87848a0969 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:44.215204 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959965d2-18e4-496f-8800-bc87848a0969 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:44.215359 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959965d2-18e4-496f-8800-bc87848a0969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:44.233021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-959965d2-18e4-496f-8800-bc87848a0969 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:44.234209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-959965d2-18e4-496f-8800-bc87848a0969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:44.298299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 558/1136] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:44.566150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bfffe-26e0-4ae8-8ba3-e51ffcbb2264 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:44.657495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:44.665303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bfffe-26e0-4ae8-8ba3-e51ffcbb2264 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:44.698459 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab1adc-9e44-4b14-8e90-861b570de208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:44.699065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab1adc-9e44-4b14-8e90-861b570de208 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:44.699345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab1adc-9e44-4b14-8e90-861b570de208 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:44.699617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab1adc-9e44-4b14-8e90-861b570de208 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:44.700708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab1adc-9e44-4b14-8e90-861b570de208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:44.702154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab1adc-9e44-4b14-8e90-861b570de208 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:44.703694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 579/1137] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:40:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:44.709398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959965d2-18e4-496f-8800-bc87848a0969 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:44.735503 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:44.806419 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959965d2-18e4-496f-8800-bc87848a0969 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:44.839866 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc37a4-6ee6-4bb2-8e91-3994aa05daff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:44.840456 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc37a4-6ee6-4bb2-8e91-3994aa05daff None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:44.840739 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc37a4-6ee6-4bb2-8e91-3994aa05daff None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:44.841033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc37a4-6ee6-4bb2-8e91-3994aa05daff None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:44.841683 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc37a4-6ee6-4bb2-8e91-3994aa05daff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:44.843095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc37a4-6ee6-4bb2-8e91-3994aa05daff None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:44.863212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 559/1138] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:40:44 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:40:46.768666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e3558-3ee4-4860-921d-78a7ebffe1bc None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:46.769214 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e3558-3ee4-4860-921d-78a7ebffe1bc None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:46.769294 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e3558-3ee4-4860-921d-78a7ebffe1bc None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:46.770589 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 580/1139] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:46.776451 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bca1b-050c-4c85-81bf-7d74e360cab0 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:46.776868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bca1b-050c-4c85-81bf-7d74e360cab0 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:46.776976 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bca1b-050c-4c85-81bf-7d74e360cab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:46.795081 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-656bca1b-050c-4c85-81bf-7d74e360cab0 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:46.796252 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-656bca1b-050c-4c85-81bf-7d74e360cab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:46.859646 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 560/1140] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:47.125857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e3558-3ee4-4860-921d-78a7ebffe1bc None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:47.224385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e3558-3ee4-4860-921d-78a7ebffe1bc None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:47.256116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4855351-9936-41b7-9cdf-11d28b3ff54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:47.256755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4855351-9936-41b7-9cdf-11d28b3ff54c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:47.257056 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4855351-9936-41b7-9cdf-11d28b3ff54c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:47.257333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4855351-9936-41b7-9cdf-11d28b3ff54c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:47.267456 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4855351-9936-41b7-9cdf-11d28b3ff54c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-b4855351-9936-41b7-9cdf-11d28b3ff54c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:40:47.272167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:47.273437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:47.274668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:47.274668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:47.274668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:47.274668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:47.274668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:40:47.274668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:40:47.274668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:40:47.274668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:40:47.274668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:40:47.274668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:40:47.274668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:40:47.274668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:47.274668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 581/1141] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:40:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:47.279524 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bca1b-050c-4c85-81bf-7d74e360cab0 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:47.293157 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:47.376800 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bca1b-050c-4c85-81bf-7d74e360cab0 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:47.410095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678188cb-8de9-4b77-95ab-c4cc5e646dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:47.410689 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678188cb-8de9-4b77-95ab-c4cc5e646dac None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:47.410968 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678188cb-8de9-4b77-95ab-c4cc5e646dac None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:47.411241 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678188cb-8de9-4b77-95ab-c4cc5e646dac None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:47.411896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678188cb-8de9-4b77-95ab-c4cc5e646dac None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:47.412199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678188cb-8de9-4b77-95ab-c4cc5e646dac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:47.413589 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678188cb-8de9-4b77-95ab-c4cc5e646dac None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:47.421337 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 561/1142] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:40:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:47.426994 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4855351-9936-41b7-9cdf-11d28b3ff54c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:47.451441 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:47.526697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4855351-9936-41b7-9cdf-11d28b3ff54c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:47.559343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d99fd-30be-4b5f-9b2e-ffc199c28e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:47.559958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d99fd-30be-4b5f-9b2e-ffc199c28e4c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:47.560243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d99fd-30be-4b5f-9b2e-ffc199c28e4c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:47.560515 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d99fd-30be-4b5f-9b2e-ffc199c28e4c None admin] PATH_INFO: `/v3/users/8fa05c031d634a01b078975445b0a7e1` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:47.573679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d99fd-30be-4b5f-9b2e-ffc199c28e4c None admin] RBAC: Authorizing `identity:get_user(user_id=8fa05c031d634a01b078975445b0a7e1)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:47.575113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d99fd-30be-4b5f-9b2e-ffc199c28e4c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:47.576719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 582/1143] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:40:47 2022] GET /identity/v3/users/8fa05c031d634a01b078975445b0a7e1 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:47.582541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678188cb-8de9-4b77-95ab-c4cc5e646dac None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:47.656560 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:47.681013 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678188cb-8de9-4b77-95ab-c4cc5e646dac None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:47.713822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bd560-6e06-484a-bf3a-0c7008ca3a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:47.714663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd560-6e06-484a-bf3a-0c7008ca3a99 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:47.714941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd560-6e06-484a-bf3a-0c7008ca3a99 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:47.715225 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd560-6e06-484a-bf3a-0c7008ca3a99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:47.779510 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bd560-6e06-484a-bf3a-0c7008ca3a99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:47.780926 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bd560-6e06-484a-bf3a-0c7008ca3a99 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:47.850257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:47.876090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 562/1144] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:40:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:40:47.881973 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d99fd-30be-4b5f-9b2e-ffc199c28e4c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:47.959205 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:47.977927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d99fd-30be-4b5f-9b2e-ffc199c28e4c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:48.010766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba9884-ee78-40f0-9b10-22cca4892810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:48.011379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba9884-ee78-40f0-9b10-22cca4892810 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:48.011661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba9884-ee78-40f0-9b10-22cca4892810 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:48.011935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba9884-ee78-40f0-9b10-22cca4892810 None admin] PATH_INFO: `/v3/projects/6acd762a29794ccdb7dc7f750c9f3ab5` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:48.013050 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba9884-ee78-40f0-9b10-22cca4892810 None admin] RBAC: Authorizing `identity:get_project(project_id=6acd762a29794ccdb7dc7f750c9f3ab5)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:48.014496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba9884-ee78-40f0-9b10-22cca4892810 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:48.016083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 583/1145] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:40:47 2022] GET /identity/v3/projects/6acd762a29794ccdb7dc7f750c9f3ab5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:48.022063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bd560-6e06-484a-bf3a-0c7008ca3a99 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:48.117892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bd560-6e06-484a-bf3a-0c7008ca3a99 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:48.151005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07251c4f-6733-40e7-9e0c-4883ee451248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:48.151596 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07251c4f-6733-40e7-9e0c-4883ee451248 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:48.151880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07251c4f-6733-40e7-9e0c-4883ee451248 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:48.152156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07251c4f-6733-40e7-9e0c-4883ee451248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:48.152873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07251c4f-6733-40e7-9e0c-4883ee451248 None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=6acd762a29794ccdb7dc7f750c9f3ab5, user.id=8fa05c031d634a01b078975445b0a7e1) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:48.153211 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07251c4f-6733-40e7-9e0c-4883ee451248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:48.154612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07251c4f-6733-40e7-9e0c-4883ee451248 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:48.159730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 563/1146] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:40:48 2022] GET /identity/v3/role_assignments?user.id=8fa05c031d634a01b078975445b0a7e1&scope.project.id=6acd762a29794ccdb7dc7f750c9f3ab5&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:50.049519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3279ff-8501-4459-871f-1e7f3e6bc095 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:50.050028 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3279ff-8501-4459-871f-1e7f3e6bc095 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:50.050140 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3279ff-8501-4459-871f-1e7f3e6bc095 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:50.051410 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 584/1147] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:40:50.056646 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfec98-1c29-4811-b815-56020ac21f76 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:50.057088 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfec98-1c29-4811-b815-56020ac21f76 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:50.057365 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfec98-1c29-4811-b815-56020ac21f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:50.075685 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-a2bfec98-1c29-4811-b815-56020ac21f76 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:50.076866 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a2bfec98-1c29-4811-b815-56020ac21f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:50.106696 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:50.142872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 564/1148] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:50.414819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3279ff-8501-4459-871f-1e7f3e6bc095 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:50.512462 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3279ff-8501-4459-871f-1e7f3e6bc095 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:50.544638 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2290c8d-c006-4737-a825-0165f7d395af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:50.545267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2290c8d-c006-4737-a825-0165f7d395af None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:50.545544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2290c8d-c006-4737-a825-0165f7d395af None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:50.545814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2290c8d-c006-4737-a825-0165f7d395af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:50.555340 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2290c8d-c006-4737-a825-0165f7d395af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-b2290c8d-c006-4737-a825-0165f7d395af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:40:50.560426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:50.561579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:50.562681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:50.562681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:50.562681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:50.562681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:50.562681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:40:50.562681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:40:50.562681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:40:50.562681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:40:50.562681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:40:50.562681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:40:50.562681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:40:50.562681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:50.562681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 585/1149] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:40:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:50.567378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfec98-1c29-4811-b815-56020ac21f76 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:50.663883 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfec98-1c29-4811-b815-56020ac21f76 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:50.696612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414d314-c8e7-4266-8ebd-264e17ec860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:50.697732 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414d314-c8e7-4266-8ebd-264e17ec860a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:50.698015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414d314-c8e7-4266-8ebd-264e17ec860a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:50.698291 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414d314-c8e7-4266-8ebd-264e17ec860a None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:50.698950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414d314-c8e7-4266-8ebd-264e17ec860a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:50.699255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414d314-c8e7-4266-8ebd-264e17ec860a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:50.700604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414d314-c8e7-4266-8ebd-264e17ec860a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:50.708317 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 565/1150] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:40:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:50.714044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2290c8d-c006-4737-a825-0165f7d395af None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:50.725498 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:50.812122 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2290c8d-c006-4737-a825-0165f7d395af None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:50.844743 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbc71f-7d47-4dac-88de-7741d05b3e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:50.845384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbc71f-7d47-4dac-88de-7741d05b3e4e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:50.845665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbc71f-7d47-4dac-88de-7741d05b3e4e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:50.845939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbc71f-7d47-4dac-88de-7741d05b3e4e None admin] PATH_INFO: `/v3/users/8fa05c031d634a01b078975445b0a7e1` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:50.847043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edbc71f-7d47-4dac-88de-7741d05b3e4e None admin] RBAC: Authorizing `identity:get_user(user_id=8fa05c031d634a01b078975445b0a7e1)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:50.848456 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edbc71f-7d47-4dac-88de-7741d05b3e4e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:50.850029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 586/1151] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:40:50 2022] GET /identity/v3/users/8fa05c031d634a01b078975445b0a7e1 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:50.856172 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414d314-c8e7-4266-8ebd-264e17ec860a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:50.886511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:50.954573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414d314-c8e7-4266-8ebd-264e17ec860a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:50.986867 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20478bce-6cf2-46d9-8213-0fff4d80ddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:50.987481 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20478bce-6cf2-46d9-8213-0fff4d80ddb1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:50.987767 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20478bce-6cf2-46d9-8213-0fff4d80ddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:50.988043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20478bce-6cf2-46d9-8213-0fff4d80ddb1 None admin] PATH_INFO: `/v3/projects/6acd762a29794ccdb7dc7f750c9f3ab5` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:50.989172 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20478bce-6cf2-46d9-8213-0fff4d80ddb1 None admin] RBAC: Authorizing `identity:get_project(project_id=6acd762a29794ccdb7dc7f750c9f3ab5)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:50.990593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20478bce-6cf2-46d9-8213-0fff4d80ddb1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:50.992166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 566/1152] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:40:50 2022] GET /identity/v3/projects/6acd762a29794ccdb7dc7f750c9f3ab5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:50.998652 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbc71f-7d47-4dac-88de-7741d05b3e4e None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:51.072960 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:51.095235 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbc71f-7d47-4dac-88de-7741d05b3e4e None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:51.128209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1994cf-f00b-41ca-b50c-e16652eb793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:51.128848 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1994cf-f00b-41ca-b50c-e16652eb793b None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:51.129165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1994cf-f00b-41ca-b50c-e16652eb793b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:51.129445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1994cf-f00b-41ca-b50c-e16652eb793b None admin] PATH_INFO: `/v3/projects/6acd762a29794ccdb7dc7f750c9f3ab5/users/8fa05c031d634a01b078975445b0a7e1/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:51.131324 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1994cf-f00b-41ca-b50c-e16652eb793b None admin] RBAC: Authorizing `identity:create_grant(project_id=6acd762a29794ccdb7dc7f750c9f3ab5, user_id=8fa05c031d634a01b078975445b0a7e1, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:51.132751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1994cf-f00b-41ca-b50c-e16652eb793b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:51.145483 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 587/1153] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:40:50 2022] PUT /identity/v3/projects/6acd762a29794ccdb7dc7f750c9f3ab5/users/8fa05c031d634a01b078975445b0a7e1/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:40:53.007909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0420eec-4a74-47b5-a923-2e74c8bb8e0a None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:53.008471 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0420eec-4a74-47b5-a923-2e74c8bb8e0a None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:53.008471 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0420eec-4a74-47b5-a923-2e74c8bb8e0a None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:53.009845 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 567/1154] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:53.015142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c93a1f-d9cd-487a-a3d3-f80d485fc242 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:53.015566 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c93a1f-d9cd-487a-a3d3-f80d485fc242 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:53.015694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c93a1f-d9cd-487a-a3d3-f80d485fc242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:53.033819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-72c93a1f-d9cd-487a-a3d3-f80d485fc242 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:53.035009 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-72c93a1f-d9cd-487a-a3d3-f80d485fc242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:53.099678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 588/1155] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:53.370897 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0420eec-4a74-47b5-a923-2e74c8bb8e0a None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:53.466225 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:53.471357 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0420eec-4a74-47b5-a923-2e74c8bb8e0a None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:53.504106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d2840-5ce6-441e-8a10-2548e0ba85fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:53.504713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d2840-5ce6-441e-8a10-2548e0ba85fd None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:53.505018 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d2840-5ce6-441e-8a10-2548e0ba85fd None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:53.505306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d2840-5ce6-441e-8a10-2548e0ba85fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:53.515584 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d2840-5ce6-441e-8a10-2548e0ba85fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-002d2840-5ce6-441e-8a10-2548e0ba85fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:40:53.520197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:53.521314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:53.522484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:53.522484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:53.522484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:53.522484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:53.522484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:40:53.522484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:40:53.522484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:40:53.522484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:40:53.522484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:40:53.522484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:40:53.522484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:40:53.522484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:40:53.522484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 568/1156] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:40:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:53.527166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c93a1f-d9cd-487a-a3d3-f80d485fc242 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:53.598092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:53.632294 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c93a1f-d9cd-487a-a3d3-f80d485fc242 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:53.664676 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38de63-67b0-42cb-aa57-c05c550da150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:53.665298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38de63-67b0-42cb-aa57-c05c550da150 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:53.665581 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38de63-67b0-42cb-aa57-c05c550da150 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:53.665879 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38de63-67b0-42cb-aa57-c05c550da150 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:53.666538 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38de63-67b0-42cb-aa57-c05c550da150 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:53.666843 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38de63-67b0-42cb-aa57-c05c550da150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:53.668199 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38de63-67b0-42cb-aa57-c05c550da150 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:53.675899 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 589/1157] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:40:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:53.682184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d2840-5ce6-441e-8a10-2548e0ba85fd None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:53.779519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d2840-5ce6-441e-8a10-2548e0ba85fd None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:53.812318 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520142fb-aa2a-425e-a36a-aa253bbf0c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:53.812925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520142fb-aa2a-425e-a36a-aa253bbf0c42 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:53.813235 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520142fb-aa2a-425e-a36a-aa253bbf0c42 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:53.813511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520142fb-aa2a-425e-a36a-aa253bbf0c42 None admin] PATH_INFO: `/v3/users/8fa05c031d634a01b078975445b0a7e1` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:53.814622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520142fb-aa2a-425e-a36a-aa253bbf0c42 None admin] RBAC: Authorizing `identity:get_user(user_id=8fa05c031d634a01b078975445b0a7e1)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:53.816047 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520142fb-aa2a-425e-a36a-aa253bbf0c42 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:53.817614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 569/1158] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:40:53 2022] GET /identity/v3/users/8fa05c031d634a01b078975445b0a7e1 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:53.823909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38de63-67b0-42cb-aa57-c05c550da150 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:53.918467 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38de63-67b0-42cb-aa57-c05c550da150 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:53.942567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:53.950822 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a4a2a-954e-4482-bd92-cb01169f1bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:53.951407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a4a2a-954e-4482-bd92-cb01169f1bd3 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:53.951686 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a4a2a-954e-4482-bd92-cb01169f1bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:53.951960 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a4a2a-954e-4482-bd92-cb01169f1bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:54.016364 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a4a2a-954e-4482-bd92-cb01169f1bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:54.017815 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a4a2a-954e-4482-bd92-cb01169f1bd3 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:54.114218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 590/1159] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:40:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:40:54.120051 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520142fb-aa2a-425e-a36a-aa253bbf0c42 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:54.146808 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:54.217262 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520142fb-aa2a-425e-a36a-aa253bbf0c42 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:54.249827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a26aeb-a78a-4263-88a8-de926812522d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:54.250429 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a26aeb-a78a-4263-88a8-de926812522d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:54.250708 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a26aeb-a78a-4263-88a8-de926812522d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:54.250979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a26aeb-a78a-4263-88a8-de926812522d None admin] PATH_INFO: `/v3/projects/6acd762a29794ccdb7dc7f750c9f3ab5` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:54.252060 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a26aeb-a78a-4263-88a8-de926812522d None admin] RBAC: Authorizing `identity:get_project(project_id=6acd762a29794ccdb7dc7f750c9f3ab5)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:54.253499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a26aeb-a78a-4263-88a8-de926812522d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:54.255064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 570/1160] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:40:54 2022] GET /identity/v3/projects/6acd762a29794ccdb7dc7f750c9f3ab5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:54.261890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a4a2a-954e-4482-bd92-cb01169f1bd3 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:54.287889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:54.357023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a4a2a-954e-4482-bd92-cb01169f1bd3 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:54.390277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962963c6-9533-46c4-9010-6f722ced8ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:54.390857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962963c6-9533-46c4-9010-6f722ced8ae9 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:54.391137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962963c6-9533-46c4-9010-6f722ced8ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:54.391410 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962963c6-9533-46c4-9010-6f722ced8ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:54.392117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962963c6-9533-46c4-9010-6f722ced8ae9 None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=6acd762a29794ccdb7dc7f750c9f3ab5, user.id=8fa05c031d634a01b078975445b0a7e1) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:54.392420 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962963c6-9533-46c4-9010-6f722ced8ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:54.393850 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962963c6-9533-46c4-9010-6f722ced8ae9 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:54.399334 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 591/1161] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:40:54 2022] GET /identity/v3/role_assignments?user.id=8fa05c031d634a01b078975445b0a7e1&scope.project.id=6acd762a29794ccdb7dc7f750c9f3ab5&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:56.289548 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29955e0-4e3c-4e4d-a673-491100700605 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:56.290157 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29955e0-4e3c-4e4d-a673-491100700605 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:56.290157 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29955e0-4e3c-4e4d-a673-491100700605 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:56.291412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 571/1162] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:56.296486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d26ca-3685-4782-9e35-55f10a711b2b None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:56.296913 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d26ca-3685-4782-9e35-55f10a711b2b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:56.297056 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d26ca-3685-4782-9e35-55f10a711b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:56.314497 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-2f5d26ca-3685-4782-9e35-55f10a711b2b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:56.315666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-2f5d26ca-3685-4782-9e35-55f10a711b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:56.381751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 592/1163] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:56.653257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29955e0-4e3c-4e4d-a673-491100700605 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:56.744151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:56.751961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29955e0-4e3c-4e4d-a673-491100700605 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:56.786412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c05b8c-eea5-41d5-a2d6-1f83df745403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:56.787016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c05b8c-eea5-41d5-a2d6-1f83df745403 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:56.787300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c05b8c-eea5-41d5-a2d6-1f83df745403 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:56.787576 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c05b8c-eea5-41d5-a2d6-1f83df745403 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:56.852301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c05b8c-eea5-41d5-a2d6-1f83df745403 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:56.854280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c05b8c-eea5-41d5-a2d6-1f83df745403 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:56.942068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:56.949594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 572/1164] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:40:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:40:56.955402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d26ca-3685-4782-9e35-55f10a711b2b None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:56.979021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:57.050733 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d26ca-3685-4782-9e35-55f10a711b2b None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:57.083292 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12852b4d-6177-4fe5-b24e-cc5d63dd3512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:57.083926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12852b4d-6177-4fe5-b24e-cc5d63dd3512 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:57.084206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12852b4d-6177-4fe5-b24e-cc5d63dd3512 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:57.084475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12852b4d-6177-4fe5-b24e-cc5d63dd3512 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:57.091179 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12852b4d-6177-4fe5-b24e-cc5d63dd3512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:57.092600 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12852b4d-6177-4fe5-b24e-cc5d63dd3512 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-12852b4d-6177-4fe5-b24e-cc5d63dd3512 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:40:57.104065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:40:57.105352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:40:57.106504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:40:57.106504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:40:57.106504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:40:57.106504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:40:57.106504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:40:57.106504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:40:57.106504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:40:57.106504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:40:57.106504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:40:57.106504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:40:57.106504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 26 08:40:57.106504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:40:57.106504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 26 08:40:57.106504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:40:57.106504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 593/1165] 10.222.0.76 () {56 vars in 1117 bytes} [Fri Aug 26 08:40:56 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:40:57.110804 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c05b8c-eea5-41d5-a2d6-1f83df745403 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:57.206020 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c05b8c-eea5-41d5-a2d6-1f83df745403 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:57.239513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f9aea-763f-4cfb-a13c-6cdee2ca9b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:57.240107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f9aea-763f-4cfb-a13c-6cdee2ca9b2e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:57.240390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f9aea-763f-4cfb-a13c-6cdee2ca9b2e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:57.240668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f9aea-763f-4cfb-a13c-6cdee2ca9b2e None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:57.241336 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f9aea-763f-4cfb-a13c-6cdee2ca9b2e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:40:57.241644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f9aea-763f-4cfb-a13c-6cdee2ca9b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:57.242989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f9aea-763f-4cfb-a13c-6cdee2ca9b2e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:57.249833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 573/1166] 10.222.0.76 () {56 vars in 1115 bytes} [Fri Aug 26 08:40:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:40:59.109124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8953-e1bc-4288-9c0f-7a23c574cb49 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:59.109665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8953-e1bc-4288-9c0f-7a23c574cb49 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:59.109665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8953-e1bc-4288-9c0f-7a23c574cb49 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:59.111011 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 594/1167] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:40:59.116232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42a09e-6872-4304-b9e7-2278be5ccca0 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:59.116667 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42a09e-6872-4304-b9e7-2278be5ccca0 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:59.116762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42a09e-6872-4304-b9e7-2278be5ccca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:59.134832 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-2d42a09e-6872-4304-b9e7-2278be5ccca0 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:40:59.135994 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-2d42a09e-6872-4304-b9e7-2278be5ccca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:40:59.186799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:59.200349 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 574/1168] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:40:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:40:59.463937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a8953-e1bc-4288-9c0f-7a23c574cb49 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:40:59.544544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:40:59.564067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a8953-e1bc-4288-9c0f-7a23c574cb49 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:40:59.598104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507cae9-4f37-4ee9-8cb9-361a62f069b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:40:59.598719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507cae9-4f37-4ee9-8cb9-361a62f069b4 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:40:59.599002 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507cae9-4f37-4ee9-8cb9-361a62f069b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:40:59.599276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507cae9-4f37-4ee9-8cb9-361a62f069b4 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:40:59.599944 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507cae9-4f37-4ee9-8cb9-361a62f069b4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:40:59.601335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507cae9-4f37-4ee9-8cb9-361a62f069b4 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:40:59.617145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 595/1169] 10.222.0.76 () {60 vars in 1138 bytes} [Fri Aug 26 08:40:59 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:41:01.509106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdcef7-d27f-48d3-8c01-5ad97fd18ec1 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:01.509666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdcef7-d27f-48d3-8c01-5ad97fd18ec1 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:01.509666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdcef7-d27f-48d3-8c01-5ad97fd18ec1 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:01.510973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 575/1170] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:41:01.516263 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f7bb1-6263-4ec8-a1eb-292686d8d1ef None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:01.516668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f7bb1-6263-4ec8-a1eb-292686d8d1ef None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:01.516830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f7bb1-6263-4ec8-a1eb-292686d8d1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:01.535502 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-8b7f7bb1-6263-4ec8-a1eb-292686d8d1ef None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:41:01.536701 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-8b7f7bb1-6263-4ec8-a1eb-292686d8d1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:41:01.602050 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 596/1171] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:41:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:41:01.869059 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdcef7-d27f-48d3-8c01-5ad97fd18ec1 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:01.965449 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdcef7-d27f-48d3-8c01-5ad97fd18ec1 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:01.997860 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b67e5-970a-4b6f-8951-e880fc874f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:01.998468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b67e5-970a-4b6f-8951-e880fc874f23 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:01.998745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b67e5-970a-4b6f-8951-e880fc874f23 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:01.999017 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b67e5-970a-4b6f-8951-e880fc874f23 None admin] PATH_INFO: `/v3/domains/eac8f5c9ca444315b6674b1627abdd1b` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:02.009926 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b67e5-970a-4b6f-8951-e880fc874f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=eac8f5c9ca444315b6674b1627abdd1b)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:02.011358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b67e5-970a-4b6f-8951-e880fc874f23 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:02.012942 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 576/1172] 10.222.0.76 () {56 vars in 1183 bytes} [Fri Aug 26 08:41:01 2022] GET /identity/v3/domains/eac8f5c9ca444315b6674b1627abdd1b => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:41:02.018699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f7bb1-6263-4ec8-a1eb-292686d8d1ef None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:02.085803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:02.115357 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f7bb1-6263-4ec8-a1eb-292686d8d1ef None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:02.148012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f11e87-312c-4897-b4e6-7dce3884b6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:02.148538 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f11e87-312c-4897-b4e6-7dce3884b6de None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:02.148820 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f11e87-312c-4897-b4e6-7dce3884b6de None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:02.149120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f11e87-312c-4897-b4e6-7dce3884b6de None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:02.150316 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f11e87-312c-4897-b4e6-7dce3884b6de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:02.151731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f11e87-312c-4897-b4e6-7dce3884b6de None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:02.176506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 597/1173] 10.222.0.76 () {60 vars in 1141 bytes} [Fri Aug 26 08:41:02 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:41:04.144939 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a23cc0-2daa-4aab-8d35-ed38d4a1c642 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:04.146833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a23cc0-2daa-4aab-8d35-ed38d4a1c642 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:04.146833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a23cc0-2daa-4aab-8d35-ed38d4a1c642 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:04.147034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 577/1174] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:41:04.152761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2b12-029c-4fd5-9303-fdcede3c7497 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:04.153245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2b12-029c-4fd5-9303-fdcede3c7497 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:04.153347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2b12-029c-4fd5-9303-fdcede3c7497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:04.171460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-b62a2b12-029c-4fd5-9303-fdcede3c7497 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:41:04.172634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b62a2b12-029c-4fd5-9303-fdcede3c7497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:41:04.236832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 598/1175] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:41:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:41:04.510564 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a23cc0-2daa-4aab-8d35-ed38d4a1c642 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:04.559655 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:04.628549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a23cc0-2daa-4aab-8d35-ed38d4a1c642 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:04.662487 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9bd89-fd75-4763-8f1d-1163a410830e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:04.663114 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9bd89-fd75-4763-8f1d-1163a410830e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:04.663399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9bd89-fd75-4763-8f1d-1163a410830e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:04.663677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9bd89-fd75-4763-8f1d-1163a410830e None admin] PATH_INFO: `/v3/domains/eac8f5c9ca444315b6674b1627abdd1b` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:04.664788 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9bd89-fd75-4763-8f1d-1163a410830e None admin] RBAC: Authorizing `identity:get_domain(domain_id=eac8f5c9ca444315b6674b1627abdd1b)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:04.666243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9bd89-fd75-4763-8f1d-1163a410830e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:04.667798 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 578/1176] 10.222.0.76 () {56 vars in 1183 bytes} [Fri Aug 26 08:41:04 2022] GET /identity/v3/domains/eac8f5c9ca444315b6674b1627abdd1b => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:41:04.673615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2b12-029c-4fd5-9303-fdcede3c7497 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:04.726508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:04.770199 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2b12-029c-4fd5-9303-fdcede3c7497 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:04.801857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba96058-3909-4470-8d80-cde57cdc37e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:04.802450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba96058-3909-4470-8d80-cde57cdc37e4 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:04.802731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba96058-3909-4470-8d80-cde57cdc37e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:04.803004 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba96058-3909-4470-8d80-cde57cdc37e4 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:04.803644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba96058-3909-4470-8d80-cde57cdc37e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:04.805086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba96058-3909-4470-8d80-cde57cdc37e4 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:04.826005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 599/1177] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:41:04 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:41:06.754771 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e5f1b-368c-41c6-a4ca-f558656fc801 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:06.755317 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e5f1b-368c-41c6-a4ca-f558656fc801 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:06.755317 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e5f1b-368c-41c6-a4ca-f558656fc801 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:06.756652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 579/1178] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:41:06.761877 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f03a92-744a-4fdb-a94e-11fa36f30da8 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:06.762268 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f03a92-744a-4fdb-a94e-11fa36f30da8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:06.762435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f03a92-744a-4fdb-a94e-11fa36f30da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:06.779872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-c4f03a92-744a-4fdb-a94e-11fa36f30da8 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:41:06.781091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c4f03a92-744a-4fdb-a94e-11fa36f30da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:41:06.845407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 600/1179] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:41:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:41:07.113181 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e5f1b-368c-41c6-a4ca-f558656fc801 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:07.209121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e5f1b-368c-41c6-a4ca-f558656fc801 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:07.226064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:07.243504 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d8925-42da-41b7-9025-8a955d9872a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:07.244139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d8925-42da-41b7-9025-8a955d9872a8 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:07.244415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d8925-42da-41b7-9025-8a955d9872a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:07.244684 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d8925-42da-41b7-9025-8a955d9872a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:07.254274 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d8925-42da-41b7-9025-8a955d9872a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-281d8925-42da-41b7-9025-8a955d9872a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:41:07.258805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:41:07.259981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:41:07.261148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:41:07.261148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:41:07.261148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:41:07.261148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:41:07.261148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:41:07.261148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:41:07.261148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:41:07.261148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:41:07.261148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:41:07.261148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:41:07.261148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:41:07.261148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:41:07.261148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 580/1180] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:41:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:41:07.265803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f03a92-744a-4fdb-a94e-11fa36f30da8 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:07.306215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:07.363679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f03a92-744a-4fdb-a94e-11fa36f30da8 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:07.395731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19498222-d79c-4062-96fa-25849f09ef57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:07.396325 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19498222-d79c-4062-96fa-25849f09ef57 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:07.396601 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19498222-d79c-4062-96fa-25849f09ef57 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:07.396869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19498222-d79c-4062-96fa-25849f09ef57 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:07.397550 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19498222-d79c-4062-96fa-25849f09ef57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:41:07.397851 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19498222-d79c-4062-96fa-25849f09ef57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:07.399195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19498222-d79c-4062-96fa-25849f09ef57 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:07.407514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 601/1181] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:41:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:41:07.413194 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d8925-42da-41b7-9025-8a955d9872a8 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:07.508294 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d8925-42da-41b7-9025-8a955d9872a8 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:07.541019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b7b43-494a-4a05-aa3d-89c02945ad56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:07.541624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b7b43-494a-4a05-aa3d-89c02945ad56 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:07.541902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b7b43-494a-4a05-aa3d-89c02945ad56 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:07.542171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b7b43-494a-4a05-aa3d-89c02945ad56 None admin] PATH_INFO: `/v3/users/4679e126234b469a9448b3b9915f83be` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:07.554458 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b7b43-494a-4a05-aa3d-89c02945ad56 None admin] RBAC: Authorizing `identity:get_user(user_id=4679e126234b469a9448b3b9915f83be)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:07.555900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b7b43-494a-4a05-aa3d-89c02945ad56 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:07.557502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 581/1182] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:41:07 2022] GET /identity/v3/users/4679e126234b469a9448b3b9915f83be => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:41:07.563187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19498222-d79c-4062-96fa-25849f09ef57 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:07.661173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19498222-d79c-4062-96fa-25849f09ef57 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:07.662599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:07.702446 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f0b52-ac05-4b3d-83ca-80411527b190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:07.703048 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f0b52-ac05-4b3d-83ca-80411527b190 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:07.703333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f0b52-ac05-4b3d-83ca-80411527b190 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:07.703609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f0b52-ac05-4b3d-83ca-80411527b190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:07.769257 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f0b52-ac05-4b3d-83ca-80411527b190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:07.770690 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f0b52-ac05-4b3d-83ca-80411527b190 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:07.864529 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 602/1183] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:41:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:41:07.871084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b7b43-494a-4a05-aa3d-89c02945ad56 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:07.904562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:07.969061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b7b43-494a-4a05-aa3d-89c02945ad56 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:08.001914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b4727-f5f8-4565-a0d1-84a7d2460440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:08.002536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b4727-f5f8-4565-a0d1-84a7d2460440 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:08.002818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b4727-f5f8-4565-a0d1-84a7d2460440 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:08.003091 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b4727-f5f8-4565-a0d1-84a7d2460440 None admin] PATH_INFO: `/v3/projects/5f78845eb7ec47dea3cb13f8f232dd8b` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:08.004191 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b4727-f5f8-4565-a0d1-84a7d2460440 None admin] RBAC: Authorizing `identity:get_project(project_id=5f78845eb7ec47dea3cb13f8f232dd8b)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:08.005784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b4727-f5f8-4565-a0d1-84a7d2460440 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:08.007479 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 582/1184] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:41:07 2022] GET /identity/v3/projects/5f78845eb7ec47dea3cb13f8f232dd8b => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:41:08.014161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f0b52-ac05-4b3d-83ca-80411527b190 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:08.016339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:08.110524 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f0b52-ac05-4b3d-83ca-80411527b190 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:08.143305 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c199c6-9526-4676-a484-e5ed4831e398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:08.143894 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c199c6-9526-4676-a484-e5ed4831e398 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:08.144179 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c199c6-9526-4676-a484-e5ed4831e398 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:08.144457 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c199c6-9526-4676-a484-e5ed4831e398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:08.145209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c199c6-9526-4676-a484-e5ed4831e398 None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=5f78845eb7ec47dea3cb13f8f232dd8b, user.id=4679e126234b469a9448b3b9915f83be) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:41:08.145523 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c199c6-9526-4676-a484-e5ed4831e398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:08.146950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c199c6-9526-4676-a484-e5ed4831e398 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:08.154408 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 603/1185] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:41:08 2022] GET /identity/v3/role_assignments?user.id=4679e126234b469a9448b3b9915f83be&scope.project.id=5f78845eb7ec47dea3cb13f8f232dd8b&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:41:09.988092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db53239-a0e6-4fd0-936c-cb2cb2d11afc None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:09.988656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db53239-a0e6-4fd0-936c-cb2cb2d11afc None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:09.988656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db53239-a0e6-4fd0-936c-cb2cb2d11afc None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:09.990004 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 583/1186] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:41:09.995504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c98e9-0e75-4b25-8f2a-2e35ef30d36f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:09.995922 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c98e9-0e75-4b25-8f2a-2e35ef30d36f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:09.996045 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c98e9-0e75-4b25-8f2a-2e35ef30d36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:10.014072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0c7c98e9-0e75-4b25-8f2a-2e35ef30d36f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:41:10.015236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0c7c98e9-0e75-4b25-8f2a-2e35ef30d36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:41:10.072057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:10.079641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 604/1187] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:41:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:41:10.346113 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db53239-a0e6-4fd0-936c-cb2cb2d11afc None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:10.445850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db53239-a0e6-4fd0-936c-cb2cb2d11afc None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:10.447323 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:10.479855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98743f8-95eb-4bc3-9c1f-58b64f25bfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:10.480458 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98743f8-95eb-4bc3-9c1f-58b64f25bfe2 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:10.480736 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98743f8-95eb-4bc3-9c1f-58b64f25bfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:10.481023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98743f8-95eb-4bc3-9c1f-58b64f25bfe2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:10.490801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98743f8-95eb-4bc3-9c1f-58b64f25bfe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-f98743f8-95eb-4bc3-9c1f-58b64f25bfe2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:41:10.496009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:41:10.497158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:41:10.498207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:41:10.498207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:41:10.498207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:41:10.498207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:41:10.498207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:41:10.498207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:41:10.498207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:41:10.498207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:41:10.498207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:41:10.498207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:41:10.498207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:41:10.498207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:41:10.498207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 584/1188] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:41:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:41:10.502949 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c98e9-0e75-4b25-8f2a-2e35ef30d36f None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:10.597634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c98e9-0e75-4b25-8f2a-2e35ef30d36f None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:10.631004 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0dc7e-54bd-4954-aad4-54a155504722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:10.631602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0dc7e-54bd-4954-aad4-54a155504722 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:10.631884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0dc7e-54bd-4954-aad4-54a155504722 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:10.632158 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0dc7e-54bd-4954-aad4-54a155504722 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:10.632816 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0dc7e-54bd-4954-aad4-54a155504722 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:41:10.633173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0dc7e-54bd-4954-aad4-54a155504722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:10.634554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0dc7e-54bd-4954-aad4-54a155504722 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:10.642356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 605/1189] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:41:10.648043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98743f8-95eb-4bc3-9c1f-58b64f25bfe2 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:10.744915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98743f8-95eb-4bc3-9c1f-58b64f25bfe2 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:10.777077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93538aed-93fb-4df3-b826-80d8fcd17e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:10.777681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93538aed-93fb-4df3-b826-80d8fcd17e55 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:10.777959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93538aed-93fb-4df3-b826-80d8fcd17e55 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:10.778228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93538aed-93fb-4df3-b826-80d8fcd17e55 None admin] PATH_INFO: `/v3/users/4679e126234b469a9448b3b9915f83be` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:10.779313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93538aed-93fb-4df3-b826-80d8fcd17e55 None admin] RBAC: Authorizing `identity:get_user(user_id=4679e126234b469a9448b3b9915f83be)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:10.780722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93538aed-93fb-4df3-b826-80d8fcd17e55 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:10.782254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 585/1190] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:41:10 2022] GET /identity/v3/users/4679e126234b469a9448b3b9915f83be => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:41:10.787837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0dc7e-54bd-4954-aad4-54a155504722 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:10.845213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:10.886527 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0dc7e-54bd-4954-aad4-54a155504722 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:10.919210 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9f3bc-fc95-4c07-9c74-ef89cdd474e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:10.919816 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9f3bc-fc95-4c07-9c74-ef89cdd474e2 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:10.920103 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9f3bc-fc95-4c07-9c74-ef89cdd474e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:10.920383 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9f3bc-fc95-4c07-9c74-ef89cdd474e2 None admin] PATH_INFO: `/v3/projects/5f78845eb7ec47dea3cb13f8f232dd8b` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:10.921504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9f3bc-fc95-4c07-9c74-ef89cdd474e2 None admin] RBAC: Authorizing `identity:get_project(project_id=5f78845eb7ec47dea3cb13f8f232dd8b)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:10.922921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9f3bc-fc95-4c07-9c74-ef89cdd474e2 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:10.924519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 606/1191] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:41:10 2022] GET /identity/v3/projects/5f78845eb7ec47dea3cb13f8f232dd8b => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:41:10.930281 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93538aed-93fb-4df3-b826-80d8fcd17e55 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:10.959179 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:11.026264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93538aed-93fb-4df3-b826-80d8fcd17e55 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:11.058515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f996c-6d8b-42ef-b949-e0043784ee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:11.059144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f996c-6d8b-42ef-b949-e0043784ee18 None admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:11.059421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f996c-6d8b-42ef-b949-e0043784ee18 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:11.059688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f996c-6d8b-42ef-b949-e0043784ee18 None admin] PATH_INFO: `/v3/projects/5f78845eb7ec47dea3cb13f8f232dd8b/users/4679e126234b469a9448b3b9915f83be/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:11.061558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f996c-6d8b-42ef-b949-e0043784ee18 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f78845eb7ec47dea3cb13f8f232dd8b, user_id=4679e126234b469a9448b3b9915f83be, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:11.062953 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f996c-6d8b-42ef-b949-e0043784ee18 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:11.075185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 586/1192] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:41:10 2022] PUT /identity/v3/projects/5f78845eb7ec47dea3cb13f8f232dd8b/users/4679e126234b469a9448b3b9915f83be/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:41:12.923539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5e17d-e7db-4473-83e1-dfe4f43b1d27 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:12.924063 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5e17d-e7db-4473-83e1-dfe4f43b1d27 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:12.924176 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5e17d-e7db-4473-83e1-dfe4f43b1d27 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:12.925458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 607/1193] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:41:12.930602 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15a29f-365a-4816-9aa9-b2660bec0842 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:12.930993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15a29f-365a-4816-9aa9-b2660bec0842 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:12.931145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15a29f-365a-4816-9aa9-b2660bec0842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:12.949031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ea15a29f-365a-4816-9aa9-b2660bec0842 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:41:12.950193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ea15a29f-365a-4816-9aa9-b2660bec0842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:41:13.014028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 587/1194] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:41:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:41:13.276934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5e17d-e7db-4473-83e1-dfe4f43b1d27 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:13.375195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5e17d-e7db-4473-83e1-dfe4f43b1d27 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:13.400249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:13.408969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baacae-c26e-405f-88cc-a3b971647e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:13.409605 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baacae-c26e-405f-88cc-a3b971647e6f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:13.409885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baacae-c26e-405f-88cc-a3b971647e6f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:13.410157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baacae-c26e-405f-88cc-a3b971647e6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:13.419877 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76baacae-c26e-405f-88cc-a3b971647e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-76baacae-c26e-405f-88cc-a3b971647e6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:41:13.424484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:41:13.425606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:41:13.426612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:41:13.426612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:41:13.426612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:41:13.426612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:41:13.426612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:41:13.426612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:41:13.426612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:41:13.426612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:41:13.426612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:41:13.426612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:41:13.426612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:41:13.426612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:41:13.426612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 608/1195] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:41:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:41:13.431456 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15a29f-365a-4816-9aa9-b2660bec0842 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:13.452286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:13.529229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15a29f-365a-4816-9aa9-b2660bec0842 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:13.561648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3c1f6-ab20-4f34-8f77-ebce2654214b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:13.562245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3c1f6-ab20-4f34-8f77-ebce2654214b None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:13.562531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3c1f6-ab20-4f34-8f77-ebce2654214b None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:13.562801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3c1f6-ab20-4f34-8f77-ebce2654214b None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:13.563456 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3c1f6-ab20-4f34-8f77-ebce2654214b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:41:13.563757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3c1f6-ab20-4f34-8f77-ebce2654214b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:13.565125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3c1f6-ab20-4f34-8f77-ebce2654214b None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:13.573437 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 588/1196] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:41:13.579138 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baacae-c26e-405f-88cc-a3b971647e6f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:13.675591 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baacae-c26e-405f-88cc-a3b971647e6f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:13.709674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4e2df-6349-4e46-a3f6-6123f723a2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:13.710286 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4e2df-6349-4e46-a3f6-6123f723a2eb None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:13.710565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4e2df-6349-4e46-a3f6-6123f723a2eb None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:13.710835 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4e2df-6349-4e46-a3f6-6123f723a2eb None admin] PATH_INFO: `/v3/users/4679e126234b469a9448b3b9915f83be` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:13.712567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4e2df-6349-4e46-a3f6-6123f723a2eb None admin] RBAC: Authorizing `identity:get_user(user_id=4679e126234b469a9448b3b9915f83be)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:13.714831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4e2df-6349-4e46-a3f6-6123f723a2eb None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:13.716393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 609/1197] 10.222.0.76 () {56 vars in 1177 bytes} [Fri Aug 26 08:41:13 2022] GET /identity/v3/users/4679e126234b469a9448b3b9915f83be => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:41:13.722326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3c1f6-ab20-4f34-8f77-ebce2654214b None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:13.800874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:13.818730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3c1f6-ab20-4f34-8f77-ebce2654214b None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:13.851131 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8ba6f-cd58-4307-ae2c-196ed3805483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:13.851718 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8ba6f-cd58-4307-ae2c-196ed3805483 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:13.851998 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8ba6f-cd58-4307-ae2c-196ed3805483 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:13.852270 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8ba6f-cd58-4307-ae2c-196ed3805483 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:13.916423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8ba6f-cd58-4307-ae2c-196ed3805483 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:13.917871 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8ba6f-cd58-4307-ae2c-196ed3805483 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:13.994440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:14.013224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 589/1198] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:41:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:41:14.019024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4e2df-6349-4e46-a3f6-6123f723a2eb None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:14.072943 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:14.116136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4e2df-6349-4e46-a3f6-6123f723a2eb None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:14.148969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b43944-41a9-49bf-be39-e89795b9edbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:14.149638 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b43944-41a9-49bf-be39-e89795b9edbe None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:14.149919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b43944-41a9-49bf-be39-e89795b9edbe None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:14.150194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b43944-41a9-49bf-be39-e89795b9edbe None admin] PATH_INFO: `/v3/projects/5f78845eb7ec47dea3cb13f8f232dd8b` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:14.151294 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b43944-41a9-49bf-be39-e89795b9edbe None admin] RBAC: Authorizing `identity:get_project(project_id=5f78845eb7ec47dea3cb13f8f232dd8b)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:14.152711 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b43944-41a9-49bf-be39-e89795b9edbe None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:14.154330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 610/1199] 10.222.0.76 () {56 vars in 1186 bytes} [Fri Aug 26 08:41:14 2022] GET /identity/v3/projects/5f78845eb7ec47dea3cb13f8f232dd8b => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:41:14.160263 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8ba6f-cd58-4307-ae2c-196ed3805483 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:41:14.256687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8ba6f-cd58-4307-ae2c-196ed3805483 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:41:14.289674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5c8a8-e099-45f4-b409-145a8ead40a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:41:14.290797 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5c8a8-e099-45f4-b409-145a8ead40a2 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:41:14.291078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5c8a8-e099-45f4-b409-145a8ead40a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:41:14.291350 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5c8a8-e099-45f4-b409-145a8ead40a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:41:14.292067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5c8a8-e099-45f4-b409-145a8ead40a2 None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=5f78845eb7ec47dea3cb13f8f232dd8b, user.id=4679e126234b469a9448b3b9915f83be) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:41:14.292376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5c8a8-e099-45f4-b409-145a8ead40a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:41:14.293812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5c8a8-e099-45f4-b409-145a8ead40a2 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:41:14.299303 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 590/1200] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:41:14 2022] GET /identity/v3/role_assignments?user.id=4679e126234b469a9448b3b9915f83be&scope.project.id=5f78845eb7ec47dea3cb13f8f232dd8b&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:41:24.144937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=39 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:41:24.296793 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=77 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:08.986874 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba06407-8abf-4259-9a63-710c5d291ad5 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:08.987466 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba06407-8abf-4259-9a63-710c5d291ad5 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:08.987466 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba06407-8abf-4259-9a63-710c5d291ad5 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:08.988941 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 611/1201] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:42:08.999066 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bd05a-0af6-41bc-a42c-256243a15c48 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:08.999620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bd05a-0af6-41bc-a42c-256243a15c48 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:08.999620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bd05a-0af6-41bc-a42c-256243a15c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:09.018200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-e11bd05a-0af6-41bc-a42c-256243a15c48 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:42:09.019414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-e11bd05a-0af6-41bc-a42c-256243a15c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:42:09.098258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 591/1202] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:42:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:42:09.376135 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba06407-8abf-4259-9a63-710c5d291ad5 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:09.489763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba06407-8abf-4259-9a63-710c5d291ad5 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:09.527175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f6790-ba17-424b-b1a4-3b2720d9f1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:09.527984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f6790-ba17-424b-b1a4-3b2720d9f1cd None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:09.528265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f6790-ba17-424b-b1a4-3b2720d9f1cd None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:09.528584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f6790-ba17-424b-b1a4-3b2720d9f1cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:09.540839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f6790-ba17-424b-b1a4-3b2720d9f1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:09.542404 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f6790-ba17-424b-b1a4-3b2720d9f1cd None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-001f6790-ba17-424b-b1a4-3b2720d9f1cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:42:09.558963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:09.560109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:42:09.561138 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:42:09.561138 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:09.561138 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:09.561138 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 612/1203] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:42:09.567976 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bd05a-0af6-41bc-a42c-256243a15c48 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:09.706962 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bd05a-0af6-41bc-a42c-256243a15c48 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:09.753411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:09.762481 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960e2a8-eb3a-407a-8a05-720a5fa7fd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:09.763149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960e2a8-eb3a-407a-8a05-720a5fa7fd43 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:09.763541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960e2a8-eb3a-407a-8a05-720a5fa7fd43 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:09.763838 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960e2a8-eb3a-407a-8a05-720a5fa7fd43 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:09.764709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960e2a8-eb3a-407a-8a05-720a5fa7fd43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:09.764920 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960e2a8-eb3a-407a-8a05-720a5fa7fd43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:09.767022 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960e2a8-eb3a-407a-8a05-720a5fa7fd43 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:09.791487 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 592/1204] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:09.797315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f6790-ba17-424b-b1a4-3b2720d9f1cd None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:09.872144 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:09.939676 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f6790-ba17-424b-b1a4-3b2720d9f1cd None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:09.985569 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14279181-bb76-4ba9-a760-a43ead7f9ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:09.986094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14279181-bb76-4ba9-a760-a43ead7f9ed5 None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:09.986373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14279181-bb76-4ba9-a760-a43ead7f9ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:09.986643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14279181-bb76-4ba9-a760-a43ead7f9ed5 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:09.987357 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14279181-bb76-4ba9-a760-a43ead7f9ed5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:09.988699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14279181-bb76-4ba9-a760-a43ead7f9ed5 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:10.015412 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 613/1205] 10.222.0.76 () {60 vars in 1132 bytes} [Fri Aug 26 08:42:09 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:42:12.152153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01dcfe-9095-48e2-8849-769e33c8c0e3 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:12.152732 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01dcfe-9095-48e2-8849-769e33c8c0e3 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:12.152732 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01dcfe-9095-48e2-8849-769e33c8c0e3 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:12.154047 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 593/1206] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:42:12.161171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ee0c9-5386-471d-84d3-e218656c11c0 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:12.161634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ee0c9-5386-471d-84d3-e218656c11c0 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:12.161759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ee0c9-5386-471d-84d3-e218656c11c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:12.182636 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-1d7ee0c9-5386-471d-84d3-e218656c11c0 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:42:12.183930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1d7ee0c9-5386-471d-84d3-e218656c11c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:42:12.261139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 614/1207] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:42:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:42:12.547906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01dcfe-9095-48e2-8849-769e33c8c0e3 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:12.671874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01dcfe-9095-48e2-8849-769e33c8c0e3 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:12.716057 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76db06-dd4d-45fc-9162-0c4f07009f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:12.716960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76db06-dd4d-45fc-9162-0c4f07009f08 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:12.717427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76db06-dd4d-45fc-9162-0c4f07009f08 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:12.717701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76db06-dd4d-45fc-9162-0c4f07009f08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:12.729421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76db06-dd4d-45fc-9162-0c4f07009f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-3d76db06-dd4d-45fc-9162-0c4f07009f08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:42:12.734021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:12.735127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:12.736014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:12.736014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:12.736014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:12.736014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:12.736014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:42:12.736014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:42:12.736014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:42:12.736014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:42:12.736014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:42:12.736014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:42:12.736014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:42:12.736014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:12.740106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 594/1208] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:42:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:12.741182 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ee0c9-5386-471d-84d3-e218656c11c0 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:12.783966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:12.858667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ee0c9-5386-471d-84d3-e218656c11c0 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:12.899702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c904a8d-4f0d-4d4c-8cd5-adbb0c12305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:12.900297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c904a8d-4f0d-4d4c-8cd5-adbb0c12305f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:12.900578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c904a8d-4f0d-4d4c-8cd5-adbb0c12305f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:12.900864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c904a8d-4f0d-4d4c-8cd5-adbb0c12305f None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:12.901595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c904a8d-4f0d-4d4c-8cd5-adbb0c12305f None admin] RBAC: Adding query filter params (name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:12.901862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c904a8d-4f0d-4d4c-8cd5-adbb0c12305f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:12.903229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c904a8d-4f0d-4d4c-8cd5-adbb0c12305f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:12.911931 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 615/1209] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:42:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:42:12.918128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76db06-dd4d-45fc-9162-0c4f07009f08 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:12.978150 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:13.045259 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76db06-dd4d-45fc-9162-0c4f07009f08 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:13.087154 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d9f2f-04ac-4075-a5fc-3390464128fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:13.087828 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d9f2f-04ac-4075-a5fc-3390464128fe None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:13.088183 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d9f2f-04ac-4075-a5fc-3390464128fe None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:13.088468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d9f2f-04ac-4075-a5fc-3390464128fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:13.101249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d9f2f-04ac-4075-a5fc-3390464128fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:13.102858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d9f2f-04ac-4075-a5fc-3390464128fe None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-567d9f2f-04ac-4075-a5fc-3390464128fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:42:13.125614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:13.127008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:42:13.128117 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:42:13.128117 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:13.128117 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:13.128117 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 595/1210] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:13.134379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c904a8d-4f0d-4d4c-8cd5-adbb0c12305f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:13.256135 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:13.261265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c904a8d-4f0d-4d4c-8cd5-adbb0c12305f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:13.298678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79384fce-d227-46fd-9000-eda4150173c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:13.299280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79384fce-d227-46fd-9000-eda4150173c1 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:13.299561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79384fce-d227-46fd-9000-eda4150173c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:13.299831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79384fce-d227-46fd-9000-eda4150173c1 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:13.300463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79384fce-d227-46fd-9000-eda4150173c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:13.300764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79384fce-d227-46fd-9000-eda4150173c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:13.302210 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79384fce-d227-46fd-9000-eda4150173c1 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:13.316898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 616/1211] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:13.322986 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d9f2f-04ac-4075-a5fc-3390464128fe None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:13.449089 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d9f2f-04ac-4075-a5fc-3390464128fe None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:13.451293 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:13.494226 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68bab1-ab1a-4660-8eb3-26115e8ebee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:13.494988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68bab1-ab1a-4660-8eb3-26115e8ebee0 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:13.495383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68bab1-ab1a-4660-8eb3-26115e8ebee0 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:13.495733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68bab1-ab1a-4660-8eb3-26115e8ebee0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:13.504792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68bab1-ab1a-4660-8eb3-26115e8ebee0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:13.506542 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68bab1-ab1a-4660-8eb3-26115e8ebee0 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-0a68bab1-ab1a-4660-8eb3-26115e8ebee0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:42:13.518801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:13.520063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:13.521572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:13.521572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:13.521572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:42:13.521572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:42:13.521572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:42:13.521572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:42:13.521572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:42:13.521572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:42:13.521572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 08:42:13.521572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:13.521572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 596/1212] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:13.525643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79384fce-d227-46fd-9000-eda4150173c1 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:13.658972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79384fce-d227-46fd-9000-eda4150173c1 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:13.696208 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58cdd8-5bae-4dfb-8178-c45774357327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:13.696834 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58cdd8-5bae-4dfb-8178-c45774357327 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:13.697156 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58cdd8-5bae-4dfb-8178-c45774357327 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:13.697430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58cdd8-5bae-4dfb-8178-c45774357327 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:13.698157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58cdd8-5bae-4dfb-8178-c45774357327 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:13.698447 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58cdd8-5bae-4dfb-8178-c45774357327 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:13.699929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58cdd8-5bae-4dfb-8178-c45774357327 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:13.719113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 617/1213] 10.222.0.76 () {56 vars in 1143 bytes} [Fri Aug 26 08:42:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:42:13.724729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68bab1-ab1a-4660-8eb3-26115e8ebee0 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:13.851245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68bab1-ab1a-4660-8eb3-26115e8ebee0 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:13.888194 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7daf63-c271-40df-9521-1b2b25389faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:13.890371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7daf63-c271-40df-9521-1b2b25389faa None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:13.890371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7daf63-c271-40df-9521-1b2b25389faa None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:13.890371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7daf63-c271-40df-9521-1b2b25389faa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:13.928617 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:13.976116 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7daf63-c271-40df-9521-1b2b25389faa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:13.977818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7daf63-c271-40df-9521-1b2b25389faa None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:14.108016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 597/1214] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:42:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:42:14.113863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58cdd8-5bae-4dfb-8178-c45774357327 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:14.138541 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:14.235742 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58cdd8-5bae-4dfb-8178-c45774357327 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:14.273485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a70d6-9534-4deb-ac70-d87ce15b4124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:14.274163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a70d6-9534-4deb-ac70-d87ce15b4124 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:14.274424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a70d6-9534-4deb-ac70-d87ce15b4124 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:14.274783 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a70d6-9534-4deb-ac70-d87ce15b4124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:14.286694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a70d6-9534-4deb-ac70-d87ce15b4124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:14.288877 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a70d6-9534-4deb-ac70-d87ce15b4124 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-d63a70d6-9534-4deb-ac70-d87ce15b4124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:42:14.306077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:14.307514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:42:14.308639 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:42:14.308639 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:14.308639 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:14.308639 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 618/1215] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:14.313281 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7daf63-c271-40df-9521-1b2b25389faa None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:14.382151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:14.426535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7daf63-c271-40df-9521-1b2b25389faa None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:14.467298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a08173-b453-4775-ad4c-67391b7118d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:14.468067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a08173-b453-4775-ad4c-67391b7118d6 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:14.469453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a08173-b453-4775-ad4c-67391b7118d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:14.469453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a08173-b453-4775-ad4c-67391b7118d6 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:14.469453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a08173-b453-4775-ad4c-67391b7118d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:14.469904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a08173-b453-4775-ad4c-67391b7118d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:14.471435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a08173-b453-4775-ad4c-67391b7118d6 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:14.488502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 598/1216] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:14.489677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a70d6-9534-4deb-ac70-d87ce15b4124 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:14.564656 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:14.597802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a70d6-9534-4deb-ac70-d87ce15b4124 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:14.634472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0404c-eac8-43fb-875d-251bdb24ac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:14.635319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0404c-eac8-43fb-875d-251bdb24ac2f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:14.635704 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0404c-eac8-43fb-875d-251bdb24ac2f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:14.636074 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0404c-eac8-43fb-875d-251bdb24ac2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:14.643109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0404c-eac8-43fb-875d-251bdb24ac2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:14.644545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0404c-eac8-43fb-875d-251bdb24ac2f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:14.656738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-a5d0404c-eac8-43fb-875d-251bdb24ac2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:42:14.656738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:14.656738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:14.656738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:14.656738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:14.656738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:14.656738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:14.656738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:14.656738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:14.656738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:14.656738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:14.656738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:14.656738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:42:14.656738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:42:14.656738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:14.657898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:14.659419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:42:14.659419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:42:14.659419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:42:14.659419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:42:14.659419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:42:14.659419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:42:14.659419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:42:14.659419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:14.659419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 619/1217] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:14.664283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a08173-b453-4775-ad4c-67391b7118d6 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:14.768514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a08173-b453-4775-ad4c-67391b7118d6 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:14.794164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:14.807022 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7881b4-5082-49bf-bad8-ad2f16894b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:14.807923 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7881b4-5082-49bf-bad8-ad2f16894b4b None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:14.808332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7881b4-5082-49bf-bad8-ad2f16894b4b None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:14.808684 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7881b4-5082-49bf-bad8-ad2f16894b4b None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:14.809514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7881b4-5082-49bf-bad8-ad2f16894b4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:14.809823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7881b4-5082-49bf-bad8-ad2f16894b4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:14.811275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7881b4-5082-49bf-bad8-ad2f16894b4b None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:14.826515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 599/1218] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:42:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:14.833089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0404c-eac8-43fb-875d-251bdb24ac2f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:14.950811 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0404c-eac8-43fb-875d-251bdb24ac2f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:14.983874 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:14.990836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd196295-baed-42ec-9a65-eed71e942acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:14.992084 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd196295-baed-42ec-9a65-eed71e942acd None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:14.992486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd196295-baed-42ec-9a65-eed71e942acd None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:14.992867 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd196295-baed-42ec-9a65-eed71e942acd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:14.993719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd196295-baed-42ec-9a65-eed71e942acd None admin] RBAC: Adding query filter params (role.id=7aef270090c546a0aff3f62f1fcf517a, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=95abbd88e549427abbf5699efed0451a) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:14.994153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd196295-baed-42ec-9a65-eed71e942acd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:14.995682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd196295-baed-42ec-9a65-eed71e942acd None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:15.004344 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 620/1219] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:42:14 2022] GET /identity/v3/role_assignments?user.id=95abbd88e549427abbf5699efed0451a&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=7aef270090c546a0aff3f62f1fcf517a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:16.903267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3ea70-4a76-42a5-9efd-f765aa860ffb None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:16.903841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3ea70-4a76-42a5-9efd-f765aa860ffb None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:16.903841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3ea70-4a76-42a5-9efd-f765aa860ffb None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:16.905680 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 600/1220] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:42:16.910709 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdd074-c218-422b-957c-490bb22b5070 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:16.911110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdd074-c218-422b-957c-490bb22b5070 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:16.911262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdd074-c218-422b-957c-490bb22b5070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:16.930707 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-bacdd074-c218-422b-957c-490bb22b5070 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:42:16.931892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-bacdd074-c218-422b-957c-490bb22b5070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:42:17.008299 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 621/1221] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:42:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:42:17.282779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3ea70-4a76-42a5-9efd-f765aa860ffb None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:17.392090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3ea70-4a76-42a5-9efd-f765aa860ffb None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:17.431905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c27e93-2974-4cde-a9b4-c96713da271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:17.432803 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c27e93-2974-4cde-a9b4-c96713da271e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:17.433277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c27e93-2974-4cde-a9b4-c96713da271e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:17.433697 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c27e93-2974-4cde-a9b4-c96713da271e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:17.445092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c27e93-2974-4cde-a9b4-c96713da271e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-f1c27e93-2974-4cde-a9b4-c96713da271e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:42:17.449713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:17.450819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:17.452056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:17.452056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:17.452056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:17.452056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:17.452056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:42:17.452056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:42:17.452056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:42:17.452056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:42:17.452056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:42:17.452056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:42:17.452056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:42:17.452056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:17.452056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 601/1222] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:42:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:17.456834 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdd074-c218-422b-957c-490bb22b5070 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:17.562086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdd074-c218-422b-957c-490bb22b5070 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:17.591478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:17.603547 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d4b60-c820-430b-81a3-58046ba59b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:17.604157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d4b60-c820-430b-81a3-58046ba59b97 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:17.604433 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d4b60-c820-430b-81a3-58046ba59b97 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:17.604703 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d4b60-c820-430b-81a3-58046ba59b97 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:17.605426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d4b60-c820-430b-81a3-58046ba59b97 None admin] RBAC: Adding query filter params (name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:17.605729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d4b60-c820-430b-81a3-58046ba59b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:17.607092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d4b60-c820-430b-81a3-58046ba59b97 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:17.617356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 622/1223] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:42:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:17.623131 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c27e93-2974-4cde-a9b4-c96713da271e None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:17.669714 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:17.728520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c27e93-2974-4cde-a9b4-c96713da271e None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:17.764667 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd2dbe-12a8-4b6d-85d5-8ec7cd1cf866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:17.765397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd2dbe-12a8-4b6d-85d5-8ec7cd1cf866 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:17.765723 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd2dbe-12a8-4b6d-85d5-8ec7cd1cf866 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:17.766035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd2dbe-12a8-4b6d-85d5-8ec7cd1cf866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:17.778002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd2dbe-12a8-4b6d-85d5-8ec7cd1cf866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:17.779760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd2dbe-12a8-4b6d-85d5-8ec7cd1cf866 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-71dd2dbe-12a8-4b6d-85d5-8ec7cd1cf866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:42:17.794717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:17.795875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:42:17.796827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:42:17.796827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:17.796827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:17.796827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 602/1224] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:17.801744 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d4b60-c820-430b-81a3-58046ba59b97 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:17.904071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d4b60-c820-430b-81a3-58046ba59b97 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:17.939512 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988b065-fe07-4023-b9fe-31e5e708f045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:17.940181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988b065-fe07-4023-b9fe-31e5e708f045 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:17.940384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988b065-fe07-4023-b9fe-31e5e708f045 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:17.940654 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988b065-fe07-4023-b9fe-31e5e708f045 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:17.941323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988b065-fe07-4023-b9fe-31e5e708f045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:17.941625 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988b065-fe07-4023-b9fe-31e5e708f045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:17.942975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988b065-fe07-4023-b9fe-31e5e708f045 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:17.954480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 623/1225] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:42:17.960446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd2dbe-12a8-4b6d-85d5-8ec7cd1cf866 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:18.069309 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:18.076519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd2dbe-12a8-4b6d-85d5-8ec7cd1cf866 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:18.111572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45ef43-83da-4848-840c-c76dc2f1665d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:18.112200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45ef43-83da-4848-840c-c76dc2f1665d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:18.112486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45ef43-83da-4848-840c-c76dc2f1665d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:18.112762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45ef43-83da-4848-840c-c76dc2f1665d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:18.120937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45ef43-83da-4848-840c-c76dc2f1665d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:18.122407 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45ef43-83da-4848-840c-c76dc2f1665d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-3a45ef43-83da-4848-840c-c76dc2f1665d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:42:18.133989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:18.135180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:18.136773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:18.136773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:18.136773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:42:18.136773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:42:18.136773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:42:18.136773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:42:18.136773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:42:18.136773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:42:18.136773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 08:42:18.136773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:18.136773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 603/1226] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:18.141076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988b065-fe07-4023-b9fe-31e5e708f045 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:18.190159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:18.251939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988b065-fe07-4023-b9fe-31e5e708f045 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:18.289519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df927f-fc9f-4020-baff-a34a21f5e1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:18.290132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df927f-fc9f-4020-baff-a34a21f5e1dc None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:18.290456 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df927f-fc9f-4020-baff-a34a21f5e1dc None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:18.290806 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df927f-fc9f-4020-baff-a34a21f5e1dc None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:18.291532 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df927f-fc9f-4020-baff-a34a21f5e1dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:18.291842 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df927f-fc9f-4020-baff-a34a21f5e1dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:18.293370 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df927f-fc9f-4020-baff-a34a21f5e1dc None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:18.314656 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 624/1227] 10.222.0.76 () {56 vars in 1143 bytes} [Fri Aug 26 08:42:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:18.320926 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45ef43-83da-4848-840c-c76dc2f1665d None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:18.438936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45ef43-83da-4848-840c-c76dc2f1665d None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:18.475723 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ec330-2d8d-4aa2-8a55-c5574ae57fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:18.476276 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ec330-2d8d-4aa2-8a55-c5574ae57fe0 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:18.476560 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ec330-2d8d-4aa2-8a55-c5574ae57fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:18.476828 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ec330-2d8d-4aa2-8a55-c5574ae57fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:18.489483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ec330-2d8d-4aa2-8a55-c5574ae57fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:18.490968 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ec330-2d8d-4aa2-8a55-c5574ae57fe0 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-600ec330-2d8d-4aa2-8a55-c5574ae57fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:42:18.504611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:18.505704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:42:18.506859 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:42:18.506859 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:18.506859 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:18.506859 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 604/1228] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:18.511617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df927f-fc9f-4020-baff-a34a21f5e1dc None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:18.633305 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df927f-fc9f-4020-baff-a34a21f5e1dc None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:18.636042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:18.673617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06115e1-7fa2-45a8-a825-ceae97423786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:18.674587 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06115e1-7fa2-45a8-a825-ceae97423786 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:18.674887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06115e1-7fa2-45a8-a825-ceae97423786 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:18.675146 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06115e1-7fa2-45a8-a825-ceae97423786 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:18.675782 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06115e1-7fa2-45a8-a825-ceae97423786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:18.676091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06115e1-7fa2-45a8-a825-ceae97423786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:18.677473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06115e1-7fa2-45a8-a825-ceae97423786 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:18.690174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 625/1229] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:42:18.696404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ec330-2d8d-4aa2-8a55-c5574ae57fe0 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:18.705927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:18.809087 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ec330-2d8d-4aa2-8a55-c5574ae57fe0 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:18.846164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d76f59-a75c-4afa-b6dd-c6def0db63be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:18.846790 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76f59-a75c-4afa-b6dd-c6def0db63be None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:18.847073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76f59-a75c-4afa-b6dd-c6def0db63be None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:18.847353 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76f59-a75c-4afa-b6dd-c6def0db63be None admin] PATH_INFO: `/v3/projects/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:18.855147 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d76f59-a75c-4afa-b6dd-c6def0db63be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:18.856777 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d76f59-a75c-4afa-b6dd-c6def0db63be None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:18.869636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-f5d76f59-a75c-4afa-b6dd-c6def0db63be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:42:18.869636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:18.869636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:18.869636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:18.869636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:18.869636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:18.869636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:18.869636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:18.869636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:18.869636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:18.869636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:18.869636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:18.869636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:42:18.869636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:42:18.869636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:18.870744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:18.871725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:42:18.871725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:42:18.871725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:42:18.871725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:42:18.871725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:42:18.871725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:42:18.871725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:42:18.871725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:18.871725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 605/1230] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:42:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:18.876926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06115e1-7fa2-45a8-a825-ceae97423786 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:18.986338 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06115e1-7fa2-45a8-a825-ceae97423786 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:19.028694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be6a13-d9ca-4f98-b47a-de092941290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:19.029453 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be6a13-d9ca-4f98-b47a-de092941290f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:19.029917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be6a13-d9ca-4f98-b47a-de092941290f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:19.030435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be6a13-d9ca-4f98-b47a-de092941290f None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:19.031403 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be6a13-d9ca-4f98-b47a-de092941290f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:19.031903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be6a13-d9ca-4f98-b47a-de092941290f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:19.033794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be6a13-d9ca-4f98-b47a-de092941290f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:19.048767 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 626/1231] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:42:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:19.055454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d76f59-a75c-4afa-b6dd-c6def0db63be None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:19.132708 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:19.174520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d76f59-a75c-4afa-b6dd-c6def0db63be None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:19.212601 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1ec12-2933-4e87-a939-a3264d8b97d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:19.214189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1ec12-2933-4e87-a939-a3264d8b97d7 None admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:19.214189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1ec12-2933-4e87-a939-a3264d8b97d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:19.214189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1ec12-2933-4e87-a939-a3264d8b97d7 None admin] PATH_INFO: `/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/95abbd88e549427abbf5699efed0451a/roles/7aef270090c546a0aff3f62f1fcf517a` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:19.232376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1ec12-2933-4e87-a939-a3264d8b97d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=35aafba89a1d47cd86cef1eb0a11e507, user_id=95abbd88e549427abbf5699efed0451a, role_id=7aef270090c546a0aff3f62f1fcf517a)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:19.233932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1ec12-2933-4e87-a939-a3264d8b97d7 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:19.247419 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 606/1232] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:42:19 2022] PUT /identity/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/95abbd88e549427abbf5699efed0451a/roles/7aef270090c546a0aff3f62f1fcf517a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:42:21.144384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d55e4-37ab-4038-afe5-fa4d75b87431 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:21.144958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d55e4-37ab-4038-afe5-fa4d75b87431 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:21.144958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d55e4-37ab-4038-afe5-fa4d75b87431 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:21.146335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 627/1233] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:42:21.152145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e8f68-a096-41b5-9a48-13a54bb5e2ac None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:21.152578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e8f68-a096-41b5-9a48-13a54bb5e2ac None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:21.152695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e8f68-a096-41b5-9a48-13a54bb5e2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:21.170770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-675e8f68-a096-41b5-9a48-13a54bb5e2ac None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:42:21.171965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-675e8f68-a096-41b5-9a48-13a54bb5e2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:42:21.241343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 607/1234] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:42:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:42:21.507644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d55e4-37ab-4038-afe5-fa4d75b87431 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:21.534284 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:21.622062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d55e4-37ab-4038-afe5-fa4d75b87431 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:21.658095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728c75e-6695-45a8-a918-7f45463e8b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:21.658743 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728c75e-6695-45a8-a918-7f45463e8b3b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:21.659031 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728c75e-6695-45a8-a918-7f45463e8b3b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:21.659307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728c75e-6695-45a8-a918-7f45463e8b3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:21.671272 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728c75e-6695-45a8-a918-7f45463e8b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-c728c75e-6695-45a8-a918-7f45463e8b3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:42:21.675992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:21.677186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:21.678799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:21.678799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:21.678799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:21.678799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:21.678799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:42:21.678799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:42:21.678799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:42:21.678799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:42:21.678799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:42:21.678799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:42:21.678799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 08:42:21.678799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:21.678799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 628/1235] 10.222.0.76 () {56 vars in 1102 bytes} [Fri Aug 26 08:42:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:21.683863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e8f68-a096-41b5-9a48-13a54bb5e2ac None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:21.741351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:21.797965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e8f68-a096-41b5-9a48-13a54bb5e2ac None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:21.832731 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28916e1a-ef6d-47d3-91a1-4a137ce77a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:21.833451 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28916e1a-ef6d-47d3-91a1-4a137ce77a9c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:21.833815 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28916e1a-ef6d-47d3-91a1-4a137ce77a9c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:21.834060 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28916e1a-ef6d-47d3-91a1-4a137ce77a9c None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:21.834967 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28916e1a-ef6d-47d3-91a1-4a137ce77a9c None admin] RBAC: Adding query filter params (name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:21.835258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28916e1a-ef6d-47d3-91a1-4a137ce77a9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:21.836801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28916e1a-ef6d-47d3-91a1-4a137ce77a9c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:21.846078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 608/1236] 10.222.0.76 () {56 vars in 1103 bytes} [Fri Aug 26 08:42:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:21.852389 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728c75e-6695-45a8-a918-7f45463e8b3b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:21.939468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:21.955600 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728c75e-6695-45a8-a918-7f45463e8b3b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:21.991657 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44088398-0ffa-4dcd-9c2b-baeba6f4b3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:21.992396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44088398-0ffa-4dcd-9c2b-baeba6f4b3c0 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:21.992722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44088398-0ffa-4dcd-9c2b-baeba6f4b3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:21.993098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44088398-0ffa-4dcd-9c2b-baeba6f4b3c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:22.003994 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44088398-0ffa-4dcd-9c2b-baeba6f4b3c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:22.005478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44088398-0ffa-4dcd-9c2b-baeba6f4b3c0 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-44088398-0ffa-4dcd-9c2b-baeba6f4b3c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:42:22.023592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:22.024805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:42:22.025836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:42:22.025836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:22.025836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:22.025836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 629/1237] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:42:22.031385 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28916e1a-ef6d-47d3-91a1-4a137ce77a9c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:22.146395 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28916e1a-ef6d-47d3-91a1-4a137ce77a9c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:22.156178 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:22.182562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe497a-c72a-4fd1-82e5-b65dd90cb3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:22.183166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe497a-c72a-4fd1-82e5-b65dd90cb3c7 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:22.183802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe497a-c72a-4fd1-82e5-b65dd90cb3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:22.184137 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe497a-c72a-4fd1-82e5-b65dd90cb3c7 None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:22.184796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe497a-c72a-4fd1-82e5-b65dd90cb3c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:22.185146 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe497a-c72a-4fd1-82e5-b65dd90cb3c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:22.186711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe497a-c72a-4fd1-82e5-b65dd90cb3c7 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:22.198919 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 609/1238] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:42:22.204512 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44088398-0ffa-4dcd-9c2b-baeba6f4b3c0 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:22.313905 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44088398-0ffa-4dcd-9c2b-baeba6f4b3c0 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:22.354350 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d0797-a83a-4bf1-be7e-d485af752c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:22.355038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d0797-a83a-4bf1-be7e-d485af752c2b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:22.355323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d0797-a83a-4bf1-be7e-d485af752c2b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:22.355643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d0797-a83a-4bf1-be7e-d485af752c2b None admin] PATH_INFO: `/v3/users/placement` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:22.358689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:22.364110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d0797-a83a-4bf1-be7e-d485af752c2b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:22.365896 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d0797-a83a-4bf1-be7e-d485af752c2b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-052d0797-a83a-4bf1-be7e-d485af752c2b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:42:22.377238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:22.378391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:22.380116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:22.380116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:22.380116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:42:22.380116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:42:22.380116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:42:22.380116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:42:22.380116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:42:22.380116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:42:22.380116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 08:42:22.380116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:22.380116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 630/1239] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:22.384873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe497a-c72a-4fd1-82e5-b65dd90cb3c7 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:22.499589 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe497a-c72a-4fd1-82e5-b65dd90cb3c7 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:22.540639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7438fa-160a-43bf-a8e5-18f7ed2415e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:22.541570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7438fa-160a-43bf-a8e5-18f7ed2415e3 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:22.541819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7438fa-160a-43bf-a8e5-18f7ed2415e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:22.542180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7438fa-160a-43bf-a8e5-18f7ed2415e3 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:22.543084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7438fa-160a-43bf-a8e5-18f7ed2415e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:22.543484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7438fa-160a-43bf-a8e5-18f7ed2415e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:22.545163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7438fa-160a-43bf-a8e5-18f7ed2415e3 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:22.566282 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 610/1240] 10.222.0.76 () {56 vars in 1143 bytes} [Fri Aug 26 08:42:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:22.574996 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d0797-a83a-4bf1-be7e-d485af752c2b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:22.694491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d0797-a83a-4bf1-be7e-d485af752c2b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:22.734807 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c39b7-6180-428a-a4cc-c7818dd425c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:22.735448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c39b7-6180-428a-a4cc-c7818dd425c4 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:22.735732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c39b7-6180-428a-a4cc-c7818dd425c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:22.736005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c39b7-6180-428a-a4cc-c7818dd425c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:22.798829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:22.807600 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c39b7-6180-428a-a4cc-c7818dd425c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:22.809163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c39b7-6180-428a-a4cc-c7818dd425c4 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:22.921714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 631/1241] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:42:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 08:42:22.927558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7438fa-160a-43bf-a8e5-18f7ed2415e3 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:22.959538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:23.046264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7438fa-160a-43bf-a8e5-18f7ed2415e3 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:23.090101 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af5541-6829-4cc0-872b-d943bd1ff254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:23.090758 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af5541-6829-4cc0-872b-d943bd1ff254 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:23.091009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af5541-6829-4cc0-872b-d943bd1ff254 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:23.091283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af5541-6829-4cc0-872b-d943bd1ff254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:23.102319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af5541-6829-4cc0-872b-d943bd1ff254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:23.103743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af5541-6829-4cc0-872b-d943bd1ff254 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-01af5541-6829-4cc0-872b-d943bd1ff254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:42:23.119694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:23.120844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:42:23.121850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:42:23.121850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:23.121850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:23.121850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 611/1242] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:23.126880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c39b7-6180-428a-a4cc-c7818dd425c4 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:23.229719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:23.236275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c39b7-6180-428a-a4cc-c7818dd425c4 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:23.273431 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035c9b7-09d5-4845-a691-32a747429316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:23.274032 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035c9b7-09d5-4845-a691-32a747429316 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:23.274313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035c9b7-09d5-4845-a691-32a747429316 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:23.274583 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035c9b7-09d5-4845-a691-32a747429316 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:23.275212 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035c9b7-09d5-4845-a691-32a747429316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:23.275513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035c9b7-09d5-4845-a691-32a747429316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:23.276863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035c9b7-09d5-4845-a691-32a747429316 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:23.289012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 632/1243] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:23.296485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af5541-6829-4cc0-872b-d943bd1ff254 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:23.391972 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:23.416060 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af5541-6829-4cc0-872b-d943bd1ff254 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:23.453435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32f534-b713-47d4-94ae-5f399c7f4534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:23.454067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32f534-b713-47d4-94ae-5f399c7f4534 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:23.454352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32f534-b713-47d4-94ae-5f399c7f4534 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:23.454630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32f534-b713-47d4-94ae-5f399c7f4534 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:23.463680 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32f534-b713-47d4-94ae-5f399c7f4534 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:23.465575 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32f534-b713-47d4-94ae-5f399c7f4534 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:23.478049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-aa32f534-b713-47d4-94ae-5f399c7f4534 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:42:23.478049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:23.478049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:23.478049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:23.478049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:23.478049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:23.478049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:23.478049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:23.478049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:23.478049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:23.478049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:23.478049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:23.478049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:42:23.478049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:42:23.478049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:23.479202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:23.480786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:42:23.480786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:42:23.480786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:42:23.480786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:42:23.480786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:42:23.480786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:42:23.480786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:42:23.480786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:23.480786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 612/1244] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:23.485806 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035c9b7-09d5-4845-a691-32a747429316 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:23.595137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035c9b7-09d5-4845-a691-32a747429316 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:23.631797 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373be8b7-8dcb-48bf-b71a-d418edafb30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:23.632407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373be8b7-8dcb-48bf-b71a-d418edafb30c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:23.632686 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373be8b7-8dcb-48bf-b71a-d418edafb30c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:23.632958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373be8b7-8dcb-48bf-b71a-d418edafb30c None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:23.633769 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373be8b7-8dcb-48bf-b71a-d418edafb30c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:23.634077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373be8b7-8dcb-48bf-b71a-d418edafb30c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:23.635512 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373be8b7-8dcb-48bf-b71a-d418edafb30c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:23.648081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 633/1245] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:42:23.654397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32f534-b713-47d4-94ae-5f399c7f4534 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:23.762965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32f534-b713-47d4-94ae-5f399c7f4534 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:23.797718 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa477c-b09d-4aed-8424-c557e2440a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:23.798363 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa477c-b09d-4aed-8424-c557e2440a76 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:23.798650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa477c-b09d-4aed-8424-c557e2440a76 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:23.798956 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa477c-b09d-4aed-8424-c557e2440a76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:23.799750 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa477c-b09d-4aed-8424-c557e2440a76 None admin] RBAC: Adding query filter params (role.id=7aef270090c546a0aff3f62f1fcf517a, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=95abbd88e549427abbf5699efed0451a) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:23.800067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa477c-b09d-4aed-8424-c557e2440a76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:23.801648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa477c-b09d-4aed-8424-c557e2440a76 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:23.807789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 613/1246] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:42:23 2022] GET /identity/v3/role_assignments?user.id=95abbd88e549427abbf5699efed0451a&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=7aef270090c546a0aff3f62f1fcf517a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:25.870576 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764682a-19c8-41fc-b216-c26c3acd4078 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:25.871207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764682a-19c8-41fc-b216-c26c3acd4078 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:25.871207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764682a-19c8-41fc-b216-c26c3acd4078 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:25.872644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 634/1247] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:42:25.878824 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab0fd6-601a-4875-81d2-c03a89233278 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:25.879317 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab0fd6-601a-4875-81d2-c03a89233278 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:25.879509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab0fd6-601a-4875-81d2-c03a89233278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:25.886863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:25.900703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-dcab0fd6-601a-4875-81d2-c03a89233278 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:42:25.902156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-dcab0fd6-601a-4875-81d2-c03a89233278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:42:25.978289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 614/1248] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:42:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:42:26.260317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764682a-19c8-41fc-b216-c26c3acd4078 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:26.281005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:26.381502 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764682a-19c8-41fc-b216-c26c3acd4078 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:26.423349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677d444-5033-4ebd-8d33-5aa3aa10284e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:26.424278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677d444-5033-4ebd-8d33-5aa3aa10284e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:26.424564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677d444-5033-4ebd-8d33-5aa3aa10284e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:26.424828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677d444-5033-4ebd-8d33-5aa3aa10284e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:26.436054 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677d444-5033-4ebd-8d33-5aa3aa10284e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-1677d444-5033-4ebd-8d33-5aa3aa10284e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:42:26.440689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:26.441997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:26.442860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:26.442860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:26.442860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:26.442860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:26.442860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:42:26.442860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:42:26.442860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:42:26.442860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:42:26.442860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:42:26.442860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:42:26.442860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:42:26.442860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:26.442860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 635/1249] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:42:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:26.447810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab0fd6-601a-4875-81d2-c03a89233278 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:26.564483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab0fd6-601a-4875-81d2-c03a89233278 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:26.607930 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:26.613520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35ed93-7102-4a74-81b2-6e8b5e36a9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:26.614117 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35ed93-7102-4a74-81b2-6e8b5e36a9e2 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:26.614393 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35ed93-7102-4a74-81b2-6e8b5e36a9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:26.614667 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35ed93-7102-4a74-81b2-6e8b5e36a9e2 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:26.615331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35ed93-7102-4a74-81b2-6e8b5e36a9e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:26.615638 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35ed93-7102-4a74-81b2-6e8b5e36a9e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:26.617029 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35ed93-7102-4a74-81b2-6e8b5e36a9e2 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:26.626515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 615/1250] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:42:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:26.632206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677d444-5033-4ebd-8d33-5aa3aa10284e None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:26.716583 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:26.744517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677d444-5033-4ebd-8d33-5aa3aa10284e None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:26.783726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958cebe-47e1-4db3-a5c7-449b3d68e42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:26.784355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958cebe-47e1-4db3-a5c7-449b3d68e42b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:26.784664 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958cebe-47e1-4db3-a5c7-449b3d68e42b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:26.784911 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958cebe-47e1-4db3-a5c7-449b3d68e42b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:26.798596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958cebe-47e1-4db3-a5c7-449b3d68e42b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:26.800464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958cebe-47e1-4db3-a5c7-449b3d68e42b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-e958cebe-47e1-4db3-a5c7-449b3d68e42b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:42:26.820036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:26.821225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:42:26.822345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:42:26.822345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:26.822345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:26.823893 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 636/1251] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:26.829817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35ed93-7102-4a74-81b2-6e8b5e36a9e2 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:26.938528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35ed93-7102-4a74-81b2-6e8b5e36a9e2 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:26.977402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78077005-0dba-4ad3-895d-c137db0d968d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:26.978037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78077005-0dba-4ad3-895d-c137db0d968d None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:26.978342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78077005-0dba-4ad3-895d-c137db0d968d None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:26.978580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78077005-0dba-4ad3-895d-c137db0d968d None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:26.979220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78077005-0dba-4ad3-895d-c137db0d968d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:26.979519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78077005-0dba-4ad3-895d-c137db0d968d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:26.980962 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78077005-0dba-4ad3-895d-c137db0d968d None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:26.993402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 616/1252] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:42:26.999286 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958cebe-47e1-4db3-a5c7-449b3d68e42b None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:27.115989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958cebe-47e1-4db3-a5c7-449b3d68e42b None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:27.143869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:27.152690 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640d760-37eb-46bd-99f8-e7e024a98dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:27.153357 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640d760-37eb-46bd-99f8-e7e024a98dd2 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:27.153641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640d760-37eb-46bd-99f8-e7e024a98dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:27.153915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640d760-37eb-46bd-99f8-e7e024a98dd2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:27.161808 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640d760-37eb-46bd-99f8-e7e024a98dd2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:27.163293 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640d760-37eb-46bd-99f8-e7e024a98dd2 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-7640d760-37eb-46bd-99f8-e7e024a98dd2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:42:27.174715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:27.176051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:27.177086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:27.177086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:27.177086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:42:27.177086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:42:27.177086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:42:27.177086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:42:27.177086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:42:27.177086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:42:27.177086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 08:42:27.177086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:27.177086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 637/1253] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:42:27.181890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78077005-0dba-4ad3-895d-c137db0d968d None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:27.245297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:27.293111 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78077005-0dba-4ad3-895d-c137db0d968d None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:27.331133 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5623d-2c3a-4ed9-bcaa-a54ade04efad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:27.331747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5623d-2c3a-4ed9-bcaa-a54ade04efad None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:27.332035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5623d-2c3a-4ed9-bcaa-a54ade04efad None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:27.332310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5623d-2c3a-4ed9-bcaa-a54ade04efad None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:27.333069 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5623d-2c3a-4ed9-bcaa-a54ade04efad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:27.333381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5623d-2c3a-4ed9-bcaa-a54ade04efad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:27.335341 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5623d-2c3a-4ed9-bcaa-a54ade04efad None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:27.356193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 617/1254] 10.222.0.76 () {56 vars in 1143 bytes} [Fri Aug 26 08:42:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:27.361934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640d760-37eb-46bd-99f8-e7e024a98dd2 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:27.471985 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640d760-37eb-46bd-99f8-e7e024a98dd2 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:27.508342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6438d-f8b9-4a62-b77e-5f340a04255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:27.508982 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6438d-f8b9-4a62-b77e-5f340a04255f None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:27.509251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6438d-f8b9-4a62-b77e-5f340a04255f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:27.509527 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6438d-f8b9-4a62-b77e-5f340a04255f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:27.576905 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:27.592988 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6438d-f8b9-4a62-b77e-5f340a04255f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:27.595541 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6438d-f8b9-4a62-b77e-5f340a04255f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:27.715941 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 638/1255] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:42:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:42:27.722067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5623d-2c3a-4ed9-bcaa-a54ade04efad None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:27.825715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5623d-2c3a-4ed9-bcaa-a54ade04efad None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:27.840026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:27.862473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f86272-e2bb-4b3e-ab57-ab72e47f6515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:27.863099 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f86272-e2bb-4b3e-ab57-ab72e47f6515 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:27.863377 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f86272-e2bb-4b3e-ab57-ab72e47f6515 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:27.863648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f86272-e2bb-4b3e-ab57-ab72e47f6515 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:27.874230 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f86272-e2bb-4b3e-ab57-ab72e47f6515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:27.875658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f86272-e2bb-4b3e-ab57-ab72e47f6515 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-a2f86272-e2bb-4b3e-ab57-ab72e47f6515 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:42:27.890422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:27.891418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:42:27.897084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:42:27.897084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:27.897084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:27.897084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 618/1256] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:27.897336 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6438d-f8b9-4a62-b77e-5f340a04255f None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:27.996142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:28.013428 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6438d-f8b9-4a62-b77e-5f340a04255f None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:28.056305 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da912630-59e6-4ad0-8b25-daea541f4c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:28.057098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da912630-59e6-4ad0-8b25-daea541f4c26 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:28.057285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da912630-59e6-4ad0-8b25-daea541f4c26 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:28.057618 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da912630-59e6-4ad0-8b25-daea541f4c26 None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:28.058355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da912630-59e6-4ad0-8b25-daea541f4c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:28.058665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da912630-59e6-4ad0-8b25-daea541f4c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:28.060034 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da912630-59e6-4ad0-8b25-daea541f4c26 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:28.073279 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 639/1257] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:28.081099 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f86272-e2bb-4b3e-ab57-ab72e47f6515 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:28.195477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f86272-e2bb-4b3e-ab57-ab72e47f6515 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:28.233822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ca975-0853-4306-9d4c-279441cdacaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:28.234456 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ca975-0853-4306-9d4c-279441cdacaf None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:28.234786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ca975-0853-4306-9d4c-279441cdacaf None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:28.235018 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ca975-0853-4306-9d4c-279441cdacaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:28.242449 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ca975-0853-4306-9d4c-279441cdacaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:28.243975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ca975-0853-4306-9d4c-279441cdacaf None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:28.257109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-2b2ca975-0853-4306-9d4c-279441cdacaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:42:28.257109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:28.257109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:28.257109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:28.257109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:28.257109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:28.257109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:28.257109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:28.257109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:28.257109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:28.257109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:28.257109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:28.257109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:42:28.257109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:42:28.257109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:28.258198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:28.259266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:42:28.259266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:42:28.259266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:42:28.259266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:42:28.259266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:42:28.259266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:42:28.259266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:42:28.259266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:28.259266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 619/1258] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:42:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:42:28.265300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da912630-59e6-4ad0-8b25-daea541f4c26 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:28.369859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da912630-59e6-4ad0-8b25-daea541f4c26 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:28.405777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db21348-3c49-4a77-a494-4ae32f549d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:28.406376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db21348-3c49-4a77-a494-4ae32f549d02 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:28.406716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db21348-3c49-4a77-a494-4ae32f549d02 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:28.406977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db21348-3c49-4a77-a494-4ae32f549d02 None admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:28.407710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db21348-3c49-4a77-a494-4ae32f549d02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:28.408015 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db21348-3c49-4a77-a494-4ae32f549d02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:28.409482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db21348-3c49-4a77-a494-4ae32f549d02 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:28.421836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 640/1259] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:42:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:28.428318 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ca975-0853-4306-9d4c-279441cdacaf None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:28.457847 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:28.539558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ca975-0853-4306-9d4c-279441cdacaf None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:28.578458 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26e957-c3f5-4216-a4c4-5d9594c1acaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:28.578695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26e957-c3f5-4216-a4c4-5d9594c1acaa None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:28.578971 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26e957-c3f5-4216-a4c4-5d9594c1acaa None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:28.579237 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26e957-c3f5-4216-a4c4-5d9594c1acaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:28.579955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26e957-c3f5-4216-a4c4-5d9594c1acaa None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=95abbd88e549427abbf5699efed0451a) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:28.580257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26e957-c3f5-4216-a4c4-5d9594c1acaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:28.581716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26e957-c3f5-4216-a4c4-5d9594c1acaa None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:28.587949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 620/1260] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:42:28 2022] GET /identity/v3/role_assignments?user.id=95abbd88e549427abbf5699efed0451a&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:30.465647 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e573ba5-f50c-4c3f-b283-df582b62ae42 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:30.466198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e573ba5-f50c-4c3f-b283-df582b62ae42 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:30.466198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e573ba5-f50c-4c3f-b283-df582b62ae42 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:30.467526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 641/1261] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:42:30.472424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe48bc9-d72e-4c2a-be57-0639d5a79caa None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:30.472826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe48bc9-d72e-4c2a-be57-0639d5a79caa None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:30.472973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe48bc9-d72e-4c2a-be57-0639d5a79caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:30.490953 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-efe48bc9-d72e-4c2a-be57-0639d5a79caa None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:42:30.492117 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-efe48bc9-d72e-4c2a-be57-0639d5a79caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:42:30.556012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 621/1262] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:42:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:42:30.825904 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e573ba5-f50c-4c3f-b283-df582b62ae42 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:30.836657 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:30.924330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e573ba5-f50c-4c3f-b283-df582b62ae42 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:30.956650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1b031-8301-4204-8ab6-676ffef670b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:30.957282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1b031-8301-4204-8ab6-676ffef670b0 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:30.957563 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1b031-8301-4204-8ab6-676ffef670b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:30.957832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1b031-8301-4204-8ab6-676ffef670b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:30.968249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1b031-8301-4204-8ab6-676ffef670b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-3ad1b031-8301-4204-8ab6-676ffef670b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:42:30.972862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:30.973953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:30.975637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:30.975637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:30.975637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:30.975637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:30.975637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:42:30.975637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:42:30.975637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:42:30.975637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:42:30.975637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:42:30.975637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:42:30.975637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:42:30.975637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:30.975637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 642/1263] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:42:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:30.980351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe48bc9-d72e-4c2a-be57-0639d5a79caa None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:30.997936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:31.085709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe48bc9-d72e-4c2a-be57-0639d5a79caa None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:31.119269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01470efb-f51e-4108-bf82-347705a56d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:31.119862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01470efb-f51e-4108-bf82-347705a56d36 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:31.120138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01470efb-f51e-4108-bf82-347705a56d36 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:31.120408 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01470efb-f51e-4108-bf82-347705a56d36 None admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:31.121091 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01470efb-f51e-4108-bf82-347705a56d36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:31.121391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01470efb-f51e-4108-bf82-347705a56d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:31.122738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01470efb-f51e-4108-bf82-347705a56d36 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:31.130368 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 622/1264] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:42:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:31.136101 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1b031-8301-4204-8ab6-676ffef670b0 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:31.199953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:31.232354 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1b031-8301-4204-8ab6-676ffef670b0 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:31.265404 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfdcc7-9890-4950-ba6a-8dd381554660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:31.266018 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfdcc7-9890-4950-ba6a-8dd381554660 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:31.266297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfdcc7-9890-4950-ba6a-8dd381554660 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:31.266566 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfdcc7-9890-4950-ba6a-8dd381554660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:31.276192 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfdcc7-9890-4950-ba6a-8dd381554660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:31.277664 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfdcc7-9890-4950-ba6a-8dd381554660 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-abbfdcc7-9890-4950-ba6a-8dd381554660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:42:31.291465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:31.292799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:42:31.294027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:42:31.294027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:31.294027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:31.294027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 643/1265] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 08:42:31.298139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01470efb-f51e-4108-bf82-347705a56d36 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:31.377615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:31.396120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01470efb-f51e-4108-bf82-347705a56d36 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:31.428608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674e0c1-82fe-4ac6-8866-bd2ba8b0a18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:31.429220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674e0c1-82fe-4ac6-8866-bd2ba8b0a18b None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:31.429497 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674e0c1-82fe-4ac6-8866-bd2ba8b0a18b None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:31.429765 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674e0c1-82fe-4ac6-8866-bd2ba8b0a18b None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:31.430386 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674e0c1-82fe-4ac6-8866-bd2ba8b0a18b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:31.430684 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674e0c1-82fe-4ac6-8866-bd2ba8b0a18b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:31.432026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674e0c1-82fe-4ac6-8866-bd2ba8b0a18b None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:31.443075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 623/1266] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:31.448618 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfdcc7-9890-4950-ba6a-8dd381554660 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:31.544623 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfdcc7-9890-4950-ba6a-8dd381554660 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:31.563727 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:31.577575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248878a-39b6-4b76-8cc2-0675ce8ee0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:31.578190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248878a-39b6-4b76-8cc2-0675ce8ee0c7 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:31.578472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248878a-39b6-4b76-8cc2-0675ce8ee0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:31.578748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248878a-39b6-4b76-8cc2-0675ce8ee0c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:31.586253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248878a-39b6-4b76-8cc2-0675ce8ee0c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:31.587687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248878a-39b6-4b76-8cc2-0675ce8ee0c7 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-3248878a-39b6-4b76-8cc2-0675ce8ee0c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:42:31.598778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:31.600386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:31.601586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:31.601586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:31.601586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:42:31.601586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:42:31.601586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:42:31.601586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:42:31.601586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:42:31.601586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:42:31.601586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 08:42:31.601586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:31.601586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 644/1267] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:31.606086 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674e0c1-82fe-4ac6-8866-bd2ba8b0a18b None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:31.701391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674e0c1-82fe-4ac6-8866-bd2ba8b0a18b None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:31.734583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cf0f8-1ba9-4884-b27a-4bbeb7456b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:31.735166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cf0f8-1ba9-4884-b27a-4bbeb7456b67 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:31.735443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cf0f8-1ba9-4884-b27a-4bbeb7456b67 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:31.735713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cf0f8-1ba9-4884-b27a-4bbeb7456b67 None admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:31.736421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cf0f8-1ba9-4884-b27a-4bbeb7456b67 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:31.736720 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cf0f8-1ba9-4884-b27a-4bbeb7456b67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:31.738158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cf0f8-1ba9-4884-b27a-4bbeb7456b67 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:31.746418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:31.754587 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 624/1268] 10.222.0.76 () {56 vars in 1143 bytes} [Fri Aug 26 08:42:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:31.760151 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248878a-39b6-4b76-8cc2-0675ce8ee0c7 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:31.856445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248878a-39b6-4b76-8cc2-0675ce8ee0c7 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:31.887909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5c6ae-6a63-45a4-ac51-5e9488ebba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:31.888513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5c6ae-6a63-45a4-ac51-5e9488ebba08 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:31.888797 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5c6ae-6a63-45a4-ac51-5e9488ebba08 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:31.889110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5c6ae-6a63-45a4-ac51-5e9488ebba08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:31.899675 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5c6ae-6a63-45a4-ac51-5e9488ebba08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:31.901124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5c6ae-6a63-45a4-ac51-5e9488ebba08 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-21a5c6ae-6a63-45a4-ac51-5e9488ebba08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:42:31.915113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:31.916259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:42:31.917347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:42:31.917347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:31.917347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:31.917347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 645/1269] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:31.921762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cf0f8-1ba9-4884-b27a-4bbeb7456b67 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:32.017278 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cf0f8-1ba9-4884-b27a-4bbeb7456b67 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:32.055964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89a39d-3c36-4363-834b-d5363114623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:32.056642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89a39d-3c36-4363-834b-d5363114623c None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:32.056903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89a39d-3c36-4363-834b-d5363114623c None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:32.057247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89a39d-3c36-4363-834b-d5363114623c None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:32.057986 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89a39d-3c36-4363-834b-d5363114623c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:32.058333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89a39d-3c36-4363-834b-d5363114623c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:32.059929 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89a39d-3c36-4363-834b-d5363114623c None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:32.073669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 625/1270] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:42:32.079615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5c6ae-6a63-45a4-ac51-5e9488ebba08 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:32.111842 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:32.177618 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5c6ae-6a63-45a4-ac51-5e9488ebba08 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:32.210364 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c2b65-36ee-4e8a-939a-7d4a9bbe5501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:32.210969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c2b65-36ee-4e8a-939a-7d4a9bbe5501 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:32.211279 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c2b65-36ee-4e8a-939a-7d4a9bbe5501 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:32.211550 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c2b65-36ee-4e8a-939a-7d4a9bbe5501 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:32.218239 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c2b65-36ee-4e8a-939a-7d4a9bbe5501 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:32.219666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c2b65-36ee-4e8a-939a-7d4a9bbe5501 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:32.230437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-2c6c2b65-36ee-4e8a-939a-7d4a9bbe5501 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:42:32.230437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:32.230437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:32.230437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:32.230437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:32.230437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:32.230437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:32.230437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:32.230437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:32.230437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:32.230437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:32.230437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:32.230437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:42:32.230437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:42:32.230437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:32.231477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:32.232612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:42:32.232612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:42:32.232612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:42:32.232612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:42:32.232612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:42:32.232612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:42:32.232612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:42:32.232612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:32.232612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 646/1271] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:42:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:32.237359 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89a39d-3c36-4363-834b-d5363114623c None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:32.294443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:32.334927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89a39d-3c36-4363-834b-d5363114623c None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:32.366465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64108cd7-2f13-452f-b95a-c4c96b9fc07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:32.367051 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64108cd7-2f13-452f-b95a-c4c96b9fc07e None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:32.367328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64108cd7-2f13-452f-b95a-c4c96b9fc07e None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:32.367596 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64108cd7-2f13-452f-b95a-c4c96b9fc07e None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:32.368276 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64108cd7-2f13-452f-b95a-c4c96b9fc07e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:32.368576 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64108cd7-2f13-452f-b95a-c4c96b9fc07e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:32.369994 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64108cd7-2f13-452f-b95a-c4c96b9fc07e None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:32.381755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 626/1272] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:42:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:32.387619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c2b65-36ee-4e8a-939a-7d4a9bbe5501 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:32.476142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:32.484694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c2b65-36ee-4e8a-939a-7d4a9bbe5501 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:32.517168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae1011-e28f-40e7-bcf9-6b7190bf6405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:32.517805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae1011-e28f-40e7-bcf9-6b7190bf6405 None admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:32.518088 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae1011-e28f-40e7-bcf9-6b7190bf6405 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:32.518365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae1011-e28f-40e7-bcf9-6b7190bf6405 None admin] PATH_INFO: `/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/95abbd88e549427abbf5699efed0451a/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:32.520208 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae1011-e28f-40e7-bcf9-6b7190bf6405 None admin] RBAC: Authorizing `identity:create_grant(project_id=35aafba89a1d47cd86cef1eb0a11e507, user_id=95abbd88e549427abbf5699efed0451a, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:32.521675 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae1011-e28f-40e7-bcf9-6b7190bf6405 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:32.533652 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 647/1273] 10.222.0.76 () {58 vars in 1439 bytes} [Fri Aug 26 08:42:32 2022] PUT /identity/v3/projects/35aafba89a1d47cd86cef1eb0a11e507/users/95abbd88e549427abbf5699efed0451a/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:42:34.372241 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cf90b-1c6d-4668-b082-d28adb3a1f9a None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:34.372775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cf90b-1c6d-4668-b082-d28adb3a1f9a None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:34.372775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cf90b-1c6d-4668-b082-d28adb3a1f9a None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:34.374128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 627/1274] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:42:34.379194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08948a-8b52-4103-96c6-1f8394e7a9a8 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:34.379579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08948a-8b52-4103-96c6-1f8394e7a9a8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:34.379754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08948a-8b52-4103-96c6-1f8394e7a9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:34.397276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-ec08948a-8b52-4103-96c6-1f8394e7a9a8 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:42:34.398464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ec08948a-8b52-4103-96c6-1f8394e7a9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:42:34.462151 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 648/1275] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:42:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:42:34.729289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cf90b-1c6d-4668-b082-d28adb3a1f9a None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:34.827522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cf90b-1c6d-4668-b082-d28adb3a1f9a None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:34.844870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:34.862100 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63104ceb-8eb4-4fad-90eb-4ef477d78dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:34.862704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63104ceb-8eb4-4fad-90eb-4ef477d78dda None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:34.862980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63104ceb-8eb4-4fad-90eb-4ef477d78dda None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:34.863250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63104ceb-8eb4-4fad-90eb-4ef477d78dda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:34.872859 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63104ceb-8eb4-4fad-90eb-4ef477d78dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-63104ceb-8eb4-4fad-90eb-4ef477d78dda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 08:42:34.877427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:34.878538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:34.879588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:34.879588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:34.879588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:34.879588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:34.879588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 08:42:34.879588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 08:42:34.879588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 08:42:34.879588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 08:42:34.879588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 08:42:34.879588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 08:42:34.879588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 08:42:34.879588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:34.879588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 628/1276] 10.222.0.76 () {56 vars in 1096 bytes} [Fri Aug 26 08:42:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:34.884313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08948a-8b52-4103-96c6-1f8394e7a9a8 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:34.960886 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:34.979682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08948a-8b52-4103-96c6-1f8394e7a9a8 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:35.011238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5501c83-fbec-4334-a706-cbb4c45bf758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:35.011821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5501c83-fbec-4334-a706-cbb4c45bf758 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:35.012099 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5501c83-fbec-4334-a706-cbb4c45bf758 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:35.012369 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5501c83-fbec-4334-a706-cbb4c45bf758 None admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:35.013037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5501c83-fbec-4334-a706-cbb4c45bf758 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:35.013339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5501c83-fbec-4334-a706-cbb4c45bf758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:35.014677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5501c83-fbec-4334-a706-cbb4c45bf758 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:35.022832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 649/1277] 10.222.0.76 () {56 vars in 1099 bytes} [Fri Aug 26 08:42:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:35.028415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63104ceb-8eb4-4fad-90eb-4ef477d78dda None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:35.137585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63104ceb-8eb4-4fad-90eb-4ef477d78dda None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:35.169374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03376aa2-9513-49dd-8f4b-a890d583a06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:35.169976 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03376aa2-9513-49dd-8f4b-a890d583a06f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:35.170251 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03376aa2-9513-49dd-8f4b-a890d583a06f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:35.170520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03376aa2-9513-49dd-8f4b-a890d583a06f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:35.180398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03376aa2-9513-49dd-8f4b-a890d583a06f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:35.181838 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03376aa2-9513-49dd-8f4b-a890d583a06f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-03376aa2-9513-49dd-8f4b-a890d583a06f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:42:35.195520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:35.196622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:42:35.197747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:42:35.197747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:35.197747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:35.197747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 629/1278] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:35.202292 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5501c83-fbec-4334-a706-cbb4c45bf758 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:35.299365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5501c83-fbec-4334-a706-cbb4c45bf758 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:35.331327 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108829a-9320-4142-840f-d38642d4633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:35.331916 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108829a-9320-4142-840f-d38642d4633e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:35.332199 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108829a-9320-4142-840f-d38642d4633e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:35.332475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108829a-9320-4142-840f-d38642d4633e None admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:35.333139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108829a-9320-4142-840f-d38642d4633e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:35.333448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108829a-9320-4142-840f-d38642d4633e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:35.335391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108829a-9320-4142-840f-d38642d4633e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:35.346850 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 650/1279] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:35.352262 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03376aa2-9513-49dd-8f4b-a890d583a06f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:35.381953 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:35.448576 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03376aa2-9513-49dd-8f4b-a890d583a06f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:35.480686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5096186-52e4-4372-805b-6ef7742e1ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:35.481312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5096186-52e4-4372-805b-6ef7742e1ea1 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:35.481590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5096186-52e4-4372-805b-6ef7742e1ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:35.481857 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5096186-52e4-4372-805b-6ef7742e1ea1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:35.488863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5096186-52e4-4372-805b-6ef7742e1ea1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:35.490823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5096186-52e4-4372-805b-6ef7742e1ea1 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-f5096186-52e4-4372-805b-6ef7742e1ea1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 08:42:35.501502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:35.502606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:35.503751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:35.503751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:35.503751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 08:42:35.503751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 08:42:35.503751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 08:42:35.503751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 08:42:35.503751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 08:42:35.503751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 08:42:35.503751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 08:42:35.503751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:35.503751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 630/1280] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:35.508788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108829a-9320-4142-840f-d38642d4633e None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:35.512517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:35.607159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108829a-9320-4142-840f-d38642d4633e None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:35.640325 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a03ded-0f73-4945-a6d4-665ec12128c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:35.640918 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a03ded-0f73-4945-a6d4-665ec12128c7 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:35.641226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a03ded-0f73-4945-a6d4-665ec12128c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:35.641500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a03ded-0f73-4945-a6d4-665ec12128c7 None admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:35.642215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a03ded-0f73-4945-a6d4-665ec12128c7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:35.642520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a03ded-0f73-4945-a6d4-665ec12128c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:35.643936 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a03ded-0f73-4945-a6d4-665ec12128c7 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:35.660218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 651/1281] 10.222.0.76 () {56 vars in 1143 bytes} [Fri Aug 26 08:42:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:35.665874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5096186-52e4-4372-805b-6ef7742e1ea1 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:35.752328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:35.762130 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5096186-52e4-4372-805b-6ef7742e1ea1 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:35.793776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c73b5-6d18-4061-88b1-a7c68e3e3b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:35.794357 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c73b5-6d18-4061-88b1-a7c68e3e3b9f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:35.794633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c73b5-6d18-4061-88b1-a7c68e3e3b9f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:35.794903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c73b5-6d18-4061-88b1-a7c68e3e3b9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:35.859076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c73b5-6d18-4061-88b1-a7c68e3e3b9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:35.860485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c73b5-6d18-4061-88b1-a7c68e3e3b9f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:35.945237 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:35.955576 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 631/1282] 10.222.0.76 () {58 vars in 1282 bytes} [Fri Aug 26 08:42:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 08:42:35.961421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a03ded-0f73-4945-a6d4-665ec12128c7 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:36.021030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:36.059498 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a03ded-0f73-4945-a6d4-665ec12128c7 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:36.092427 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86901950-3c9e-492b-8a25-c5d88f562886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:36.093074 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86901950-3c9e-492b-8a25-c5d88f562886 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:36.093360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86901950-3c9e-492b-8a25-c5d88f562886 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:36.093635 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86901950-3c9e-492b-8a25-c5d88f562886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:36.103976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86901950-3c9e-492b-8a25-c5d88f562886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:36.105452 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86901950-3c9e-492b-8a25-c5d88f562886 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-86901950-3c9e-492b-8a25-c5d88f562886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 08:42:36.120133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:36.121241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 08:42:36.122449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 08:42:36.122449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 08:42:36.122449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:36.122449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 652/1283] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:36.128515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c73b5-6d18-4061-88b1-a7c68e3e3b9f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:36.225180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c73b5-6d18-4061-88b1-a7c68e3e3b9f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:36.257934 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb599d2a-4177-42d9-8630-08f8c89df24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:36.258528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb599d2a-4177-42d9-8630-08f8c89df24a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:36.258811 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb599d2a-4177-42d9-8630-08f8c89df24a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:36.259085 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb599d2a-4177-42d9-8630-08f8c89df24a None admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:36.259719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb599d2a-4177-42d9-8630-08f8c89df24a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:36.260021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb599d2a-4177-42d9-8630-08f8c89df24a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:36.261397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb599d2a-4177-42d9-8630-08f8c89df24a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:36.272840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 632/1284] 10.222.0.76 () {56 vars in 1109 bytes} [Fri Aug 26 08:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:36.278336 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86901950-3c9e-492b-8a25-c5d88f562886 None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:36.374283 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86901950-3c9e-492b-8a25-c5d88f562886 None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:36.387123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:36.407221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c46cab-6497-4f16-acb0-3382cc3c41ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:36.407832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46cab-6497-4f16-acb0-3382cc3c41ca None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:36.408115 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46cab-6497-4f16-acb0-3382cc3c41ca None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:36.408390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46cab-6497-4f16-acb0-3382cc3c41ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:36.415355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c46cab-6497-4f16-acb0-3382cc3c41ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:36.416787 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c46cab-6497-4f16-acb0-3382cc3c41ca None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:36.427667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application [None req-d4c46cab-6497-4f16-acb0-3382cc3c41ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:42:36.427667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:36.427667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:36.427667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:36.427667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:36.427667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:36.427667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:36.427667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:36.427667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:36.427667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:36.427667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:36.427667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:36.427667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 08:42:36.427667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 08:42:36.427667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:36.428724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:36.430037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 08:42:36.430037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 08:42:36.430037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 08:42:36.430037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 08:42:36.430037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 08:42:36.430037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 08:42:36.430037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 08:42:36.430037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: ERROR keystone.server.flask.application Aug 26 08:42:36.430037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 653/1285] 10.222.0.76 () {56 vars in 1111 bytes} [Fri Aug 26 08:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:36.434343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb599d2a-4177-42d9-8630-08f8c89df24a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:36.483027 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:36.530723 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb599d2a-4177-42d9-8630-08f8c89df24a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:36.562865 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c60ffc-e98f-40a1-8d56-9858277a1723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:36.563447 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c60ffc-e98f-40a1-8d56-9858277a1723 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:36.563728 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c60ffc-e98f-40a1-8d56-9858277a1723 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:36.564000 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c60ffc-e98f-40a1-8d56-9858277a1723 None admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:36.564682 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c60ffc-e98f-40a1-8d56-9858277a1723 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:36.564984 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c60ffc-e98f-40a1-8d56-9858277a1723 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:36.566423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c60ffc-e98f-40a1-8d56-9858277a1723 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:36.578506 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 633/1286] 10.222.0.76 () {56 vars in 1148 bytes} [Fri Aug 26 08:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:36.585082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c46cab-6497-4f16-acb0-3382cc3c41ca None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:36.680653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c46cab-6497-4f16-acb0-3382cc3c41ca None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:36.713065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2497e-020f-4f39-918c-2621d4252d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:36.713653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2497e-020f-4f39-918c-2621d4252d0b None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:36.713937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2497e-020f-4f39-918c-2621d4252d0b None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:36.714207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2497e-020f-4f39-918c-2621d4252d0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:36.715164 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2497e-020f-4f39-918c-2621d4252d0b None admin] RBAC: Adding query filter params (role.id=09f2910c22c641428a249f1ccd5c5180, scope.project.id=35aafba89a1d47cd86cef1eb0a11e507, user.id=95abbd88e549427abbf5699efed0451a) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:36.715469 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2497e-020f-4f39-918c-2621d4252d0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:36.716885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2497e-020f-4f39-918c-2621d4252d0b None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:36.722414 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 654/1287] 10.222.0.76 () {56 vars in 1374 bytes} [Fri Aug 26 08:42:36 2022] GET /identity/v3/role_assignments?user.id=95abbd88e549427abbf5699efed0451a&scope.project.id=35aafba89a1d47cd86cef1eb0a11e507&role.id=09f2910c22c641428a249f1ccd5c5180 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:38.612553 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb929b-95f8-46e6-a797-28988e931f50 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:38.613076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb929b-95f8-46e6-a797-28988e931f50 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:38.613184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb929b-95f8-46e6-a797-28988e931f50 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:38.614482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 634/1288] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:42:38.620219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec273b-aeb7-4395-8739-6035cd8e97d2 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:38.620652 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec273b-aeb7-4395-8739-6035cd8e97d2 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:38.620780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec273b-aeb7-4395-8739-6035cd8e97d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:38.639128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-9dec273b-aeb7-4395-8739-6035cd8e97d2 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:42:38.640316 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9dec273b-aeb7-4395-8739-6035cd8e97d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:42:38.669017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:38.709290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 655/1289] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:42:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:42:38.978839 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb929b-95f8-46e6-a797-28988e931f50 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:39.084127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb929b-95f8-46e6-a797-28988e931f50 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:39.095358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:39.119015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba534d62-e65c-4605-9f1b-129d29f9ed0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:39.119630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba534d62-e65c-4605-9f1b-129d29f9ed0f None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:39.119909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba534d62-e65c-4605-9f1b-129d29f9ed0f None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:39.120180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba534d62-e65c-4605-9f1b-129d29f9ed0f None admin] PATH_INFO: `/v3/services/placement` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:39.120753 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba534d62-e65c-4605-9f1b-129d29f9ed0f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:39.122139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba534d62-e65c-4605-9f1b-129d29f9ed0f None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-ba534d62-e65c-4605-9f1b-129d29f9ed0f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:39.130512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:39.131782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:39.132738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:39.132738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:39.132738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:39.132738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:39.132738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:39.132738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:39.132738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:39.132738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:39.132738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:39.132738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:39.132738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:42:39.132738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:42:39.132738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 08:42:39.132738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:39.132738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 635/1290] 10.222.0.76 () {56 vars in 1117 bytes} [Fri Aug 26 08:42:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:39.137678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec273b-aeb7-4395-8739-6035cd8e97d2 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:39.234195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec273b-aeb7-4395-8739-6035cd8e97d2 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:39.266182 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50209da5-4db6-4e32-b410-13cbab7e4a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:39.266772 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50209da5-4db6-4e32-b410-13cbab7e4a2c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:39.267054 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50209da5-4db6-4e32-b410-13cbab7e4a2c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:39.267327 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50209da5-4db6-4e32-b410-13cbab7e4a2c None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:39.267953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50209da5-4db6-4e32-b410-13cbab7e4a2c None admin] RBAC: Adding query filter params (name=placement) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:39.268258 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50209da5-4db6-4e32-b410-13cbab7e4a2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:39.269637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50209da5-4db6-4e32-b410-13cbab7e4a2c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:39.274778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 656/1291] 10.222.0.76 () {56 vars in 1116 bytes} [Fri Aug 26 08:42:39 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:39.280516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba534d62-e65c-4605-9f1b-129d29f9ed0f None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:39.378464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba534d62-e65c-4605-9f1b-129d29f9ed0f None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:39.410925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dd1a4-1ed7-4d73-9fb1-9a928bb08ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:39.411513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dd1a4-1ed7-4d73-9fb1-9a928bb08ea5 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:39.411797 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dd1a4-1ed7-4d73-9fb1-9a928bb08ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:39.412660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dd1a4-1ed7-4d73-9fb1-9a928bb08ea5 None admin] PATH_INFO: `/v3/services` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:39.413318 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dd1a4-1ed7-4d73-9fb1-9a928bb08ea5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:39.413621 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dd1a4-1ed7-4d73-9fb1-9a928bb08ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:39.414963 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dd1a4-1ed7-4d73-9fb1-9a928bb08ea5 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:39.419243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 636/1292] 10.222.0.76 () {56 vars in 1116 bytes} [Fri Aug 26 08:42:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:42:41.268588 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe2c17-fb17-468d-83a9-c49dccbbed63 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:41.269175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe2c17-fb17-468d-83a9-c49dccbbed63 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:41.269175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe2c17-fb17-468d-83a9-c49dccbbed63 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:41.270488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 657/1293] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:42:41.275544 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc81f42-1eee-484f-8198-5f540b59c356 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:41.275929 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc81f42-1eee-484f-8198-5f540b59c356 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:41.276104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc81f42-1eee-484f-8198-5f540b59c356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:41.294166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-bfc81f42-1eee-484f-8198-5f540b59c356 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:42:41.295341 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-bfc81f42-1eee-484f-8198-5f540b59c356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:42:41.324509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:41.361047 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 637/1294] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:42:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:42:41.626597 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe2c17-fb17-468d-83a9-c49dccbbed63 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:41.656973 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:41.725233 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe2c17-fb17-468d-83a9-c49dccbbed63 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:41.758335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b3db7-57e4-4679-bb29-fe8395ed564f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:41.758919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b3db7-57e4-4679-bb29-fe8395ed564f None admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:41.759197 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b3db7-57e4-4679-bb29-fe8395ed564f None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:41.759468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b3db7-57e4-4679-bb29-fe8395ed564f None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:41.760101 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b3db7-57e4-4679-bb29-fe8395ed564f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:41.761474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b3db7-57e4-4679-bb29-fe8395ed564f None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:41.775735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 658/1295] 10.222.0.76 () {60 vars in 1141 bytes} [Fri Aug 26 08:42:41 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:42:43.647141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03bb59-ef7d-4b7a-ad78-ac2166c9225e None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:43.647667 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03bb59-ef7d-4b7a-ad78-ac2166c9225e None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:43.647667 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03bb59-ef7d-4b7a-ad78-ac2166c9225e None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:43.649025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 638/1296] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:42:43.654097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d2f2f-0f58-41a4-b27e-e72a010edf4c None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:43.654502 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d2f2f-0f58-41a4-b27e-e72a010edf4c None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:43.654654 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d2f2f-0f58-41a4-b27e-e72a010edf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:43.672744 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-626d2f2f-0f58-41a4-b27e-e72a010edf4c None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:42:43.673981 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-626d2f2f-0f58-41a4-b27e-e72a010edf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:42:43.747083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 659/1297] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:42:43 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 08:42:44.013637 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03bb59-ef7d-4b7a-ad78-ac2166c9225e None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:44.124502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03bb59-ef7d-4b7a-ad78-ac2166c9225e None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:44.157957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422b6db-3fa4-4fd7-8874-324f9f61728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:44.158573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422b6db-3fa4-4fd7-8874-324f9f61728a None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:44.158856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422b6db-3fa4-4fd7-8874-324f9f61728a None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:44.159132 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422b6db-3fa4-4fd7-8874-324f9f61728a None admin] PATH_INFO: `/v3/services/placement` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:44.159716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422b6db-3fa4-4fd7-8874-324f9f61728a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:44.161098 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422b6db-3fa4-4fd7-8874-324f9f61728a None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-7422b6db-3fa4-4fd7-8874-324f9f61728a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:44.169496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:44.170663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:44.171715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:44.171715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:44.171715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:44.171715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:44.171715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:44.171715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:44.171715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:44.171715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:44.171715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:44.171715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:44.171715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:42:44.171715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:42:44.171715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 08:42:44.171715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:44.171715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 639/1298] 10.222.0.76 () {56 vars in 1117 bytes} [Fri Aug 26 08:42:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:44.176693 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d2f2f-0f58-41a4-b27e-e72a010edf4c None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:44.195037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:44.274248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d2f2f-0f58-41a4-b27e-e72a010edf4c None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:44.306341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d13850-3a82-432c-abe1-0f59935a6f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:44.306934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d13850-3a82-432c-abe1-0f59935a6f4c None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:44.307219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d13850-3a82-432c-abe1-0f59935a6f4c None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:44.307495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d13850-3a82-432c-abe1-0f59935a6f4c None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:44.308120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d13850-3a82-432c-abe1-0f59935a6f4c None admin] RBAC: Adding query filter params (name=placement) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:44.308427 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d13850-3a82-432c-abe1-0f59935a6f4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:44.309821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d13850-3a82-432c-abe1-0f59935a6f4c None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:44.314763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 660/1299] 10.222.0.76 () {56 vars in 1116 bytes} [Fri Aug 26 08:42:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:44.321149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422b6db-3fa4-4fd7-8874-324f9f61728a None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:44.353305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:44.419177 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422b6db-3fa4-4fd7-8874-324f9f61728a None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:44.451440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b386822-5c9a-43f3-ac12-6bdcfff60768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:44.452051 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b386822-5c9a-43f3-ac12-6bdcfff60768 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:44.452325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b386822-5c9a-43f3-ac12-6bdcfff60768 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:44.452592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b386822-5c9a-43f3-ac12-6bdcfff60768 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:44.453338 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b386822-5c9a-43f3-ac12-6bdcfff60768 None admin] RBAC: Adding query filter params (interface=public, service_id=49d7ba215f304bd5b90348f60cae099e, region_id=RegionOne) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:44.453642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b386822-5c9a-43f3-ac12-6bdcfff60768 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:44.454980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b386822-5c9a-43f3-ac12-6bdcfff60768 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:44.460330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 640/1300] 10.222.0.76 () {56 vars in 1251 bytes} [Fri Aug 26 08:42:44 2022] GET /identity/v3/endpoints?service_id=49d7ba215f304bd5b90348f60cae099e&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:44.466137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d13850-3a82-432c-abe1-0f59935a6f4c None admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:44.543048 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:44.561448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d13850-3a82-432c-abe1-0f59935a6f4c None admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:44.596283 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ace5e-67f7-4c31-842e-720c5110248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:44.596885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ace5e-67f7-4c31-842e-720c5110248e None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:44.597204 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ace5e-67f7-4c31-842e-720c5110248e None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:44.597484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ace5e-67f7-4c31-842e-720c5110248e None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:44.598085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ace5e-67f7-4c31-842e-720c5110248e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:44.599443 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ace5e-67f7-4c31-842e-720c5110248e None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:44.606099 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 661/1301] 10.222.0.76 () {56 vars in 1087 bytes} [Fri Aug 26 08:42:44 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:42:46.501442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37e5cc-9c3d-4909-9649-4db19c763699 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:46.502003 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37e5cc-9c3d-4909-9649-4db19c763699 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:46.502003 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37e5cc-9c3d-4909-9649-4db19c763699 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:46.503305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 641/1302] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:42:46.508480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cd8e3-49c7-4e9a-a9cf-fa0adde61413 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:46.508862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cd8e3-49c7-4e9a-a9cf-fa0adde61413 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:46.509062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cd8e3-49c7-4e9a-a9cf-fa0adde61413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:46.526452 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-090cd8e3-49c7-4e9a-a9cf-fa0adde61413 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:42:46.527617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-090cd8e3-49c7-4e9a-a9cf-fa0adde61413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:42:46.592207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 662/1303] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:42:46 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 08:42:46.874139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37e5cc-9c3d-4909-9649-4db19c763699 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:46.965975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:46.972909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37e5cc-9c3d-4909-9649-4db19c763699 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:47.005179 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fae63-53e0-4dc4-b5f4-71008a118f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:47.005823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fae63-53e0-4dc4-b5f4-71008a118f88 None admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:47.006099 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fae63-53e0-4dc4-b5f4-71008a118f88 None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:47.006366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fae63-53e0-4dc4-b5f4-71008a118f88 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:47.006934 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fae63-53e0-4dc4-b5f4-71008a118f88 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:47.008309 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fae63-53e0-4dc4-b5f4-71008a118f88 None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application [None req-cd2fae63-53e0-4dc4-b5f4-71008a118f88 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 08:42:47.018107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 08:42:47.019397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 08:42:47.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 08:42:47.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application with Lock( Aug 26 08:42:47.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 08:42:47.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self._enter() Aug 26 08:42:47.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 08:42:47.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 08:42:47.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 08:42:47.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application return self.creator() Aug 26 08:42:47.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 08:42:47.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application created_value = creator( Aug 26 08:42:47.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 08:42:47.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 08:42:47.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 08:42:47.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: ERROR keystone.server.flask.application Aug 26 08:42:47.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 642/1304] 10.222.0.76 () {56 vars in 1117 bytes} [Fri Aug 26 08:42:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 08:42:47.026034 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cd8e3-49c7-4e9a-a9cf-fa0adde61413 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:47.106455 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:47.128708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cd8e3-49c7-4e9a-a9cf-fa0adde61413 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:47.161815 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee6199-bad9-4219-b31f-ae5654134181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:47.162410 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee6199-bad9-4219-b31f-ae5654134181 None admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:47.162691 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee6199-bad9-4219-b31f-ae5654134181 None admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:47.162964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee6199-bad9-4219-b31f-ae5654134181 None admin] PATH_INFO: `/v3/services` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:47.163586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee6199-bad9-4219-b31f-ae5654134181 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:42:47.163891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee6199-bad9-4219-b31f-ae5654134181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:47.165295 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee6199-bad9-4219-b31f-ae5654134181 None admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:47.170236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 663/1305] 10.222.0.76 () {56 vars in 1116 bytes} [Fri Aug 26 08:42:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:42:47.176103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fae63-53e0-4dc4-b5f4-71008a118f88 None admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:42:47.274874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fae63-53e0-4dc4-b5f4-71008a118f88 None admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:42:47.306643 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2814e-be2f-4ed5-9a79-ec11930d39ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:42:47.307228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2814e-be2f-4ed5-9a79-ec11930d39ac None admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:42:47.307512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2814e-be2f-4ed5-9a79-ec11930d39ac None admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:42:47.307787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2814e-be2f-4ed5-9a79-ec11930d39ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:42:47.308431 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2814e-be2f-4ed5-9a79-ec11930d39ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:42:47.309807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2814e-be2f-4ed5-9a79-ec11930d39ac None admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:42:47.329700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 643/1306] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:42:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:42:57.167388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=30 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:42:57.325538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:43:50.713283 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297b230-7b8f-4f01-a5ff-0552c1e0522b None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:43:50.713905 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297b230-7b8f-4f01-a5ff-0552c1e0522b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:43:50.713905 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297b230-7b8f-4f01-a5ff-0552c1e0522b None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:43:50.720699 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eefd80-59c7-4c05-901f-8979cc9e16ce None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:43:50.721198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eefd80-59c7-4c05-901f-8979cc9e16ce None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:43:50.721310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eefd80-59c7-4c05-901f-8979cc9e16ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:43:50.725325 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 664/1307] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:43:50 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:43:50.834086 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-29eefd80-59c7-4c05-901f-8979cc9e16ce None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:43:50.834515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-29eefd80-59c7-4c05-901f-8979cc9e16ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:43:50.977371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 644/1308] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:43:51.272124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414cd14-49e7-446d-8124-97a04684ea87 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:43:51.272699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414cd14-49e7-446d-8124-97a04684ea87 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:43:51.273171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414cd14-49e7-446d-8124-97a04684ea87 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:43:51.274930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 665/1309] 10.222.0.76 () {54 vars in 965 bytes} [Fri Aug 26 08:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:43:51.285820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392a218-85a8-4a64-ab32-c3a257116079 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:43:51.286437 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392a218-85a8-4a64-ab32-c3a257116079 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:43:51.286827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392a218-85a8-4a64-ab32-c3a257116079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:43:51.376346 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-8392a218-85a8-4a64-ab32-c3a257116079 None None] MFA Rules not processed for user `e8a867070e974a918a906148bbfd1fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:43:51.377805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-8392a218-85a8-4a64-ab32-c3a257116079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:43:51.405188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:43:51.483518 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 645/1310] 10.222.0.76 () {58 vars in 1062 bytes} [Fri Aug 26 08:43:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:43:51.492508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414cd14-49e7-446d-8124-97a04684ea87 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:43:51.494644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-5414cd14-49e7-446d-8124-97a04684ea87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:43:51.623019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414cd14-49e7-446d-8124-97a04684ea87 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:43:51.716522 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c7836-ebe2-4a42-b96d-ba22c60c18bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:43:51.719802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c7836-ebe2-4a42-b96d-ba22c60c18bf service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:43:51.720413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c7836-ebe2-4a42-b96d-ba22c60c18bf service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:43:51.720853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c7836-ebe2-4a42-b96d-ba22c60c18bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:43:51.722933 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e81c7836-ebe2-4a42-b96d-ba22c60c18bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:43:51.797257 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:43:51.864360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c7836-ebe2-4a42-b96d-ba22c60c18bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:43:51.865851 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c7836-ebe2-4a42-b96d-ba22c60c18bf service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:43:51.888206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 666/1311] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:43:54.130827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b5643-53d5-4dea-a199-eed1c6039a2b None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:43:54.131420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b5643-53d5-4dea-a199-eed1c6039a2b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:43:54.131420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b5643-53d5-4dea-a199-eed1c6039a2b None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:43:54.133172 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 646/1312] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:43:54.138406 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2d209-eb83-4486-b8f9-8561df600c19 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:43:54.138866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2d209-eb83-4486-b8f9-8561df600c19 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:43:54.138976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2d209-eb83-4486-b8f9-8561df600c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:43:54.221120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-85c2d209-eb83-4486-b8f9-8561df600c19 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:43:54.222363 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-85c2d209-eb83-4486-b8f9-8561df600c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:43:54.320302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 667/1313] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:43:54.618105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d802185-c58a-4b02-a85e-6b7c2ef0ce7d None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:43:54.618395 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d802185-c58a-4b02-a85e-6b7c2ef0ce7d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:43:54.618672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d802185-c58a-4b02-a85e-6b7c2ef0ce7d None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:43:54.620006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 647/1314] 10.222.0.76 () {54 vars in 965 bytes} [Fri Aug 26 08:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:43:54.626199 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1378311-7e84-497e-b8ac-c5421f5118dc None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:43:54.626488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1378311-7e84-497e-b8ac-c5421f5118dc None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:43:54.626760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1378311-7e84-497e-b8ac-c5421f5118dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:43:54.638549 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:43:54.704389 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-c1378311-7e84-497e-b8ac-c5421f5118dc None None] MFA Rules not processed for user `e8a867070e974a918a906148bbfd1fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:43:54.705545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c1378311-7e84-497e-b8ac-c5421f5118dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:43:54.782764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 668/1315] 10.222.0.76 () {58 vars in 1062 bytes} [Fri Aug 26 08:43:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:43:54.792222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d802185-c58a-4b02-a85e-6b7c2ef0ce7d None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:43:54.793779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1d802185-c58a-4b02-a85e-6b7c2ef0ce7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:43:54.894615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d802185-c58a-4b02-a85e-6b7c2ef0ce7d None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:43:54.963493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:43:54.966039 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc59977-684b-41f0-85db-4295c93bbbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:43:54.966619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc59977-684b-41f0-85db-4295c93bbbcc service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:43:54.967090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc59977-684b-41f0-85db-4295c93bbbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:43:54.967420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc59977-684b-41f0-85db-4295c93bbbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:43:54.969426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-2bc59977-684b-41f0-85db-4295c93bbbcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:43:55.074932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc59977-684b-41f0-85db-4295c93bbbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:43:55.076346 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc59977-684b-41f0-85db-4295c93bbbcc service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:43:55.094909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 648/1316] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:43:57.518928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15cfe1-9388-49af-8a5c-c9e977fdfa49 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:43:57.519488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15cfe1-9388-49af-8a5c-c9e977fdfa49 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:43:57.519488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15cfe1-9388-49af-8a5c-c9e977fdfa49 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:43:57.520865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 669/1317] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:43:57.526094 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0eb3f1-cad4-481b-b564-b0b56a518f28 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:43:57.526510 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0eb3f1-cad4-481b-b564-b0b56a518f28 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:43:57.526644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0eb3f1-cad4-481b-b564-b0b56a518f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:43:57.591876 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-3b0eb3f1-cad4-481b-b564-b0b56a518f28 None None] MFA Rules not processed for user `75c78ba256b046a890982a91574c5ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:43:57.593102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3b0eb3f1-cad4-481b-b564-b0b56a518f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:43:57.643074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:43:57.687860 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 649/1318] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:43:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:43:57.971017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15cfe1-9388-49af-8a5c-c9e977fdfa49 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:43:57.973203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-db15cfe1-9388-49af-8a5c-c9e977fdfa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:43:58.075632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15cfe1-9388-49af-8a5c-c9e977fdfa49 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:43:58.078419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:43:58.148656 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58ab11-e2be-435d-ad93-750e71fc6093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:43:58.149285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58ab11-e2be-435d-ad93-750e71fc6093 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:43:58.149562 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58ab11-e2be-435d-ad93-750e71fc6093 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:43:58.149830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58ab11-e2be-435d-ad93-750e71fc6093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:43:58.151413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6b58ab11-e2be-435d-ad93-750e71fc6093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:43:58.257031 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58ab11-e2be-435d-ad93-750e71fc6093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:43:58.258397 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58ab11-e2be-435d-ad93-750e71fc6093 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:43:58.276780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 670/1319] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:43:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:44:00.668460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747a13b-8352-4197-913d-67fc60874fd0 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:00.668979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747a13b-8352-4197-913d-67fc60874fd0 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:00.668979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747a13b-8352-4197-913d-67fc60874fd0 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:00.670348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 650/1320] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:00.676303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6b662-a012-466c-9d78-459daeafe9a9 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:00.676756 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6b662-a012-466c-9d78-459daeafe9a9 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:00.676855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6b662-a012-466c-9d78-459daeafe9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:00.716856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:00.742495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0aa6b662-a012-466c-9d78-459daeafe9a9 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:00.743703 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0aa6b662-a012-466c-9d78-459daeafe9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:00.837168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 671/1321] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:01.117180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747a13b-8352-4197-913d-67fc60874fd0 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:01.118752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5747a13b-8352-4197-913d-67fc60874fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:01.219336 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747a13b-8352-4197-913d-67fc60874fd0 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:01.290475 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52f7d0-670e-499e-93b8-1fd515e6e511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:01.291073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52f7d0-670e-499e-93b8-1fd515e6e511 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:01.291339 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52f7d0-670e-499e-93b8-1fd515e6e511 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:01.291605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52f7d0-670e-499e-93b8-1fd515e6e511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:01.293205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5b52f7d0-670e-499e-93b8-1fd515e6e511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:01.300391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:01.400693 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52f7d0-670e-499e-93b8-1fd515e6e511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:01.402087 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52f7d0-670e-499e-93b8-1fd515e6e511 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:01.419497 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 651/1322] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:44:03.953627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9c0e9-38bf-4ff1-8da9-e1df36514f19 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:03.954169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9c0e9-38bf-4ff1-8da9-e1df36514f19 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:03.954169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9c0e9-38bf-4ff1-8da9-e1df36514f19 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:03.956255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 672/1323] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:03.961325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a6441-9c1c-41a4-98f6-513a54a98572 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:03.961741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a6441-9c1c-41a4-98f6-513a54a98572 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:03.961888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a6441-9c1c-41a4-98f6-513a54a98572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:04.028038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-518a6441-9c1c-41a4-98f6-513a54a98572 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:04.029279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-518a6441-9c1c-41a4-98f6-513a54a98572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:04.088279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:04.128537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 652/1324] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:04.414859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9c0e9-38bf-4ff1-8da9-e1df36514f19 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:04.416473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0fb9c0e9-38bf-4ff1-8da9-e1df36514f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:04.523270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9c0e9-38bf-4ff1-8da9-e1df36514f19 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:04.535728 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:04.601888 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efed997-0871-423d-af8a-2e3685a9e7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:04.602420 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efed997-0871-423d-af8a-2e3685a9e7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:04.602705 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efed997-0871-423d-af8a-2e3685a9e7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:04.602966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efed997-0871-423d-af8a-2e3685a9e7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:04.605138 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9efed997-0871-423d-af8a-2e3685a9e7b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:04.735847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efed997-0871-423d-af8a-2e3685a9e7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:04.737853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efed997-0871-423d-af8a-2e3685a9e7b3 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:04.761327 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 673/1325] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:44:06.729424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734c53b-5b84-4d04-bb44-38f09325df25 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:06.729895 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734c53b-5b84-4d04-bb44-38f09325df25 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:06.730004 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734c53b-5b84-4d04-bb44-38f09325df25 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:06.731298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 653/1326] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:06.736857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36870984-50d2-4854-84ca-61e89e39f15f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:06.737333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36870984-50d2-4854-84ca-61e89e39f15f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:06.737472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36870984-50d2-4854-84ca-61e89e39f15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:06.786622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:06.805337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-36870984-50d2-4854-84ca-61e89e39f15f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:06.806545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-36870984-50d2-4854-84ca-61e89e39f15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:06.902299 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 674/1327] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:07.190137 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734c53b-5b84-4d04-bb44-38f09325df25 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:07.191658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0734c53b-5b84-4d04-bb44-38f09325df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:07.301144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734c53b-5b84-4d04-bb44-38f09325df25 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:07.376035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dfe95-877c-4c41-95f8-4152b9850b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:07.376635 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dfe95-877c-4c41-95f8-4152b9850b28 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:07.376911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dfe95-877c-4c41-95f8-4152b9850b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:07.377210 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dfe95-877c-4c41-95f8-4152b9850b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:07.378892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-012dfe95-877c-4c41-95f8-4152b9850b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:07.395613 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:07.488923 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dfe95-877c-4c41-95f8-4152b9850b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:07.490370 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dfe95-877c-4c41-95f8-4152b9850b28 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:07.508020 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 654/1328] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:44:09.489623 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41560e-a799-4953-b5c4-7ef7ef76542a None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:09.490244 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41560e-a799-4953-b5c4-7ef7ef76542a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:09.490244 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41560e-a799-4953-b5c4-7ef7ef76542a None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:09.491567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 675/1329] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:09.497513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068b5a0-7019-4a41-baaa-d0185cb6afaf None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:09.498121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068b5a0-7019-4a41-baaa-d0185cb6afaf None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:09.498223 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068b5a0-7019-4a41-baaa-d0185cb6afaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:09.565916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-b068b5a0-7019-4a41-baaa-d0185cb6afaf None None] MFA Rules not processed for user `75c78ba256b046a890982a91574c5ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:09.567160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b068b5a0-7019-4a41-baaa-d0185cb6afaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:09.643614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:09.677223 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 655/1330] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:09.956673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41560e-a799-4953-b5c4-7ef7ef76542a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:09.958279 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-2b41560e-a799-4953-b5c4-7ef7ef76542a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:10.066042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41560e-a799-4953-b5c4-7ef7ef76542a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:10.085893 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:10.139643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87077b-d26f-4a07-9150-43a4f6fba0af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:10.140171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87077b-d26f-4a07-9150-43a4f6fba0af service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:10.140447 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87077b-d26f-4a07-9150-43a4f6fba0af service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:10.140717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87077b-d26f-4a07-9150-43a4f6fba0af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:10.142325 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-aa87077b-d26f-4a07-9150-43a4f6fba0af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:10.250514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87077b-d26f-4a07-9150-43a4f6fba0af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:10.251984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87077b-d26f-4a07-9150-43a4f6fba0af service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:10.271127 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 676/1331] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:09 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:44:12.597368 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d837b-2343-45a4-a3d1-2497e9495ac3 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:12.597810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d837b-2343-45a4-a3d1-2497e9495ac3 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:12.597903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d837b-2343-45a4-a3d1-2497e9495ac3 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:12.599244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 656/1332] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:12.604490 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fc0ba-68e4-4373-9afa-9168c233bbde None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:12.604943 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fc0ba-68e4-4373-9afa-9168c233bbde None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:12.605112 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fc0ba-68e4-4373-9afa-9168c233bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:12.684362 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:12.687028 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-388fc0ba-68e4-4373-9afa-9168c233bbde None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:12.688802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-388fc0ba-68e4-4373-9afa-9168c233bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:12.790976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 677/1333] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:13.075453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d837b-2343-45a4-a3d1-2497e9495ac3 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:13.077068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-747d837b-2343-45a4-a3d1-2497e9495ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:13.179671 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d837b-2343-45a4-a3d1-2497e9495ac3 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:13.250447 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee7afe-a00e-49f6-9a8e-9d877ac9af84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:13.251048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee7afe-a00e-49f6-9a8e-9d877ac9af84 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:13.251325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee7afe-a00e-49f6-9a8e-9d877ac9af84 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:13.251600 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee7afe-a00e-49f6-9a8e-9d877ac9af84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:13.253838 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-9aee7afe-a00e-49f6-9a8e-9d877ac9af84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:13.280209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:13.361153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee7afe-a00e-49f6-9a8e-9d877ac9af84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:13.363204 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee7afe-a00e-49f6-9a8e-9d877ac9af84 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:13.380678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 657/1334] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:44:15.323643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336e217-8fc0-482c-9a5d-702bd61fd9a6 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:15.324229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336e217-8fc0-482c-9a5d-702bd61fd9a6 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:15.324229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336e217-8fc0-482c-9a5d-702bd61fd9a6 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:15.325563 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 678/1335] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:15.330645 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b616ff-6cf6-4948-aad1-f447abbcb081 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:15.331126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b616ff-6cf6-4948-aad1-f447abbcb081 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:15.331317 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b616ff-6cf6-4948-aad1-f447abbcb081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:15.396328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-98b616ff-6cf6-4948-aad1-f447abbcb081 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:15.397559 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-98b616ff-6cf6-4948-aad1-f447abbcb081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:15.470519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:15.493054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 658/1336] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:15.783966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336e217-8fc0-482c-9a5d-702bd61fd9a6 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:15.785582 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a336e217-8fc0-482c-9a5d-702bd61fd9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:15.887060 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336e217-8fc0-482c-9a5d-702bd61fd9a6 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:15.914800 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:15.959209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70eeb91-1be1-4a08-b07d-1697d82fdba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:15.959807 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70eeb91-1be1-4a08-b07d-1697d82fdba2 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:15.960150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70eeb91-1be1-4a08-b07d-1697d82fdba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:15.960422 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70eeb91-1be1-4a08-b07d-1697d82fdba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:15.962016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e70eeb91-1be1-4a08-b07d-1697d82fdba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:16.066612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70eeb91-1be1-4a08-b07d-1697d82fdba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:16.068029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70eeb91-1be1-4a08-b07d-1697d82fdba2 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:16.085846 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 679/1337] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:44:18.299004 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25194985-e28c-4cda-93ae-eb05a165a068 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:18.299551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25194985-e28c-4cda-93ae-eb05a165a068 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:18.299551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25194985-e28c-4cda-93ae-eb05a165a068 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:18.300927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 659/1338] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:18.306261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34547c97-81b2-4bf3-95f7-aca51b9fccc8 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:18.306693 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34547c97-81b2-4bf3-95f7-aca51b9fccc8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:18.306796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34547c97-81b2-4bf3-95f7-aca51b9fccc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:18.371762 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-34547c97-81b2-4bf3-95f7-aca51b9fccc8 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:18.372971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-34547c97-81b2-4bf3-95f7-aca51b9fccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:18.381191 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:18.473128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 680/1339] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:18.762614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25194985-e28c-4cda-93ae-eb05a165a068 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:18.764139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-25194985-e28c-4cda-93ae-eb05a165a068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:18.864464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25194985-e28c-4cda-93ae-eb05a165a068 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:18.935413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ced84-aef1-4040-bc49-d26350a35b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:18.936012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ced84-aef1-4040-bc49-d26350a35b46 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:18.936290 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ced84-aef1-4040-bc49-d26350a35b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:18.936561 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ced84-aef1-4040-bc49-d26350a35b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:18.938180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-2f9ced84-aef1-4040-bc49-d26350a35b46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:18.974428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:19.047507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ced84-aef1-4040-bc49-d26350a35b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:19.049471 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ced84-aef1-4040-bc49-d26350a35b46 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:19.067664 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 660/1340] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:44:22.870967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7f0a7-38cc-4ee4-b7e4-b661de36a137 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:22.871480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7f0a7-38cc-4ee4-b7e4-b661de36a137 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:22.871592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7f0a7-38cc-4ee4-b7e4-b661de36a137 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:22.873287 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 681/1341] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:22.878124 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075715-5949-4cd7-b16c-12433bf3d385 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:22.878528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075715-5949-4cd7-b16c-12433bf3d385 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:22.878675 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075715-5949-4cd7-b16c-12433bf3d385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:22.943724 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-b3075715-5949-4cd7-b16c-12433bf3d385 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:22.944919 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b3075715-5949-4cd7-b16c-12433bf3d385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:23.036067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:23.048065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 661/1342] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:23.335883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7f0a7-38cc-4ee4-b7e4-b661de36a137 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:23.337504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-13b7f0a7-38cc-4ee4-b7e4-b661de36a137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:23.441440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7f0a7-38cc-4ee4-b7e4-b661de36a137 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:23.479115 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:23.515795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebe181-9ab6-4fc8-9478-53218bf93f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:23.516405 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebe181-9ab6-4fc8-9478-53218bf93f10 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:23.516685 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebe181-9ab6-4fc8-9478-53218bf93f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:23.516963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebe181-9ab6-4fc8-9478-53218bf93f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:23.518618 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-abebe181-9ab6-4fc8-9478-53218bf93f10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:23.630170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebe181-9ab6-4fc8-9478-53218bf93f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:23.631611 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebe181-9ab6-4fc8-9478-53218bf93f10 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:23.649624 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 682/1343] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:44:26.192632 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d9e37-654c-40f3-a326-acc734d275fa None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:26.193148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d9e37-654c-40f3-a326-acc734d275fa None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:26.193338 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d9e37-654c-40f3-a326-acc734d275fa None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:26.194562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 662/1344] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:26.199913 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d0e8e-effb-4a80-ad0c-5c4c7fb6d696 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:26.200468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d0e8e-effb-4a80-ad0c-5c4c7fb6d696 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:26.200567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d0e8e-effb-4a80-ad0c-5c4c7fb6d696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:26.266729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-df7d0e8e-effb-4a80-ad0c-5c4c7fb6d696 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:26.268537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-df7d0e8e-effb-4a80-ad0c-5c4c7fb6d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:26.286077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:26.363408 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 683/1345] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:26.642288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d9e37-654c-40f3-a326-acc734d275fa None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:26.643883 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-874d9e37-654c-40f3-a326-acc734d275fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:26.747046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d9e37-654c-40f3-a326-acc734d275fa None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:26.820928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2b649-03db-4e96-99cc-a8dad28131b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:26.821564 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2b649-03db-4e96-99cc-a8dad28131b7 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:26.821843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2b649-03db-4e96-99cc-a8dad28131b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:26.822112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2b649-03db-4e96-99cc-a8dad28131b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:26.823725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d6a2b649-03db-4e96-99cc-a8dad28131b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:26.872729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:26.940556 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2b649-03db-4e96-99cc-a8dad28131b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:26.942015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2b649-03db-4e96-99cc-a8dad28131b7 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:26.960273 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 663/1346] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:44:30.825150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09158da5-dd1c-47f4-bab3-8edcaa41a42a None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:30.825701 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09158da5-dd1c-47f4-bab3-8edcaa41a42a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:30.825701 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09158da5-dd1c-47f4-bab3-8edcaa41a42a None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:30.826987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 684/1347] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:30.832932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641854d7-b2f1-4b16-be4a-fca5f66ced22 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:30.833476 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641854d7-b2f1-4b16-be4a-fca5f66ced22 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:30.833576 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641854d7-b2f1-4b16-be4a-fca5f66ced22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:30.910031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-641854d7-b2f1-4b16-be4a-fca5f66ced22 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:30.911249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-641854d7-b2f1-4b16-be4a-fca5f66ced22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:31.024467 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:31.029666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 664/1348] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:31.313372 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09158da5-dd1c-47f4-bab3-8edcaa41a42a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:31.315495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-09158da5-dd1c-47f4-bab3-8edcaa41a42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:31.423242 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09158da5-dd1c-47f4-bab3-8edcaa41a42a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:31.471071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:31.497397 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac91ecf-e3a6-44f9-a6e6-5471727bc981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:31.498004 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac91ecf-e3a6-44f9-a6e6-5471727bc981 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:31.498288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac91ecf-e3a6-44f9-a6e6-5471727bc981 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:31.498563 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac91ecf-e3a6-44f9-a6e6-5471727bc981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:31.500166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-bac91ecf-e3a6-44f9-a6e6-5471727bc981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:31.607802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac91ecf-e3a6-44f9-a6e6-5471727bc981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:31.609205 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac91ecf-e3a6-44f9-a6e6-5471727bc981 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:31.627376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 685/1349] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:44:36.456634 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca1d18-9bd2-4419-b911-dd9f78203fa9 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:36.457141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca1d18-9bd2-4419-b911-dd9f78203fa9 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:36.457536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca1d18-9bd2-4419-b911-dd9f78203fa9 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:36.459306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 665/1350] 10.222.0.76 () {54 vars in 921 bytes} [Fri Aug 26 08:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:36.464476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd373a-bfdf-4d6e-a691-83d12bc161e2 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:36.464903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd373a-bfdf-4d6e-a691-83d12bc161e2 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:36.465361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd373a-bfdf-4d6e-a691-83d12bc161e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:36.562103 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-a5dd373a-bfdf-4d6e-a691-83d12bc161e2 None None] MFA Rules not processed for user `95abbd88e549427abbf5699efed0451a`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:36.563323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a5dd373a-bfdf-4d6e-a691-83d12bc161e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:36.605628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:36.753780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 686/1351] 10.222.0.76 () {58 vars in 1018 bytes} [Fri Aug 26 08:44:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:40.843677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f135256-d7f9-41ec-8a84-7908189f4cbc None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:40.844288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f135256-d7f9-41ec-8a84-7908189f4cbc None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:40.844288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f135256-d7f9-41ec-8a84-7908189f4cbc None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:40.845597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 666/1352] 10.222.0.76 () {54 vars in 921 bytes} [Fri Aug 26 08:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:40.850701 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2669-f798-4ef3-81f2-168d89bbf119 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:40.851138 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2669-f798-4ef3-81f2-168d89bbf119 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:40.851301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2669-f798-4ef3-81f2-168d89bbf119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:40.935618 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-a26c2669-f798-4ef3-81f2-168d89bbf119 None None] MFA Rules not processed for user `95abbd88e549427abbf5699efed0451a`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:40.936839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a26c2669-f798-4ef3-81f2-168d89bbf119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:41.012462 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:41.050248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 687/1353] 10.222.0.76 () {58 vars in 1018 bytes} [Fri Aug 26 08:44:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:42.464739 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb040-fbfb-4d80-9e26-be1a63aeca60 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:42.465322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb040-fbfb-4d80-9e26-be1a63aeca60 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:42.465322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb040-fbfb-4d80-9e26-be1a63aeca60 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:42.466625 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 667/1354] 10.222.0.76 () {54 vars in 921 bytes} [Fri Aug 26 08:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:42.471622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ce53a-f382-4ce9-8a25-47a74639dff5 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:42.472060 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ce53a-f382-4ce9-8a25-47a74639dff5 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:42.472180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ce53a-f382-4ce9-8a25-47a74639dff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:42.548456 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-6c0ce53a-f382-4ce9-8a25-47a74639dff5 None None] MFA Rules not processed for user `95abbd88e549427abbf5699efed0451a`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:42.549692 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6c0ce53a-f382-4ce9-8a25-47a74639dff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:42.659454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 688/1355] 10.222.0.76 () {58 vars in 1018 bytes} [Fri Aug 26 08:44:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:45.950985 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7b22a-c6be-46f8-8e82-005196dda8cf None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:45.951529 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7b22a-c6be-46f8-8e82-005196dda8cf None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:45.951529 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7b22a-c6be-46f8-8e82-005196dda8cf None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:45.953242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 668/1356] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:45.959312 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732ca2-121b-4fce-b3bf-c2d3819e2a56 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:45.959809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732ca2-121b-4fce-b3bf-c2d3819e2a56 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:45.959906 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732ca2-121b-4fce-b3bf-c2d3819e2a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:46.006337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:46.051457 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-75732ca2-121b-4fce-b3bf-c2d3819e2a56 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:46.053089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-75732ca2-121b-4fce-b3bf-c2d3819e2a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:46.189105 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 689/1357] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:46.494125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedda597-36d3-49f5-b0cd-b3cf71094b86 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:46.494828 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedda597-36d3-49f5-b0cd-b3cf71094b86 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:46.495309 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedda597-36d3-49f5-b0cd-b3cf71094b86 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:46.497362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 669/1358] 10.222.0.76 () {54 vars in 962 bytes} [Fri Aug 26 08:44:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:46.504580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998e3a6-8a21-4060-b635-23431f6a54f7 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:46.505384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998e3a6-8a21-4060-b635-23431f6a54f7 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:46.505865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998e3a6-8a21-4060-b635-23431f6a54f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:46.601133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-6998e3a6-8a21-4060-b635-23431f6a54f7 None None] MFA Rules not processed for user `b63d6e588f6e4b598b75a2ec13bea25d`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:46.602498 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6998e3a6-8a21-4060-b635-23431f6a54f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:46.659073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:46.731528 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 690/1359] 10.222.0.76 () {58 vars in 1059 bytes} [Fri Aug 26 08:44:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:46.740375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedda597-36d3-49f5-b0cd-b3cf71094b86 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:46.742094 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-cedda597-36d3-49f5-b0cd-b3cf71094b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:46.895054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedda597-36d3-49f5-b0cd-b3cf71094b86 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:46.985507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:47.028275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e11f7-346e-4ba4-8a9c-bfb29929bc2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:47.029232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e11f7-346e-4ba4-8a9c-bfb29929bc2b service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:47.029719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e11f7-346e-4ba4-8a9c-bfb29929bc2b service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:47.030214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e11f7-346e-4ba4-8a9c-bfb29929bc2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:47.033520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-066e11f7-346e-4ba4-8a9c-bfb29929bc2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:47.128139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e11f7-346e-4ba4-8a9c-bfb29929bc2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:47.129762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e11f7-346e-4ba4-8a9c-bfb29929bc2b service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:47.148528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 670/1360] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:44:49.269504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17483678-753b-4399-9853-f3a9fdf34e60 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:49.270085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17483678-753b-4399-9853-f3a9fdf34e60 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:49.270085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17483678-753b-4399-9853-f3a9fdf34e60 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:49.271464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 691/1361] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:49.276839 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97c866-f61a-470a-a12f-3d8f532ac67a None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:49.277335 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97c866-f61a-470a-a12f-3d8f532ac67a None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:49.277446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97c866-f61a-470a-a12f-3d8f532ac67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:49.348611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ea97c866-f61a-470a-a12f-3d8f532ac67a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:49.350160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ea97c866-f61a-470a-a12f-3d8f532ac67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:49.390691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:49.466736 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 671/1362] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:49.759308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17483678-753b-4399-9853-f3a9fdf34e60 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:49.761005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-17483678-753b-4399-9853-f3a9fdf34e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:49.916746 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17483678-753b-4399-9853-f3a9fdf34e60 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:49.928725 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:50.061015 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18eff7-8095-405f-a2b9-1a75e7ed055e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:50.061713 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18eff7-8095-405f-a2b9-1a75e7ed055e service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:50.062000 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18eff7-8095-405f-a2b9-1a75e7ed055e service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:50.062281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18eff7-8095-405f-a2b9-1a75e7ed055e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:50.064854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-db18eff7-8095-405f-a2b9-1a75e7ed055e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:50.163742 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18eff7-8095-405f-a2b9-1a75e7ed055e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:50.165749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18eff7-8095-405f-a2b9-1a75e7ed055e service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:50.186098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 692/1363] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:44:52.415201 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca705f5c-0827-4e42-a33a-d55b2ad9750c None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:52.416086 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca705f5c-0827-4e42-a33a-d55b2ad9750c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:52.416362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca705f5c-0827-4e42-a33a-d55b2ad9750c None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:52.417731 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 672/1364] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:52.423825 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d78f8-613e-4fde-b401-f3a9e57dcf68 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:52.424265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d78f8-613e-4fde-b401-f3a9e57dcf68 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:52.424439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d78f8-613e-4fde-b401-f3a9e57dcf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:52.440337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:52.495175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-166d78f8-613e-4fde-b401-f3a9e57dcf68 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:52.496397 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-166d78f8-613e-4fde-b401-f3a9e57dcf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:52.600046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 693/1365] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:52.890637 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a693f4-e781-4956-9ceb-5c7ac111be67 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:52.891061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a693f4-e781-4956-9ceb-5c7ac111be67 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:52.892003 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a693f4-e781-4956-9ceb-5c7ac111be67 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:52.893722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 673/1366] 10.222.0.76 () {54 vars in 962 bytes} [Fri Aug 26 08:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:52.899283 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917e25a-998a-4a8d-b39b-685d9101ae59 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:52.899643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917e25a-998a-4a8d-b39b-685d9101ae59 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:52.899989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917e25a-998a-4a8d-b39b-685d9101ae59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:53.002614 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-b917e25a-998a-4a8d-b39b-685d9101ae59 None None] MFA Rules not processed for user `b63d6e588f6e4b598b75a2ec13bea25d`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:53.003909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b917e25a-998a-4a8d-b39b-685d9101ae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:53.044811 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:53.144426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 694/1367] 10.222.0.76 () {58 vars in 1059 bytes} [Fri Aug 26 08:44:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:53.145554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a693f4-e781-4956-9ceb-5c7ac111be67 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:53.147179 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-07a693f4-e781-4956-9ceb-5c7ac111be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:53.330471 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a693f4-e781-4956-9ceb-5c7ac111be67 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:53.352157 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:53.455239 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f090b-aa05-4589-bbbb-69125d5f71dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:53.455915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f090b-aa05-4589-bbbb-69125d5f71dc service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:53.456223 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f090b-aa05-4589-bbbb-69125d5f71dc service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:53.456421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f090b-aa05-4589-bbbb-69125d5f71dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:53.458272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c44f090b-aa05-4589-bbbb-69125d5f71dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:53.556693 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f090b-aa05-4589-bbbb-69125d5f71dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:53.558323 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f090b-aa05-4589-bbbb-69125d5f71dc service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:53.581384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 674/1368] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:44:54.089187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7512f-0997-4646-bb86-5f313d86206b None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:54.090041 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7512f-0997-4646-bb86-5f313d86206b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:54.090041 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7512f-0997-4646-bb86-5f313d86206b None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:54.091505 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 695/1369] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:54.097238 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df24a9-fba3-4ae0-a67f-bb9ba0ff0348 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:54.097535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df24a9-fba3-4ae0-a67f-bb9ba0ff0348 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:54.097816 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df24a9-fba3-4ae0-a67f-bb9ba0ff0348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:54.133894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:54.172331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-90df24a9-fba3-4ae0-a67f-bb9ba0ff0348 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:54.174231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-90df24a9-fba3-4ae0-a67f-bb9ba0ff0348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:54.277516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 675/1370] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:54.863068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fd148-bdd7-4474-ba0d-28bc630b20bd None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:54.863068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fd148-bdd7-4474-ba0d-28bc630b20bd None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:54.863068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fd148-bdd7-4474-ba0d-28bc630b20bd None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:54.865283 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 696/1371] 10.222.0.76 () {54 vars in 964 bytes} [Fri Aug 26 08:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:44:54.869347 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b1bf8-7f95-42d0-b999-bc67b6d49312 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:54.869868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b1bf8-7f95-42d0-b999-bc67b6d49312 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:54.869868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b1bf8-7f95-42d0-b999-bc67b6d49312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:54.947633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-a03b1bf8-7f95-42d0-b999-bc67b6d49312 None None] MFA Rules not processed for user `0f3147e5695240afa9eaf42d2343b7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:54.950224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a03b1bf8-7f95-42d0-b999-bc67b6d49312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:54.999214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:55.033776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 676/1372] 10.222.0.76 () {58 vars in 1061 bytes} [Fri Aug 26 08:44:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:55.041937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fd148-bdd7-4474-ba0d-28bc630b20bd None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:55.043438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-5a0fd148-bdd7-4474-ba0d-28bc630b20bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:55.155334 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fd148-bdd7-4474-ba0d-28bc630b20bd None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:55.200975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:55.245256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c41adf-ce6a-4ea1-a1be-e78cead49dd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:55.246641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c41adf-ce6a-4ea1-a1be-e78cead49dd9 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:55.246796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c41adf-ce6a-4ea1-a1be-e78cead49dd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:55.247150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c41adf-ce6a-4ea1-a1be-e78cead49dd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:55.248660 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d8c41adf-ce6a-4ea1-a1be-e78cead49dd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:55.372058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c41adf-ce6a-4ea1-a1be-e78cead49dd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:55.373391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c41adf-ce6a-4ea1-a1be-e78cead49dd9 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:55.405420 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 697/1373] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:44:55.576340 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f52b52-86db-4808-b594-39f09105c48f None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:55.576627 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f52b52-86db-4808-b594-39f09105c48f None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:55.576901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f52b52-86db-4808-b594-39f09105c48f None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:55.578503 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 677/1374] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:55.583675 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca57b9-66d7-4af2-a084-4fd09994de72 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:55.583973 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca57b9-66d7-4af2-a084-4fd09994de72 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:55.584256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca57b9-66d7-4af2-a084-4fd09994de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:55.650498 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-5bca57b9-66d7-4af2-a084-4fd09994de72 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:55.651634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-5bca57b9-66d7-4af2-a084-4fd09994de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:55.673198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:55.749048 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 698/1375] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:56.038602 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f52b52-86db-4808-b594-39f09105c48f None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:56.040136 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-14f52b52-86db-4808-b594-39f09105c48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:56.196378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f52b52-86db-4808-b594-39f09105c48f None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:56.250343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:56.312968 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e4aee-782c-4d13-90f0-fbf78ea4f4db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:56.313561 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4aee-782c-4d13-90f0-fbf78ea4f4db service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:56.313852 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4aee-782c-4d13-90f0-fbf78ea4f4db service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:56.314132 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4aee-782c-4d13-90f0-fbf78ea4f4db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:56.315811 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a81e4aee-782c-4d13-90f0-fbf78ea4f4db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:56.403575 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e4aee-782c-4d13-90f0-fbf78ea4f4db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:56.405192 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e4aee-782c-4d13-90f0-fbf78ea4f4db service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:56.424171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 678/1376] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:44:58.369453 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29173b-631d-4ace-a1e0-01e377930f2b None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:58.369971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29173b-631d-4ace-a1e0-01e377930f2b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:58.370084 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29173b-631d-4ace-a1e0-01e377930f2b None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:58.371363 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 699/1377] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:44:58.377229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad35d64-be73-4abd-8fd8-6bf827f303ff None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:58.377679 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad35d64-be73-4abd-8fd8-6bf827f303ff None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:58.377785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad35d64-be73-4abd-8fd8-6bf827f303ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:58.455061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-cad35d64-be73-4abd-8fd8-6bf827f303ff None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:44:58.456198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-cad35d64-be73-4abd-8fd8-6bf827f303ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:58.462900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:58.552902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 679/1378] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:44:58.845206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29173b-631d-4ace-a1e0-01e377930f2b None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:44:58.846725 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9c29173b-631d-4ace-a1e0-01e377930f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:59.042103 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29173b-631d-4ace-a1e0-01e377930f2b None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:44:59.046817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:59.173130 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae47e6d-23bc-43f3-9410-cb972c22fb37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:44:59.173130 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae47e6d-23bc-43f3-9410-cb972c22fb37 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:44:59.173455 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae47e6d-23bc-43f3-9410-cb972c22fb37 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:44:59.173730 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae47e6d-23bc-43f3-9410-cb972c22fb37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:44:59.175508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4ae47e6d-23bc-43f3-9410-cb972c22fb37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:44:59.272126 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae47e6d-23bc-43f3-9410-cb972c22fb37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:44:59.273775 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae47e6d-23bc-43f3-9410-cb972c22fb37 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:44:59.293896 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 700/1379] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:01.251327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037bd46-4178-43f7-be63-49e21f0943b2 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:01.251843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037bd46-4178-43f7-be63-49e21f0943b2 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:01.251926 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037bd46-4178-43f7-be63-49e21f0943b2 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:01.253392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 680/1380] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:01.258507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51712d35-0cb9-4e26-aa49-b78516bce7b6 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:01.258958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51712d35-0cb9-4e26-aa49-b78516bce7b6 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:01.259058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51712d35-0cb9-4e26-aa49-b78516bce7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:01.272718 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:01.333413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-51712d35-0cb9-4e26-aa49-b78516bce7b6 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:01.335347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-51712d35-0cb9-4e26-aa49-b78516bce7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:01.443330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 701/1381] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:01.730382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037bd46-4178-43f7-be63-49e21f0943b2 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:01.732242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1037bd46-4178-43f7-be63-49e21f0943b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:01.876550 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:01.887880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037bd46-4178-43f7-be63-49e21f0943b2 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:02.009559 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c3360-5b19-43e4-ae4d-16eb35bb50d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:02.010676 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c3360-5b19-43e4-ae4d-16eb35bb50d6 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:02.011186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c3360-5b19-43e4-ae4d-16eb35bb50d6 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:02.011683 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c3360-5b19-43e4-ae4d-16eb35bb50d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:02.013519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a79c3360-5b19-43e4-ae4d-16eb35bb50d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:02.113547 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c3360-5b19-43e4-ae4d-16eb35bb50d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:02.115641 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c3360-5b19-43e4-ae4d-16eb35bb50d6 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:02.128692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:02.139538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 681/1382] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:04.090164 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273b2f1-7aac-49be-9f4a-f3942e117823 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:04.090861 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273b2f1-7aac-49be-9f4a-f3942e117823 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:04.090861 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273b2f1-7aac-49be-9f4a-f3942e117823 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:04.092047 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 702/1383] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:04.097653 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3d3a8-7a4e-4899-85f6-4c797a53aded None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:04.098077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3d3a8-7a4e-4899-85f6-4c797a53aded None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:04.098358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3d3a8-7a4e-4899-85f6-4c797a53aded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:04.184146 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-8bd3d3a8-7a4e-4899-85f6-4c797a53aded None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:04.185421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-8bd3d3a8-7a4e-4899-85f6-4c797a53aded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:04.285511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 682/1384] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:04.575995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273b2f1-7aac-49be-9f4a-f3942e117823 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:04.577726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e273b2f1-7aac-49be-9f4a-f3942e117823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:04.668519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:04.749469 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273b2f1-7aac-49be-9f4a-f3942e117823 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:04.918377 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96deb20-7d24-4bbc-8376-8e9ef47d68b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:04.919551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96deb20-7d24-4bbc-8376-8e9ef47d68b4 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:04.920046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96deb20-7d24-4bbc-8376-8e9ef47d68b4 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:04.920476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96deb20-7d24-4bbc-8376-8e9ef47d68b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:04.922811 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b96deb20-7d24-4bbc-8376-8e9ef47d68b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:04.997719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:05.042471 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96deb20-7d24-4bbc-8376-8e9ef47d68b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:05.044125 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96deb20-7d24-4bbc-8376-8e9ef47d68b4 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:05.062148 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 703/1385] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:06.988037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740347e-78f5-4281-b757-67cbd0ca9776 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:06.988613 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740347e-78f5-4281-b757-67cbd0ca9776 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:06.988721 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740347e-78f5-4281-b757-67cbd0ca9776 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:06.990497 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 683/1386] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:06.995979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2994a9-8730-4989-924d-c3d69a776cc4 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:06.996566 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2994a9-8730-4989-924d-c3d69a776cc4 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:06.996666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2994a9-8730-4989-924d-c3d69a776cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:07.070689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-3e2994a9-8730-4989-924d-c3d69a776cc4 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:07.072240 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-3e2994a9-8730-4989-924d-c3d69a776cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:07.178567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 704/1387] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:07.469793 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740347e-78f5-4281-b757-67cbd0ca9776 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:07.471355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7740347e-78f5-4281-b757-67cbd0ca9776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:07.548836 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:07.623383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740347e-78f5-4281-b757-67cbd0ca9776 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:07.744200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159a0fe-0076-43ee-9681-bd7a0d0bdeb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:07.744669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159a0fe-0076-43ee-9681-bd7a0d0bdeb8 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:07.744949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159a0fe-0076-43ee-9681-bd7a0d0bdeb8 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:07.745247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159a0fe-0076-43ee-9681-bd7a0d0bdeb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:07.746866 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b159a0fe-0076-43ee-9681-bd7a0d0bdeb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:07.790733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:07.855800 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159a0fe-0076-43ee-9681-bd7a0d0bdeb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:07.857876 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159a0fe-0076-43ee-9681-bd7a0d0bdeb8 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:07.880465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 684/1388] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:09.810722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd99c77-bc05-4691-8681-89248fa09faa None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:09.811275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd99c77-bc05-4691-8681-89248fa09faa None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:09.811381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd99c77-bc05-4691-8681-89248fa09faa None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:09.813210 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 705/1389] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:09.818450 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25884c1-4a3a-4e82-98f5-0762e46c68cb None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:09.818868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25884c1-4a3a-4e82-98f5-0762e46c68cb None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:09.819001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25884c1-4a3a-4e82-98f5-0762e46c68cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:09.884885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-a25884c1-4a3a-4e82-98f5-0762e46c68cb None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:09.886122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a25884c1-4a3a-4e82-98f5-0762e46c68cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:09.984152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 685/1390] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:10.295119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd99c77-bc05-4691-8681-89248fa09faa None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:10.296642 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-7fd99c77-bc05-4691-8681-89248fa09faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:10.328480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:10.358865 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39134e98-7974-47c9-aafd-620417602870 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:10.359149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39134e98-7974-47c9-aafd-620417602870 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:10.359981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39134e98-7974-47c9-aafd-620417602870 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:10.361343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 686/1391] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:10.366294 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bd87c-689f-4efb-ba91-0a39d22018d2 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:10.366587 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bd87c-689f-4efb-ba91-0a39d22018d2 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:10.366867 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bd87c-689f-4efb-ba91-0a39d22018d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:10.396714 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:10.452972 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-d65bd87c-689f-4efb-ba91-0a39d22018d2 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:10.454242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d65bd87c-689f-4efb-ba91-0a39d22018d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:10.469442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd99c77-bc05-4691-8681-89248fa09faa None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:10.552037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 687/1392] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:45:10.571678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:10.588886 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df365ae-4101-4530-9d9d-5076f18cd6fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:10.589795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df365ae-4101-4530-9d9d-5076f18cd6fd service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:10.590082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df365ae-4101-4530-9d9d-5076f18cd6fd service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:10.590354 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df365ae-4101-4530-9d9d-5076f18cd6fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:10.591967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4df365ae-4101-4530-9d9d-5076f18cd6fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:10.683290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df365ae-4101-4530-9d9d-5076f18cd6fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:10.684930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df365ae-4101-4530-9d9d-5076f18cd6fd service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:10.702720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 706/1393] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:10.858883 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1676f-6ff3-4a16-8fa6-2002d7aca976 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:10.859491 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1676f-6ff3-4a16-8fa6-2002d7aca976 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:10.859491 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1676f-6ff3-4a16-8fa6-2002d7aca976 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:10.860824 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 688/1394] 10.222.0.76 () {54 vars in 967 bytes} [Fri Aug 26 08:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:10.866378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1a210-3564-49fb-8c56-103e481e865e None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:10.866947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1a210-3564-49fb-8c56-103e481e865e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:10.866947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1a210-3564-49fb-8c56-103e481e865e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:10.944487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-06d1a210-3564-49fb-8c56-103e481e865e None None] MFA Rules not processed for user `9fde38c1a2a844368acd3e1b9aa10151`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:10.945715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-06d1a210-3564-49fb-8c56-103e481e865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:10.998014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:11.022659 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 707/1395] 10.222.0.76 () {58 vars in 1064 bytes} [Fri Aug 26 08:45:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:11.030542 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1676f-6ff3-4a16-8fa6-2002d7aca976 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:11.032688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0ae1676f-6ff3-4a16-8fa6-2002d7aca976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:11.130426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:11.142130 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1676f-6ff3-4a16-8fa6-2002d7aca976 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:11.216878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176abbf6-d037-4c9b-a36f-f864ba646828 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fde38c1a2a844368acd3e1b9aa10151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:11.217549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176abbf6-d037-4c9b-a36f-f864ba646828 service glance] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:11.217826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176abbf6-d037-4c9b-a36f-f864ba646828 service glance] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:11.218095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176abbf6-d037-4c9b-a36f-f864ba646828 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:11.219854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-176abbf6-d037-4c9b-a36f-f864ba646828 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:11.327738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176abbf6-d037-4c9b-a36f-f864ba646828 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:11.329808 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176abbf6-d037-4c9b-a36f-f864ba646828 service glance] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:11.347753 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 689/1396] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:12.074864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad57711-3930-4117-84d6-f284be6a25fe None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:12.075372 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad57711-3930-4117-84d6-f284be6a25fe None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:12.075530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad57711-3930-4117-84d6-f284be6a25fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:12.141319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-2ad57711-3930-4117-84d6-f284be6a25fe None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:12.142534 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-2ad57711-3930-4117-84d6-f284be6a25fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:12.238530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 708/1397] 10.222.0.76 () {58 vars in 1009 bytes} [Fri Aug 26 08:45:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:12.286569 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75da18-dd48-440b-938b-a0b54c5458ef None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:12.287134 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75da18-dd48-440b-938b-a0b54c5458ef None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:12.287512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75da18-dd48-440b-938b-a0b54c5458ef None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:12.288943 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 690/1398] 10.222.0.76 () {54 vars in 943 bytes} [Fri Aug 26 08:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:12.295476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe72022-66e6-47ee-ab61-78cdd088207e None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:12.295800 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe72022-66e6-47ee-ab61-78cdd088207e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:12.296081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe72022-66e6-47ee-ab61-78cdd088207e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:12.374653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-efe72022-66e6-47ee-ab61-78cdd088207e None None] MFA Rules not processed for user `f544d78f417844f68f3bd37863d24885`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:12.375898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-efe72022-66e6-47ee-ab61-78cdd088207e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:12.388620 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:12.486816 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 709/1399] 10.222.0.76 () {58 vars in 1040 bytes} [Fri Aug 26 08:45:12 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:12.496396 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75da18-dd48-440b-938b-a0b54c5458ef None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:12.497943 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ad75da18-dd48-440b-938b-a0b54c5458ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:12.522487 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:12.638342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75da18-dd48-440b-938b-a0b54c5458ef None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:12.677761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75033c01-b581-4504-bd03-01432654a4ef None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:12.678054 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75033c01-b581-4504-bd03-01432654a4ef None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:12.678342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75033c01-b581-4504-bd03-01432654a4ef None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:12.679688 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 710/1400] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:12.684617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6afeda-1eb0-4942-bd9f-23dc147099db None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:12.684908 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6afeda-1eb0-4942-bd9f-23dc147099db None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:12.685222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6afeda-1eb0-4942-bd9f-23dc147099db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:12.743700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901774e-3b83-4f9e-9893-a6923e120b8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:12.744305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901774e-3b83-4f9e-9893-a6923e120b8c service swift] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:12.744588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901774e-3b83-4f9e-9893-a6923e120b8c service swift] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:12.744862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901774e-3b83-4f9e-9893-a6923e120b8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:12.746549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3901774e-3b83-4f9e-9893-a6923e120b8c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:12.751062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-8f6afeda-1eb0-4942-bd9f-23dc147099db None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:12.752256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-8f6afeda-1eb0-4942-bd9f-23dc147099db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:12.754464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:12.827475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:12.836374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901774e-3b83-4f9e-9893-a6923e120b8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:12.838012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901774e-3b83-4f9e-9893-a6923e120b8c service swift] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:12.847477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 691/1401] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 08:45:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 08:45:12.851046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 711/1402] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:45:13.144837 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901774e-3b83-4f9e-9893-a6923e120b8c service swift] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:13.146073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3901774e-3b83-4f9e-9893-a6923e120b8c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:13.252633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901774e-3b83-4f9e-9893-a6923e120b8c service swift] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:13.316001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:13.378228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31eda2-0077-4e00-817d-06bf7cac8c76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:13.379028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31eda2-0077-4e00-817d-06bf7cac8c76 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:13.379414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31eda2-0077-4e00-817d-06bf7cac8c76 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:13.379823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31eda2-0077-4e00-817d-06bf7cac8c76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:13.381499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1e31eda2-0077-4e00-817d-06bf7cac8c76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:13.481375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31eda2-0077-4e00-817d-06bf7cac8c76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:13.482892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31eda2-0077-4e00-817d-06bf7cac8c76 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:13.502281 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 692/1403] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:15.480430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3930a75-a418-4d83-ad03-2b25de4d2777 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:15.481128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3930a75-a418-4d83-ad03-2b25de4d2777 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:15.481128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3930a75-a418-4d83-ad03-2b25de4d2777 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:15.482504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 712/1404] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:15.488182 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941f20b-a90d-49cb-99e1-7a6566622d58 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:15.488640 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941f20b-a90d-49cb-99e1-7a6566622d58 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:15.488752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941f20b-a90d-49cb-99e1-7a6566622d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:15.560127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-8941f20b-a90d-49cb-99e1-7a6566622d58 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:15.562951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-8941f20b-a90d-49cb-99e1-7a6566622d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:15.578301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:15.674740 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 693/1405] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:15.968355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3930a75-a418-4d83-ad03-2b25de4d2777 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:15.970463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c3930a75-a418-4d83-ad03-2b25de4d2777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:16.179291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3930a75-a418-4d83-ad03-2b25de4d2777 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:16.259108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:16.328522 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2e9f0-752d-4000-abb5-7723bde99246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:16.329203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2e9f0-752d-4000-abb5-7723bde99246 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:16.329496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2e9f0-752d-4000-abb5-7723bde99246 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:16.329768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2e9f0-752d-4000-abb5-7723bde99246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:16.331408 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ebf2e9f0-752d-4000-abb5-7723bde99246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:16.440290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2e9f0-752d-4000-abb5-7723bde99246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:16.441937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2e9f0-752d-4000-abb5-7723bde99246 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:16.466224 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 713/1406] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:18.443823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ed3ce-a96d-4dd5-a967-70b0ee78434b None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:18.444420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ed3ce-a96d-4dd5-a967-70b0ee78434b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:18.444420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ed3ce-a96d-4dd5-a967-70b0ee78434b None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:18.445727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 694/1407] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:18.451036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5b754-1563-44fc-aa07-dbd17f8d3ea1 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:18.455417 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5b754-1563-44fc-aa07-dbd17f8d3ea1 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:18.455417 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5b754-1563-44fc-aa07-dbd17f8d3ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:18.525290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-21a5b754-1563-44fc-aa07-dbd17f8d3ea1 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:18.526536 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-21a5b754-1563-44fc-aa07-dbd17f8d3ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:18.546421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:18.641506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 714/1408] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:18.935279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ed3ce-a96d-4dd5-a967-70b0ee78434b None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:18.937737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-308ed3ce-a96d-4dd5-a967-70b0ee78434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:19.095755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:19.098661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ed3ce-a96d-4dd5-a967-70b0ee78434b None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:19.229621 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32db9f-a006-4cad-9a09-5e17dc22dd4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:19.230236 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32db9f-a006-4cad-9a09-5e17dc22dd4c service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:19.230519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32db9f-a006-4cad-9a09-5e17dc22dd4c service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:19.230791 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32db9f-a006-4cad-9a09-5e17dc22dd4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:19.232559 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7d32db9f-a006-4cad-9a09-5e17dc22dd4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:19.328349 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32db9f-a006-4cad-9a09-5e17dc22dd4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:19.330006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32db9f-a006-4cad-9a09-5e17dc22dd4c service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:19.349065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 695/1409] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:28.636187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=35 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:29.346884 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:35.039513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d63c5-4a82-4598-b679-7ffaaa2fbbde None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:35.040073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d63c5-4a82-4598-b679-7ffaaa2fbbde None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:35.040243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d63c5-4a82-4598-b679-7ffaaa2fbbde None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:35.041636 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 715/1410] 10.222.0.76 () {54 vars in 918 bytes} [Fri Aug 26 08:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:35.047074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafa73d-7062-4e01-a50d-f288bd55dabe None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:35.047496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafa73d-7062-4e01-a50d-f288bd55dabe None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:35.047624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafa73d-7062-4e01-a50d-f288bd55dabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:35.123000 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-3cafa73d-7062-4e01-a50d-f288bd55dabe None None] MFA Rules not processed for user `95abbd88e549427abbf5699efed0451a`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:35.124230 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3cafa73d-7062-4e01-a50d-f288bd55dabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:35.228813 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 696/1411] 10.222.0.76 () {58 vars in 1015 bytes} [Fri Aug 26 08:45:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:35.243691 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb5f1d-2272-4c0e-b55e-b1670c50bc9d None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:35.243984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb5f1d-2272-4c0e-b55e-b1670c50bc9d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:35.244262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb5f1d-2272-4c0e-b55e-b1670c50bc9d None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:35.245657 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 716/1412] 10.222.0.76 () {54 vars in 918 bytes} [Fri Aug 26 08:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:35.250267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db25e54-1416-4d3d-9f28-b42781452fac None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:35.250556 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db25e54-1416-4d3d-9f28-b42781452fac None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:35.250833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db25e54-1416-4d3d-9f28-b42781452fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:35.321869 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:35.324460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-8db25e54-1416-4d3d-9f28-b42781452fac None None] MFA Rules not processed for user `b63d6e588f6e4b598b75a2ec13bea25d`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:35.326235 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-8db25e54-1416-4d3d-9f28-b42781452fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:35.442310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 697/1413] 10.222.0.76 () {58 vars in 1015 bytes} [Fri Aug 26 08:45:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:37.809576 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3474b-1bb0-4902-82ca-4ae1456578ca None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:37.810111 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3474b-1bb0-4902-82ca-4ae1456578ca None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:37.810111 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3474b-1bb0-4902-82ca-4ae1456578ca None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:37.812218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 08:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:37.817269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96914a2-5f1c-412a-9b09-38b9a1ab7d53 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:37.817709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96914a2-5f1c-412a-9b09-38b9a1ab7d53 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:37.817815 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96914a2-5f1c-412a-9b09-38b9a1ab7d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:37.883248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-a96914a2-5f1c-412a-9b09-38b9a1ab7d53 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:37.884455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a96914a2-5f1c-412a-9b09-38b9a1ab7d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:37.937875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:37.979029 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 08:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:38.265496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3474b-1bb0-4902-82ca-4ae1456578ca None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:38.267055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-96b3474b-1bb0-4902-82ca-4ae1456578ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:38.409803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3474b-1bb0-4902-82ca-4ae1456578ca None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:38.482183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:38.522084 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d544d2-603a-4c57-9f53-b3dff0e527a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:38.522776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d544d2-603a-4c57-9f53-b3dff0e527a9 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:38.523266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d544d2-603a-4c57-9f53-b3dff0e527a9 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:38.523750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d544d2-603a-4c57-9f53-b3dff0e527a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:38.526917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-53d544d2-603a-4c57-9f53-b3dff0e527a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:38.619850 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d544d2-603a-4c57-9f53-b3dff0e527a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:38.621479 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d544d2-603a-4c57-9f53-b3dff0e527a9 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:38.638933 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 718/1416] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:45:39.520084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3bd4b-f79f-409b-8cba-592a1f1ec092 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:39.520634 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3bd4b-f79f-409b-8cba-592a1f1ec092 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:39.520634 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3bd4b-f79f-409b-8cba-592a1f1ec092 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:39.521988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 08:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:39.526807 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c75895-b280-48d4-98b7-dc7d231daefe None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:39.527209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c75895-b280-48d4-98b7-dc7d231daefe None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:39.527397 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c75895-b280-48d4-98b7-dc7d231daefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:39.602513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-78c75895-b280-48d4-98b7-dc7d231daefe None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:39.603739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-78c75895-b280-48d4-98b7-dc7d231daefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:39.630328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:39.698424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 08:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:39.849083 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3bd4b-f79f-409b-8cba-592a1f1ec092 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:39.850601 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-82a3bd4b-f79f-409b-8cba-592a1f1ec092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:39.993707 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3bd4b-f79f-409b-8cba-592a1f1ec092 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:40.034021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:40.106516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10725b2d-46ef-444c-a895-da76d0a17c6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:40.107040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10725b2d-46ef-444c-a895-da76d0a17c6d service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:40.107320 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10725b2d-46ef-444c-a895-da76d0a17c6d service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:40.107590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10725b2d-46ef-444c-a895-da76d0a17c6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:40.109273 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-10725b2d-46ef-444c-a895-da76d0a17c6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:40.197363 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10725b2d-46ef-444c-a895-da76d0a17c6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:40.198954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10725b2d-46ef-444c-a895-da76d0a17c6d service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:40.217434 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 700/1419] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:41.099874 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5c133-ac78-4acf-86b3-748a891f3d27 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:41.100445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5c133-ac78-4acf-86b3-748a891f3d27 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:41.100445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5c133-ac78-4acf-86b3-748a891f3d27 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:41.101802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 08:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:41.106690 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a606eb-d1be-4f72-90e6-c6ab4815cb3a None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:41.107093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a606eb-d1be-4f72-90e6-c6ab4815cb3a None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:41.107235 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a606eb-d1be-4f72-90e6-c6ab4815cb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:41.161733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:41.184350 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-f0a606eb-d1be-4f72-90e6-c6ab4815cb3a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:41.185604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-f0a606eb-d1be-4f72-90e6-c6ab4815cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:41.281524 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 08:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:41.436178 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5c133-ac78-4acf-86b3-748a891f3d27 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:41.437657 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f0b5c133-ac78-4acf-86b3-748a891f3d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:41.579822 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5c133-ac78-4acf-86b3-748a891f3d27 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:41.592419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:41.691638 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73696247-100b-49a2-b151-cb09f214aa68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:41.692161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73696247-100b-49a2-b151-cb09f214aa68 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:41.692440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73696247-100b-49a2-b151-cb09f214aa68 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:41.692711 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73696247-100b-49a2-b151-cb09f214aa68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:41.694327 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-73696247-100b-49a2-b151-cb09f214aa68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:41.784335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73696247-100b-49a2-b151-cb09f214aa68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:41.785958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73696247-100b-49a2-b151-cb09f214aa68 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:41.803532 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 721/1422] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:42.661939 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a586af-a6ac-40e4-8a05-18cf54717116 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:42.662510 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a586af-a6ac-40e4-8a05-18cf54717116 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:42.662510 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a586af-a6ac-40e4-8a05-18cf54717116 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:42.663843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 08:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:42.668815 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca94d7-8e4d-46f8-9329-c5f91d90b68f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:42.669264 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca94d7-8e4d-46f8-9329-c5f91d90b68f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:42.669404 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca94d7-8e4d-46f8-9329-c5f91d90b68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:42.689416 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:42.745219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-39ca94d7-8e4d-46f8-9329-c5f91d90b68f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:42.746444 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-39ca94d7-8e4d-46f8-9329-c5f91d90b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:42.841157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 08:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:42.993721 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a586af-a6ac-40e4-8a05-18cf54717116 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:42.995246 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-16a586af-a6ac-40e4-8a05-18cf54717116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:43.104472 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:43.139980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a586af-a6ac-40e4-8a05-18cf54717116 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:43.249588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103f52a-2faa-4960-a346-f36ff3b31688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:43.250186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103f52a-2faa-4960-a346-f36ff3b31688 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:43.250464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103f52a-2faa-4960-a346-f36ff3b31688 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:43.250732 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103f52a-2faa-4960-a346-f36ff3b31688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:43.252312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5103f52a-2faa-4960-a346-f36ff3b31688 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:43.326608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:43.341064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103f52a-2faa-4960-a346-f36ff3b31688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:43.342659 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103f52a-2faa-4960-a346-f36ff3b31688 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:43.360317 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 703/1425] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:44.216056 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb052f-eaee-4646-9884-acf9f3f56018 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:44.216632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb052f-eaee-4646-9884-acf9f3f56018 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:44.216632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb052f-eaee-4646-9884-acf9f3f56018 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:44.218034 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 08:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:44.222922 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dcf08-17ee-4cf9-b91d-f331653e399d None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:44.223347 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dcf08-17ee-4cf9-b91d-f331653e399d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:44.223476 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dcf08-17ee-4cf9-b91d-f331653e399d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:44.299444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-262dcf08-17ee-4cf9-b91d-f331653e399d None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:44.300656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-262dcf08-17ee-4cf9-b91d-f331653e399d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:44.396722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 08:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:44.547925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb052f-eaee-4646-9884-acf9f3f56018 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:44.549430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-eedb052f-eaee-4646-9884-acf9f3f56018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:44.640347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:44.701956 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb052f-eaee-4646-9884-acf9f3f56018 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:44.812978 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7769a4-75b8-49d6-acc4-a8c84fb44fbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:44.813554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7769a4-75b8-49d6-acc4-a8c84fb44fbe service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:44.813833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7769a4-75b8-49d6-acc4-a8c84fb44fbe service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:44.814103 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7769a4-75b8-49d6-acc4-a8c84fb44fbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:44.815685 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ba7769a4-75b8-49d6-acc4-a8c84fb44fbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:44.863037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:44.904261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7769a4-75b8-49d6-acc4-a8c84fb44fbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:44.906373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7769a4-75b8-49d6-acc4-a8c84fb44fbe service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:44.924213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 724/1428] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:45.735910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5a518-924f-4659-9970-b9438acb1abd None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:45.736547 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5a518-924f-4659-9970-b9438acb1abd None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:45.736547 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5a518-924f-4659-9970-b9438acb1abd None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:45.737821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 08:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:45.742810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3567a-e046-47f8-8d37-d1d4235192e6 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:45.743269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3567a-e046-47f8-8d37-d1d4235192e6 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:45.743385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3567a-e046-47f8-8d37-d1d4235192e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:45.816477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-08f3567a-e046-47f8-8d37-d1d4235192e6 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:45.817708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-08f3567a-e046-47f8-8d37-d1d4235192e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:45.910481 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 08:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:46.061945 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5a518-924f-4659-9970-b9438acb1abd None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:46.063499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-9bd5a518-924f-4659-9970-b9438acb1abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:46.111910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:46.209939 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5a518-924f-4659-9970-b9438acb1abd None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:46.320170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d293b-5007-4cc4-90e5-1fd146ea2284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:46.320771 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d293b-5007-4cc4-90e5-1fd146ea2284 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:46.321082 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d293b-5007-4cc4-90e5-1fd146ea2284 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:46.321354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d293b-5007-4cc4-90e5-1fd146ea2284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:46.322953 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b53d293b-5007-4cc4-90e5-1fd146ea2284 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:46.330507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:46.416353 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d293b-5007-4cc4-90e5-1fd146ea2284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:46.417975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d293b-5007-4cc4-90e5-1fd146ea2284 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:46.435297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 706/1431] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:47.243922 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb3148-57a5-468d-aa7a-9355a5df1552 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:47.244506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb3148-57a5-468d-aa7a-9355a5df1552 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:47.244506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb3148-57a5-468d-aa7a-9355a5df1552 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:47.245869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 08:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:47.250763 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3282ce3-655f-407a-921e-a0e2f19d063b None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:47.251198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3282ce3-655f-407a-921e-a0e2f19d063b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:47.251315 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3282ce3-655f-407a-921e-a0e2f19d063b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:47.325372 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-e3282ce3-655f-407a-921e-a0e2f19d063b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:47.326605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-e3282ce3-655f-407a-921e-a0e2f19d063b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:47.392951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:47.425888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 08:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:47.582435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb3148-57a5-468d-aa7a-9355a5df1552 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:47.584341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0cfb3148-57a5-468d-aa7a-9355a5df1552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:47.602509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:47.733763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb3148-57a5-468d-aa7a-9355a5df1552 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:47.819086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:47.845169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5607a81-110b-4b9f-b174-91fd82ac8c94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:47.845777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5607a81-110b-4b9f-b174-91fd82ac8c94 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:47.846057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5607a81-110b-4b9f-b174-91fd82ac8c94 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:47.846328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5607a81-110b-4b9f-b174-91fd82ac8c94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:47.847917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e5607a81-110b-4b9f-b174-91fd82ac8c94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:47.936803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5607a81-110b-4b9f-b174-91fd82ac8c94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:47.938436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5607a81-110b-4b9f-b174-91fd82ac8c94 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:47.956728 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 727/1434] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:48.755827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c329ee-c38e-43d7-b87c-49b7ddb23654 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:48.756400 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c329ee-c38e-43d7-b87c-49b7ddb23654 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:48.756400 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c329ee-c38e-43d7-b87c-49b7ddb23654 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:48.757853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 08:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:48.762703 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14670e19-2c90-476e-a268-055c670eee5a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:48.763119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14670e19-2c90-476e-a268-055c670eee5a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:48.763288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14670e19-2c90-476e-a268-055c670eee5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:48.955029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-14670e19-2c90-476e-a268-055c670eee5a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:48.956250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-14670e19-2c90-476e-a268-055c670eee5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:48.997795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:49.056804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 08:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:45:49.205017 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c329ee-c38e-43d7-b87c-49b7ddb23654 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:49.206584 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-41c329ee-c38e-43d7-b87c-49b7ddb23654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:49.350662 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c329ee-c38e-43d7-b87c-49b7ddb23654 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:49.402661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:49.461299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81defca-d05f-41ed-b9b0-d45f230327e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:49.461837 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81defca-d05f-41ed-b9b0-d45f230327e5 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:49.462114 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81defca-d05f-41ed-b9b0-d45f230327e5 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:49.462380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81defca-d05f-41ed-b9b0-d45f230327e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:49.463950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a81defca-d05f-41ed-b9b0-d45f230327e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:49.552978 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81defca-d05f-41ed-b9b0-d45f230327e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:49.554578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81defca-d05f-41ed-b9b0-d45f230327e5 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:49.571826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 709/1437] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:50.368858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee44be3-7202-4a6a-80c4-215d9b8fbdbe None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:50.369439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee44be3-7202-4a6a-80c4-215d9b8fbdbe None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:50.369439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee44be3-7202-4a6a-80c4-215d9b8fbdbe None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:50.370790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 08:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:50.376203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53acef-be99-4381-85f9-6aecdf76768a None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:50.376638 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53acef-be99-4381-85f9-6aecdf76768a None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:50.376755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53acef-be99-4381-85f9-6aecdf76768a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:50.452245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-3b53acef-be99-4381-85f9-6aecdf76768a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:50.453503 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3b53acef-be99-4381-85f9-6aecdf76768a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:50.455516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:50.548713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 08:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:45:50.700939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee44be3-7202-4a6a-80c4-215d9b8fbdbe None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:50.702434 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-8ee44be3-7202-4a6a-80c4-215d9b8fbdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:50.845719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee44be3-7202-4a6a-80c4-215d9b8fbdbe None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:50.871921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:50.957062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddb747-3021-4f6b-a19d-15e7158cd0e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:50.957608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb747-3021-4f6b-a19d-15e7158cd0e5 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:50.957890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb747-3021-4f6b-a19d-15e7158cd0e5 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:50.958165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb747-3021-4f6b-a19d-15e7158cd0e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:50.959794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-8dddb747-3021-4f6b-a19d-15e7158cd0e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:51.050976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddb747-3021-4f6b-a19d-15e7158cd0e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:51.052574 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddb747-3021-4f6b-a19d-15e7158cd0e5 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:51.070113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 730/1440] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:52.896473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380251c8-b05f-4ba1-addb-fe69ecd490b5 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:52.897084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380251c8-b05f-4ba1-addb-fe69ecd490b5 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:52.897084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380251c8-b05f-4ba1-addb-fe69ecd490b5 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:52.898382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 08:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:52.903660 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528345b-9b50-4805-934d-eeef6d1d6720 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:52.904136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528345b-9b50-4805-934d-eeef6d1d6720 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:52.904248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528345b-9b50-4805-934d-eeef6d1d6720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:52.944291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:52.970836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-3528345b-9b50-4805-934d-eeef6d1d6720 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:52.972041 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-3528345b-9b50-4805-934d-eeef6d1d6720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:53.069109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 08:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:53.358138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380251c8-b05f-4ba1-addb-fe69ecd490b5 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:53.359711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-380251c8-b05f-4ba1-addb-fe69ecd490b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:53.461593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380251c8-b05f-4ba1-addb-fe69ecd490b5 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:53.493205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:53.533460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b144af-dd3a-447f-826e-5bd5deef4ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:53.534077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b144af-dd3a-447f-826e-5bd5deef4ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:53.534344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b144af-dd3a-447f-826e-5bd5deef4ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:53.534620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b144af-dd3a-447f-826e-5bd5deef4ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:53.536214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d5b144af-dd3a-447f-826e-5bd5deef4ec7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:53.644338 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b144af-dd3a-447f-826e-5bd5deef4ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:53.645733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b144af-dd3a-447f-826e-5bd5deef4ec7 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:53.664951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 712/1443] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:55.708032 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf50f36-12b4-4db4-a542-db3a5f387edc None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:55.708621 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf50f36-12b4-4db4-a542-db3a5f387edc None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:55.708621 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf50f36-12b4-4db4-a542-db3a5f387edc None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:55.709983 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 08:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:55.715361 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f2899-b8b2-45fb-aa5f-b77eddcde94f None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:55.715769 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f2899-b8b2-45fb-aa5f-b77eddcde94f None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:55.715904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f2899-b8b2-45fb-aa5f-b77eddcde94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:55.780853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-e19f2899-b8b2-45fb-aa5f-b77eddcde94f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:55.782091 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-e19f2899-b8b2-45fb-aa5f-b77eddcde94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:55.794643 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:55.876984 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 08:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:56.160827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf50f36-12b4-4db4-a542-db3a5f387edc None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:56.162404 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-fdf50f36-12b4-4db4-a542-db3a5f387edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:56.264867 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf50f36-12b4-4db4-a542-db3a5f387edc None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:56.277125 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:56.337821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c17e0-bcc4-4fad-91a9-f4feaa641ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:56.338425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c17e0-bcc4-4fad-91a9-f4feaa641ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:56.338710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c17e0-bcc4-4fad-91a9-f4feaa641ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:56.338985 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c17e0-bcc4-4fad-91a9-f4feaa641ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:56.340846 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-876c17e0-bcc4-4fad-91a9-f4feaa641ff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:56.447505 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c17e0-bcc4-4fad-91a9-f4feaa641ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:56.448872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c17e0-bcc4-4fad-91a9-f4feaa641ff8 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:56.468744 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 733/1446] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:58.670573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5873-c770-4818-a2d6-d1c0c7d03209 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:58.671141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5873-c770-4818-a2d6-d1c0c7d03209 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:58.671141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5873-c770-4818-a2d6-d1c0c7d03209 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:58.672987 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 08:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:45:58.678357 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c153a2f-915f-42bb-9aba-9bc09aed1a53 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:58.678789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c153a2f-915f-42bb-9aba-9bc09aed1a53 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:58.678903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c153a2f-915f-42bb-9aba-9bc09aed1a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:58.726769 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:58.745425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0c153a2f-915f-42bb-9aba-9bc09aed1a53 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:45:58.746629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0c153a2f-915f-42bb-9aba-9bc09aed1a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:58.849273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 08:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:45:59.131032 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a5873-c770-4818-a2d6-d1c0c7d03209 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:45:59.132588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-4a1a5873-c770-4818-a2d6-d1c0c7d03209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:59.233517 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a5873-c770-4818-a2d6-d1c0c7d03209 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:45:59.273342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:45:59.306807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517626aa-5d01-4df4-9b44-1443b51d8cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:45:59.307411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517626aa-5d01-4df4-9b44-1443b51d8cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:45:59.307695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517626aa-5d01-4df4-9b44-1443b51d8cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:45:59.307972 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517626aa-5d01-4df4-9b44-1443b51d8cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:45:59.309615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-517626aa-5d01-4df4-9b44-1443b51d8cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:45:59.417115 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517626aa-5d01-4df4-9b44-1443b51d8cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:45:59.418480 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517626aa-5d01-4df4-9b44-1443b51d8cb2 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:45:59.435878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 715/1449] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:46:01.444381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b155cc4-6e14-40bd-baee-403da949a2b7 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:01.444925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b155cc4-6e14-40bd-baee-403da949a2b7 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:01.444925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b155cc4-6e14-40bd-baee-403da949a2b7 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:01.446298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 08:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:46:01.451716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697a9a3-8295-4ddd-8190-1e77c4c4b6e9 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:01.452150 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697a9a3-8295-4ddd-8190-1e77c4c4b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:01.452258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697a9a3-8295-4ddd-8190-1e77c4c4b6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:01.519576 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-4697a9a3-8295-4ddd-8190-1e77c4c4b6e9 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:46:01.520741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-4697a9a3-8295-4ddd-8190-1e77c4c4b6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:01.540663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:01.617229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 08:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:46:01.904065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b155cc4-6e14-40bd-baee-403da949a2b7 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:46:01.905628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6b155cc4-6e14-40bd-baee-403da949a2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:02.008349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b155cc4-6e14-40bd-baee-403da949a2b7 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:46:02.028551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:02.082884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bb733-d3ff-4707-8a9b-725612c5da57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:46:02.083488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bb733-d3ff-4707-8a9b-725612c5da57 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:02.083772 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bb733-d3ff-4707-8a9b-725612c5da57 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:02.084046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bb733-d3ff-4707-8a9b-725612c5da57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:02.085671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-980bb733-d3ff-4707-8a9b-725612c5da57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:02.192137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bb733-d3ff-4707-8a9b-725612c5da57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:46:02.193534 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bb733-d3ff-4707-8a9b-725612c5da57 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:46:02.211597 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 736/1452] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:46:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:46:04.174764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72ac7c-890c-4f44-8f54-338479c9c125 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:04.182289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72ac7c-890c-4f44-8f54-338479c9c125 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:04.182289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72ac7c-890c-4f44-8f54-338479c9c125 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:04.182289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 08:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:46:04.183567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f246f3-ae62-4712-8e31-7f7a3375f9bd None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:04.184012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f246f3-ae62-4712-8e31-7f7a3375f9bd None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:04.184112 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f246f3-ae62-4712-8e31-7f7a3375f9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:04.249061 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:04.251928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-d3f246f3-ae62-4712-8e31-7f7a3375f9bd None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:46:04.253788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d3f246f3-ae62-4712-8e31-7f7a3375f9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:04.349378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 08:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:46:04.634043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72ac7c-890c-4f44-8f54-338479c9c125 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:46:04.635641 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-2e72ac7c-890c-4f44-8f54-338479c9c125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:04.737263 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72ac7c-890c-4f44-8f54-338479c9c125 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:46:04.785572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:04.809929 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19e3ec-f256-4ca0-9cf1-c9aa356b2cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:46:04.810539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19e3ec-f256-4ca0-9cf1-c9aa356b2cdf service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:04.810821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19e3ec-f256-4ca0-9cf1-c9aa356b2cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:04.811096 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19e3ec-f256-4ca0-9cf1-c9aa356b2cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:04.813252 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-4c19e3ec-f256-4ca0-9cf1-c9aa356b2cdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:04.921209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19e3ec-f256-4ca0-9cf1-c9aa356b2cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:46:04.922642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19e3ec-f256-4ca0-9cf1-c9aa356b2cdf service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:46:04.940747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 718/1455] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:46:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:46:06.884542 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2edb2-6b10-4987-acb6-fcc3c9f82a15 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:06.885102 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2edb2-6b10-4987-acb6-fcc3c9f82a15 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:06.885568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2edb2-6b10-4987-acb6-fcc3c9f82a15 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:06.888068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 08:46:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:46:06.893992 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce12ac-ef74-40ae-9bc8-b8d0375e6e9d None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:06.894466 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce12ac-ef74-40ae-9bc8-b8d0375e6e9d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:06.894576 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce12ac-ef74-40ae-9bc8-b8d0375e6e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:06.959332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-65ce12ac-ef74-40ae-9bc8-b8d0375e6e9d None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:46:06.960522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-65ce12ac-ef74-40ae-9bc8-b8d0375e6e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:06.988510 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:07.057814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 08:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:46:07.345598 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2edb2-6b10-4987-acb6-fcc3c9f82a15 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:46:07.347121 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-8dd2edb2-6b10-4987-acb6-fcc3c9f82a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:07.449497 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2edb2-6b10-4987-acb6-fcc3c9f82a15 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:46:07.477205 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:07.522055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1daed7-9704-4cd5-b1f5-ac5f850a7921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:46:07.522655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1daed7-9704-4cd5-b1f5-ac5f850a7921 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:07.522938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1daed7-9704-4cd5-b1f5-ac5f850a7921 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:07.523214 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1daed7-9704-4cd5-b1f5-ac5f850a7921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:07.524802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ff1daed7-9704-4cd5-b1f5-ac5f850a7921 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:07.632690 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1daed7-9704-4cd5-b1f5-ac5f850a7921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:46:07.634151 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1daed7-9704-4cd5-b1f5-ac5f850a7921 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:46:07.651507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 739/1458] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:46:09.710905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03e960-a094-4242-a777-2480168bb2e4 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:09.711485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03e960-a094-4242-a777-2480168bb2e4 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:09.711485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03e960-a094-4242-a777-2480168bb2e4 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:09.712816 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 08:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:46:09.719141 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c0ef5-912f-4463-be1e-f3afafdd29cb None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:09.719589 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c0ef5-912f-4463-be1e-f3afafdd29cb None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:09.719695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c0ef5-912f-4463-be1e-f3afafdd29cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:09.785476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-b58c0ef5-912f-4463-be1e-f3afafdd29cb None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:46:09.786717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b58c0ef5-912f-4463-be1e-f3afafdd29cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:09.794948 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:09.883050 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 08:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:46:10.162999 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03e960-a094-4242-a777-2480168bb2e4 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:46:10.164551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7d03e960-a094-4242-a777-2480168bb2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:10.266584 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03e960-a094-4242-a777-2480168bb2e4 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:46:10.320708 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:10.339743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b10aa5-42bb-4cd2-97cf-027a1cc52ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:46:10.340348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b10aa5-42bb-4cd2-97cf-027a1cc52ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:10.340630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b10aa5-42bb-4cd2-97cf-027a1cc52ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:10.340904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b10aa5-42bb-4cd2-97cf-027a1cc52ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:10.342536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-78b10aa5-42bb-4cd2-97cf-027a1cc52ec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:10.450126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b10aa5-42bb-4cd2-97cf-027a1cc52ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:46:10.451487 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b10aa5-42bb-4cd2-97cf-027a1cc52ec9 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:46:10.469404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 721/1461] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:46:12.411431 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5588bd-e26e-4de9-b5b0-dcb5d6300bc4 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:12.412019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5588bd-e26e-4de9-b5b0-dcb5d6300bc4 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:12.412019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5588bd-e26e-4de9-b5b0-dcb5d6300bc4 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:12.413348 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 08:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:46:12.418756 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44050c3-a5e5-4c15-aee8-86cbea24e106 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:12.419189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44050c3-a5e5-4c15-aee8-86cbea24e106 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:12.419323 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44050c3-a5e5-4c15-aee8-86cbea24e106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:12.484606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-e44050c3-a5e5-4c15-aee8-86cbea24e106 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:46:12.485846 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-e44050c3-a5e5-4c15-aee8-86cbea24e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:12.523629 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:12.582690 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 08:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:46:12.867288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5588bd-e26e-4de9-b5b0-dcb5d6300bc4 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:46:12.868868 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6f5588bd-e26e-4de9-b5b0-dcb5d6300bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:12.972651 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5588bd-e26e-4de9-b5b0-dcb5d6300bc4 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:46:13.009743 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:13.045857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c768656-d0cc-4dc4-a90c-595305c54001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:46:13.046490 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c768656-d0cc-4dc4-a90c-595305c54001 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:13.046773 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c768656-d0cc-4dc4-a90c-595305c54001 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:13.047049 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c768656-d0cc-4dc4-a90c-595305c54001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:13.048639 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9c768656-d0cc-4dc4-a90c-595305c54001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:13.155895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c768656-d0cc-4dc4-a90c-595305c54001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:46:13.157390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c768656-d0cc-4dc4-a90c-595305c54001 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:46:13.175106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 742/1464] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:46:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:46:15.086071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2f139-e35a-49aa-b860-e7b81ad32ffa None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:15.086640 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2f139-e35a-49aa-b860-e7b81ad32ffa None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:15.086640 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2f139-e35a-49aa-b860-e7b81ad32ffa None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:15.087955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 08:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:46:15.093592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cb3e2-481b-4852-a0c8-e72b6af8baf1 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:15.094001 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cb3e2-481b-4852-a0c8-e72b6af8baf1 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:15.094160 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cb3e2-481b-4852-a0c8-e72b6af8baf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:15.159234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-5b9cb3e2-481b-4852-a0c8-e72b6af8baf1 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:46:15.160441 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-5b9cb3e2-481b-4852-a0c8-e72b6af8baf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:15.178505 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:15.257145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 08:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:46:15.547127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2f139-e35a-49aa-b860-e7b81ad32ffa None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:46:15.548658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-08c2f139-e35a-49aa-b860-e7b81ad32ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:15.653255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2f139-e35a-49aa-b860-e7b81ad32ffa None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:46:15.721034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:15.728107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a440a5f-5a67-42c5-8845-dcd9266bc938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:46:15.728715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a440a5f-5a67-42c5-8845-dcd9266bc938 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:15.729017 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a440a5f-5a67-42c5-8845-dcd9266bc938 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:15.729299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a440a5f-5a67-42c5-8845-dcd9266bc938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:15.730909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1a440a5f-5a67-42c5-8845-dcd9266bc938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:15.837724 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a440a5f-5a67-42c5-8845-dcd9266bc938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:46:15.839066 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a440a5f-5a67-42c5-8845-dcd9266bc938 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:46:15.857211 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 724/1467] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:46:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:46:17.758078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d81aed-a96f-4c10-b770-bb4a8421d4f3 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:17.758679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d81aed-a96f-4c10-b770-bb4a8421d4f3 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:17.758679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d81aed-a96f-4c10-b770-bb4a8421d4f3 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:17.759979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 08:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:46:17.766153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c3e7b-2a50-4dbd-960d-42fda49ca88d None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:17.766617 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c3e7b-2a50-4dbd-960d-42fda49ca88d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:17.766724 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c3e7b-2a50-4dbd-960d-42fda49ca88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:17.836715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-237c3e7b-2a50-4dbd-960d-42fda49ca88d None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:46:17.837899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-237c3e7b-2a50-4dbd-960d-42fda49ca88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:17.885951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:17.934180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 08:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:46:18.216823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d81aed-a96f-4c10-b770-bb4a8421d4f3 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:46:18.218928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-43d81aed-a96f-4c10-b770-bb4a8421d4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:18.321978 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d81aed-a96f-4c10-b770-bb4a8421d4f3 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:46:18.369182 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:18.394877 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0bff5-b63e-4983-ab58-3f057b3deaf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:46:18.395475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0bff5-b63e-4983-ab58-3f057b3deaf3 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:18.395760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0bff5-b63e-4983-ab58-3f057b3deaf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:18.396033 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0bff5-b63e-4983-ab58-3f057b3deaf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:18.397646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-09d0bff5-b63e-4983-ab58-3f057b3deaf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:18.503760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0bff5-b63e-4983-ab58-3f057b3deaf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:46:18.505134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0bff5-b63e-4983-ab58-3f057b3deaf3 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:46:18.522487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 745/1470] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:46:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:46:27.932325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=22 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:28.520328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=66 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:38.102891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52759ce3-6df9-4008-b52a-620e27f3410b None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:38.103464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52759ce3-6df9-4008-b52a-620e27f3410b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:38.103464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52759ce3-6df9-4008-b52a-620e27f3410b None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:38.104792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 726/1471] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:46:38.110707 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba895f09-a360-49d4-b04c-6eb6f3e366d5 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:38.111124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba895f09-a360-49d4-b04c-6eb6f3e366d5 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:38.111307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba895f09-a360-49d4-b04c-6eb6f3e366d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:38.176788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-ba895f09-a360-49d4-b04c-6eb6f3e366d5 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:46:38.178027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ba895f09-a360-49d4-b04c-6eb6f3e366d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:38.273594 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 746/1472] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:46:38.572229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a1f51-9779-402f-af68-983bec24d8ab None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:38.572518 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a1f51-9779-402f-af68-983bec24d8ab None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:38.572788 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a1f51-9779-402f-af68-983bec24d8ab None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:38.574196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 727/1473] 10.222.0.76 () {54 vars in 967 bytes} [Fri Aug 26 08:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:46:38.579253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfcaed-6477-4517-855e-1182fe48d2a5 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:38.579618 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfcaed-6477-4517-855e-1182fe48d2a5 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:38.579904 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfcaed-6477-4517-855e-1182fe48d2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:38.657308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-2abfcaed-6477-4517-855e-1182fe48d2a5 None None] MFA Rules not processed for user `9fde38c1a2a844368acd3e1b9aa10151`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:46:38.658844 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-2abfcaed-6477-4517-855e-1182fe48d2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:38.680285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:38.739712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 747/1474] 10.222.0.76 () {58 vars in 1064 bytes} [Fri Aug 26 08:46:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:46:38.747198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a1f51-9779-402f-af68-983bec24d8ab None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:46:38.748702 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7b8a1f51-9779-402f-af68-983bec24d8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:38.851444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a1f51-9779-402f-af68-983bec24d8ab None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:46:38.924513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5982a8-bfe4-48d0-8687-93aa9a5ac3e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fde38c1a2a844368acd3e1b9aa10151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:46:38.925138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5982a8-bfe4-48d0-8687-93aa9a5ac3e4 service glance] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:38.925416 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5982a8-bfe4-48d0-8687-93aa9a5ac3e4 service glance] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:38.925683 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5982a8-bfe4-48d0-8687-93aa9a5ac3e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:38.927266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ba5982a8-bfe4-48d0-8687-93aa9a5ac3e4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:38.981146 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:39.035642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5982a8-bfe4-48d0-8687-93aa9a5ac3e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:46:39.037097 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5982a8-bfe4-48d0-8687-93aa9a5ac3e4 service glance] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:46:39.056115 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 728/1475] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:46:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:46:41.082389 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4180de0-61be-4455-9598-409b725811ab None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:41.082984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4180de0-61be-4455-9598-409b725811ab None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:41.082984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4180de0-61be-4455-9598-409b725811ab None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:41.084317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 748/1476] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:46:41.089688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a776bc-72b3-4f4a-832b-72a3f3b58466 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:41.090371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a776bc-72b3-4f4a-832b-72a3f3b58466 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:41.090510 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a776bc-72b3-4f4a-832b-72a3f3b58466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:41.155340 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-77a776bc-72b3-4f4a-832b-72a3f3b58466 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:46:41.156547 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-77a776bc-72b3-4f4a-832b-72a3f3b58466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:41.256383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 729/1477] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:46:41.538492 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4180de0-61be-4455-9598-409b725811ab None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:46:41.540034 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c4180de0-61be-4455-9598-409b725811ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:41.665423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4180de0-61be-4455-9598-409b725811ab None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:46:41.714300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:41.759003 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708da2a7-4ff4-4d3a-ba40-9755ea87c827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:46:41.759600 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708da2a7-4ff4-4d3a-ba40-9755ea87c827 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:41.759879 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708da2a7-4ff4-4d3a-ba40-9755ea87c827 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:41.760148 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708da2a7-4ff4-4d3a-ba40-9755ea87c827 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:41.760781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708da2a7-4ff4-4d3a-ba40-9755ea87c827 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:46:41.762537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: WARNING py.warnings [None req-708da2a7-4ff4-4d3a-ba40-9755ea87c827 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 08:46:41.762537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: warnings.warn(msg) Aug 26 08:46:41.762537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: Aug 26 08:46:41.763677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708da2a7-4ff4-4d3a-ba40-9755ea87c827 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:46:41.782549 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 749/1478] 10.222.0.76 () {56 vars in 1108 bytes} [Fri Aug 26 08:46:41 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:46:43.703836 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee069b7b-3e19-42d4-8c56-92e3a17cda93 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:43.704366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee069b7b-3e19-42d4-8c56-92e3a17cda93 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:43.704366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee069b7b-3e19-42d4-8c56-92e3a17cda93 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:43.705765 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 730/1479] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:46:43.710858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6228ac-0343-4f40-89e4-e684067f94c1 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:43.711326 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6228ac-0343-4f40-89e4-e684067f94c1 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:43.711428 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6228ac-0343-4f40-89e4-e684067f94c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:43.776355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-ec6228ac-0343-4f40-89e4-e684067f94c1 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:46:43.777611 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ec6228ac-0343-4f40-89e4-e684067f94c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:43.873578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 750/1480] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:46:44.173879 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee069b7b-3e19-42d4-8c56-92e3a17cda93 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:46:44.175487 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ee069b7b-3e19-42d4-8c56-92e3a17cda93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:44.185586 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:44.321467 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee069b7b-3e19-42d4-8c56-92e3a17cda93 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:46:44.400179 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:44.434521 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9736ade-5d7f-4e98-8f36-4b362f76e475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:46:44.435055 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9736ade-5d7f-4e98-8f36-4b362f76e475 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:44.435336 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9736ade-5d7f-4e98-8f36-4b362f76e475 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:44.435607 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9736ade-5d7f-4e98-8f36-4b362f76e475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:44.437790 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c9736ade-5d7f-4e98-8f36-4b362f76e475 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:44.525850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9736ade-5d7f-4e98-8f36-4b362f76e475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:46:44.527445 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9736ade-5d7f-4e98-8f36-4b362f76e475 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:46:44.545116 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 731/1481] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:46:46.634496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3105a3d-fd64-40ff-8bd3-405afe0a9139 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:46.635055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3105a3d-fd64-40ff-8bd3-405afe0a9139 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:46.635055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3105a3d-fd64-40ff-8bd3-405afe0a9139 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:46.636399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 751/1482] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:46:46.641688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b20fa-58b6-488b-a5d0-47c1e43650ea None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:46.642094 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b20fa-58b6-488b-a5d0-47c1e43650ea None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:46.642232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b20fa-58b6-488b-a5d0-47c1e43650ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:46.706958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-646b20fa-58b6-488b-a5d0-47c1e43650ea None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:46:46.708146 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-646b20fa-58b6-488b-a5d0-47c1e43650ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:46.754542 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:46.804463 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 732/1483] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:46:47.088105 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3105a3d-fd64-40ff-8bd3-405afe0a9139 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:46:47.089717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e3105a3d-fd64-40ff-8bd3-405afe0a9139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:47.114604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:47.198190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3105a3d-fd64-40ff-8bd3-405afe0a9139 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:46:47.270806 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f8d93-50ef-4ac2-b75c-6917763aeff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:46:47.271804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f8d93-50ef-4ac2-b75c-6917763aeff1 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:47.272329 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f8d93-50ef-4ac2-b75c-6917763aeff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:47.272622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f8d93-50ef-4ac2-b75c-6917763aeff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:47.275009 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-8c2f8d93-50ef-4ac2-b75c-6917763aeff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:47.355280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:47.390225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f8d93-50ef-4ac2-b75c-6917763aeff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:46:47.391658 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f8d93-50ef-4ac2-b75c-6917763aeff1 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:46:47.409892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 752/1484] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:46:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:46:49.376563 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907855c1-e64e-499e-b2e2-a88fa16c7742 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:49.377161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907855c1-e64e-499e-b2e2-a88fa16c7742 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:49.377161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907855c1-e64e-499e-b2e2-a88fa16c7742 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:49.378513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 733/1485] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:46:49.383859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe47f7-6638-4903-9f03-9e42b700143f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:49.384292 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe47f7-6638-4903-9f03-9e42b700143f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:49.384398 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe47f7-6638-4903-9f03-9e42b700143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:49.450631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-17fe47f7-6638-4903-9f03-9e42b700143f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:46:49.452373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-17fe47f7-6638-4903-9f03-9e42b700143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:49.546989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 753/1486] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:46:49.834589 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907855c1-e64e-499e-b2e2-a88fa16c7742 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:46:49.836127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-907855c1-e64e-499e-b2e2-a88fa16c7742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:49.939780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907855c1-e64e-499e-b2e2-a88fa16c7742 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:46:50.012133 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:50.014716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19078851-c9b1-4ce1-ab8e-604428ffc05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:46:50.015337 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19078851-c9b1-4ce1-ab8e-604428ffc05a service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:50.015867 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19078851-c9b1-4ce1-ab8e-604428ffc05a service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:50.016329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19078851-c9b1-4ce1-ab8e-604428ffc05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:50.018147 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-19078851-c9b1-4ce1-ab8e-604428ffc05a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:50.129057 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19078851-c9b1-4ce1-ab8e-604428ffc05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:46:50.130521 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19078851-c9b1-4ce1-ab8e-604428ffc05a service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:46:50.148981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 734/1487] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:46:52.135254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cdbed-1eda-49f4-8fb7-7de5495e7695 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:52.135829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cdbed-1eda-49f4-8fb7-7de5495e7695 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:52.135829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cdbed-1eda-49f4-8fb7-7de5495e7695 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:52.137171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 754/1488] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:46:52.142399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6365-a263-4fdb-b4b2-b99a51b57803 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:52.142867 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6365-a263-4fdb-b4b2-b99a51b57803 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:52.142974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6365-a263-4fdb-b4b2-b99a51b57803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:52.208510 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ba0a6365-a263-4fdb-b4b2-b99a51b57803 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:46:52.209763 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ba0a6365-a263-4fdb-b4b2-b99a51b57803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:52.263681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:52.308000 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 735/1489] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:46:52.604475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cdbed-1eda-49f4-8fb7-7de5495e7695 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:46:52.606087 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a41cdbed-1eda-49f4-8fb7-7de5495e7695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:52.642096 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:52.709164 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cdbed-1eda-49f4-8fb7-7de5495e7695 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:46:52.781648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8af457-ea1f-45e5-a5ed-e3cdbaf79487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:46:52.782248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8af457-ea1f-45e5-a5ed-e3cdbaf79487 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:52.782527 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8af457-ea1f-45e5-a5ed-e3cdbaf79487 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:52.782798 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8af457-ea1f-45e5-a5ed-e3cdbaf79487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:52.784394 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9a8af457-ea1f-45e5-a5ed-e3cdbaf79487 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:52.864335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:52.892999 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8af457-ea1f-45e5-a5ed-e3cdbaf79487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:46:52.894464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8af457-ea1f-45e5-a5ed-e3cdbaf79487 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:46:52.912566 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 755/1490] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:46:55.001377 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad407b-2149-4b06-8cc9-304dd1761f65 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:55.001911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad407b-2149-4b06-8cc9-304dd1761f65 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:55.002037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad407b-2149-4b06-8cc9-304dd1761f65 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:55.003299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 736/1491] 10.222.0.76 () {54 vars in 927 bytes} [Fri Aug 26 08:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:46:55.008418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c909c5-e0c7-41a5-8af9-1c9e2af9c86b None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:55.008814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c909c5-e0c7-41a5-8af9-1c9e2af9c86b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:55.008970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c909c5-e0c7-41a5-8af9-1c9e2af9c86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:55.074607 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-74c909c5-e0c7-41a5-8af9-1c9e2af9c86b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:46:55.075823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-74c909c5-e0c7-41a5-8af9-1c9e2af9c86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:55.171026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 756/1492] 10.222.0.76 () {58 vars in 1024 bytes} [Fri Aug 26 08:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:46:55.469324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad407b-2149-4b06-8cc9-304dd1761f65 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:46:55.470881 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-29ad407b-2149-4b06-8cc9-304dd1761f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:55.573347 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad407b-2149-4b06-8cc9-304dd1761f65 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:46:55.646174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd97643-653c-49ec-9799-97d2f280f683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:46:55.646778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd97643-653c-49ec-9799-97d2f280f683 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:46:55.647055 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd97643-653c-49ec-9799-97d2f280f683 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:46:55.647325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd97643-653c-49ec-9799-97d2f280f683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:46:55.648915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-9bd97643-653c-49ec-9799-97d2f280f683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:46:55.657866 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:55.756770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd97643-653c-49ec-9799-97d2f280f683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:46:55.758155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd97643-653c-49ec-9799-97d2f280f683 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:46:55.775829 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 737/1493] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:47:05.169325 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=82 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:47:05.773522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=50 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:48:07.622632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f17f3e-f380-4857-b964-748a2a315c16 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:07.623163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f17f3e-f380-4857-b964-748a2a315c16 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:07.623163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f17f3e-f380-4857-b964-748a2a315c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:07.698494 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-93f17f3e-f380-4857-b964-748a2a315c16 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:48:07.700302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-93f17f3e-f380-4857-b964-748a2a315c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:07.794675 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 757/1494] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:48:07.802675 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6a583-b232-44b9-b470-38c48b275c3a None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:07.803248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6a583-b232-44b9-b470-38c48b275c3a None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:07.803248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6a583-b232-44b9-b470-38c48b275c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:07.879408 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-1fa6a583-b232-44b9-b470-38c48b275c3a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:48:07.880622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1fa6a583-b232-44b9-b470-38c48b275c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:07.975581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 738/1495] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:48:07.980392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f17f3e-f380-4857-b964-748a2a315c16 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:48:07.981628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-93f17f3e-f380-4857-b964-748a2a315c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:07.993137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f17f3e-f380-4857-b964-748a2a315c16 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:48:08.057470 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:48:08.092634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab04e6-58b9-4a82-8261-2026cc2dc6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:48:08.093271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab04e6-58b9-4a82-8261-2026cc2dc6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:08.093559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab04e6-58b9-4a82-8261-2026cc2dc6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:08.093833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab04e6-58b9-4a82-8261-2026cc2dc6c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:08.094475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab04e6-58b9-4a82-8261-2026cc2dc6c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:48:08.094782 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab04e6-58b9-4a82-8261-2026cc2dc6c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:48:08.095787 dv-cinder-852364-5-smb devstack@keystone.service[87893]: WARNING py.warnings [None req-a1ab04e6-58b9-4a82-8261-2026cc2dc6c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 08:48:08.095787 dv-cinder-852364-5-smb devstack@keystone.service[87893]: warnings.warn(msg) Aug 26 08:48:08.095787 dv-cinder-852364-5-smb devstack@keystone.service[87893]: Aug 26 08:48:08.096677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab04e6-58b9-4a82-8261-2026cc2dc6c4 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:48:08.108275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 758/1496] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:48:08.116842 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6a583-b232-44b9-b470-38c48b275c3a None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:48:08.126915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6a583-b232-44b9-b470-38c48b275c3a None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:48:08.190226 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:48:08.227291 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d34a24-577f-49a3-a198-39ea8e4708a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:48:08.227907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d34a24-577f-49a3-a198-39ea8e4708a4 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:08.228191 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d34a24-577f-49a3-a198-39ea8e4708a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:08.228464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d34a24-577f-49a3-a198-39ea8e4708a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:08.229150 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d34a24-577f-49a3-a198-39ea8e4708a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:48:08.230981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: WARNING py.warnings [None req-b3d34a24-577f-49a3-a198-39ea8e4708a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 08:48:08.230981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: warnings.warn(msg) Aug 26 08:48:08.230981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: Aug 26 08:48:08.232198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d34a24-577f-49a3-a198-39ea8e4708a4 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:48:08.288840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 739/1497] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:48:08 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:48:08.293079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab04e6-58b9-4a82-8261-2026cc2dc6c4 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:48:08.294664 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a1ab04e6-58b9-4a82-8261-2026cc2dc6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:08.328888 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab04e6-58b9-4a82-8261-2026cc2dc6c4 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:48:08.424801 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04d0ff-a383-4f3e-8b1f-fa5e11e95f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:48:08.425430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d0ff-a383-4f3e-8b1f-fa5e11e95f60 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:08.425713 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d0ff-a383-4f3e-8b1f-fa5e11e95f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:08.425986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d0ff-a383-4f3e-8b1f-fa5e11e95f60 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:08.426600 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04d0ff-a383-4f3e-8b1f-fa5e11e95f60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:48:08.427619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: WARNING py.warnings [None req-4a04d0ff-a383-4f3e-8b1f-fa5e11e95f60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 08:48:08.427619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: warnings.warn(msg) Aug 26 08:48:08.427619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: Aug 26 08:48:08.428833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04d0ff-a383-4f3e-8b1f-fa5e11e95f60 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:48:08.471439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 759/1498] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:48:08 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:48:08.475496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d34a24-577f-49a3-a198-39ea8e4708a4 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:48:08.477123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b3d34a24-577f-49a3-a198-39ea8e4708a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:08.539342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d34a24-577f-49a3-a198-39ea8e4708a4 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:48:08.624730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:48:08.636365 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202caa0-2fd6-44dd-82fb-ed1d9da0c110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:48:08.637021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202caa0-2fd6-44dd-82fb-ed1d9da0c110 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:08.637305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202caa0-2fd6-44dd-82fb-ed1d9da0c110 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:08.637578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202caa0-2fd6-44dd-82fb-ed1d9da0c110 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:08.638228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202caa0-2fd6-44dd-82fb-ed1d9da0c110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:48:08.639244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: WARNING py.warnings [None req-d202caa0-2fd6-44dd-82fb-ed1d9da0c110 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 08:48:08.639244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: warnings.warn(msg) Aug 26 08:48:08.639244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: Aug 26 08:48:08.640192 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202caa0-2fd6-44dd-82fb-ed1d9da0c110 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:48:08.653154 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 740/1499] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:48:08.657287 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04d0ff-a383-4f3e-8b1f-fa5e11e95f60 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:48:08.658818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4a04d0ff-a383-4f3e-8b1f-fa5e11e95f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:08.670878 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04d0ff-a383-4f3e-8b1f-fa5e11e95f60 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:48:08.696077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:48:08.767770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501fa7b-5c12-4d10-b8db-3a2c4b1c1c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:48:08.768301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501fa7b-5c12-4d10-b8db-3a2c4b1c1c66 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:08.768584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501fa7b-5c12-4d10-b8db-3a2c4b1c1c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:08.768857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501fa7b-5c12-4d10-b8db-3a2c4b1c1c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:08.769537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501fa7b-5c12-4d10-b8db-3a2c4b1c1c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:48:08.770539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: WARNING py.warnings [None req-2501fa7b-5c12-4d10-b8db-3a2c4b1c1c66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 08:48:08.770539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: warnings.warn(msg) Aug 26 08:48:08.770539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: Aug 26 08:48:08.771433 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501fa7b-5c12-4d10-b8db-3a2c4b1c1c66 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:48:08.784448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 760/1500] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:48:08.788830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202caa0-2fd6-44dd-82fb-ed1d9da0c110 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:48:08.790399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d202caa0-2fd6-44dd-82fb-ed1d9da0c110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:08.825822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202caa0-2fd6-44dd-82fb-ed1d9da0c110 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:48:08.919103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dc700-1a83-444f-b033-885d545abdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:48:08.919762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dc700-1a83-444f-b033-885d545abdaf admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:08.920047 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dc700-1a83-444f-b033-885d545abdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:08.920322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dc700-1a83-444f-b033-885d545abdaf admin admin] PATH_INFO: `/v3/projects/490dd2d27c814606b618837bd42dd955/users/8d173174bb8042a9acb268e4621f6557/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:08.941725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dc700-1a83-444f-b033-885d545abdaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=490dd2d27c814606b618837bd42dd955, user_id=8d173174bb8042a9acb268e4621f6557, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:48:08.942835 dv-cinder-852364-5-smb devstack@keystone.service[87892]: WARNING py.warnings [None req-439dc700-1a83-444f-b033-885d545abdaf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 08:48:08.942835 dv-cinder-852364-5-smb devstack@keystone.service[87892]: warnings.warn(msg) Aug 26 08:48:08.942835 dv-cinder-852364-5-smb devstack@keystone.service[87892]: Aug 26 08:48:08.944762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dc700-1a83-444f-b033-885d545abdaf admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:48:08.969712 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 741/1501] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:48:08 2022] PUT /identity/v3/projects/490dd2d27c814606b618837bd42dd955/users/8d173174bb8042a9acb268e4621f6557/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:48:08.981694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4041777-3ac7-4f3d-92cc-64854fe4eaf8 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:08.982012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4041777-3ac7-4f3d-92cc-64854fe4eaf8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:08.982297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4041777-3ac7-4f3d-92cc-64854fe4eaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:09.039374 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-c4041777-3ac7-4f3d-92cc-64854fe4eaf8 None None] MFA Rules not processed for user `8d173174bb8042a9acb268e4621f6557`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:48:09.040554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c4041777-3ac7-4f3d-92cc-64854fe4eaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:09.116431 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 761/1502] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:48:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:48:09.129345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278e3ec-64ba-474b-841f-d5d3d374512d None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:09.129634 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278e3ec-64ba-474b-841f-d5d3d374512d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:09.129914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278e3ec-64ba-474b-841f-d5d3d374512d None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:09.131244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 742/1503] 10.222.0.76 () {54 vars in 964 bytes} [Fri Aug 26 08:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:48:09.135787 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57739c-2af3-43cf-834b-22340afb3c5f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:09.136077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57739c-2af3-43cf-834b-22340afb3c5f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:09.136352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57739c-2af3-43cf-834b-22340afb3c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:09.168789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:48:09.213006 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-3c57739c-2af3-43cf-834b-22340afb3c5f None None] MFA Rules not processed for user `0f3147e5695240afa9eaf42d2343b7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:48:09.214224 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-3c57739c-2af3-43cf-834b-22340afb3c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:09.288906 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 762/1504] 10.222.0.76 () {58 vars in 1061 bytes} [Fri Aug 26 08:48:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:48:09.296628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278e3ec-64ba-474b-841f-d5d3d374512d None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:48:09.298142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-6278e3ec-64ba-474b-841f-d5d3d374512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:09.348280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:48:09.401996 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278e3ec-64ba-474b-841f-d5d3d374512d None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:48:09.474008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757209c8-5052-4ed6-989f-546218e7c353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:48:09.474612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757209c8-5052-4ed6-989f-546218e7c353 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:09.474898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757209c8-5052-4ed6-989f-546218e7c353 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:09.475168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757209c8-5052-4ed6-989f-546218e7c353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:09.476758 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-757209c8-5052-4ed6-989f-546218e7c353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:09.573481 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757209c8-5052-4ed6-989f-546218e7c353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:48:09.575415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757209c8-5052-4ed6-989f-546218e7c353 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:48:09.578985 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:48:09.594265 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 743/1505] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:48:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:48:09.638782 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74df5b9-2193-4f60-8f0b-78210a231d4d None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:09.639074 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74df5b9-2193-4f60-8f0b-78210a231d4d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:09.639354 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74df5b9-2193-4f60-8f0b-78210a231d4d None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:09.640658 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 763/1506] 10.222.0.76 () {52 vars in 830 bytes} [Fri Aug 26 08:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:48:09.644247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757209c8-5052-4ed6-989f-546218e7c353 service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:48:09.645505 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-757209c8-5052-4ed6-989f-546218e7c353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:09.742788 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757209c8-5052-4ed6-989f-546218e7c353 service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:48:09.835265 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1a8cd-3883-4c13-8bed-6919e5657edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:48:09.835889 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1a8cd-3883-4c13-8bed-6919e5657edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:09.836079 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1a8cd-3883-4c13-8bed-6919e5657edc admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:09.836348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1a8cd-3883-4c13-8bed-6919e5657edc admin admin] PATH_INFO: `/v3/users/8d173174bb8042a9acb268e4621f6557` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:09.848481 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1a8cd-3883-4c13-8bed-6919e5657edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d173174bb8042a9acb268e4621f6557)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:48:09.849529 dv-cinder-852364-5-smb devstack@keystone.service[87892]: WARNING py.warnings [None req-1cf1a8cd-3883-4c13-8bed-6919e5657edc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 08:48:09.849529 dv-cinder-852364-5-smb devstack@keystone.service[87892]: warnings.warn(msg) Aug 26 08:48:09.849529 dv-cinder-852364-5-smb devstack@keystone.service[87892]: Aug 26 08:48:09.850741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1a8cd-3883-4c13-8bed-6919e5657edc admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:48:09.860684 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:48:09.915530 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1cf1a8cd-3883-4c13-8bed-6919e5657edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d173174bb8042a9acb268e4621f6557'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:48:09.925488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1cf1a8cd-3883-4c13-8bed-6919e5657edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d173174bb8042a9acb268e4621f6557'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:48:09.925917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1cf1a8cd-3883-4c13-8bed-6919e5657edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d173174bb8042a9acb268e4621f6557'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:48:09.926420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1cf1a8cd-3883-4c13-8bed-6919e5657edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d173174bb8042a9acb268e4621f6557'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:48:09.940539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1cf1a8cd-3883-4c13-8bed-6919e5657edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d173174bb8042a9acb268e4621f6557'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:48:09.967918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 744/1507] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:48:09 2022] DELETE /identity/v3/users/8d173174bb8042a9acb268e4621f6557 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:48:09.972341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7bda8-4ba1-47bb-ab8a-4d2aa23b58b2 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:09.972805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7bda8-4ba1-47bb-ab8a-4d2aa23b58b2 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:09.972898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7bda8-4ba1-47bb-ab8a-4d2aa23b58b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:10.030006 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-83f7bda8-4ba1-47bb-ab8a-4d2aa23b58b2 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:48:10.031220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-83f7bda8-4ba1-47bb-ab8a-4d2aa23b58b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:10.108058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:48:10.120762 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 764/1508] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:48:10.131507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1a8cd-3883-4c13-8bed-6919e5657edc admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:48:10.132877 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1cf1a8cd-3883-4c13-8bed-6919e5657edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:10.232666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1a8cd-3883-4c13-8bed-6919e5657edc admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:48:10.293383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:48:10.314732 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7f90-8acb-4314-979a-fc6dc8cc09b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:48:10.315341 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7f90-8acb-4314-979a-fc6dc8cc09b0 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:10.315623 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7f90-8acb-4314-979a-fc6dc8cc09b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:10.315896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7f90-8acb-4314-979a-fc6dc8cc09b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:10.317532 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b5eb7f90-8acb-4314-979a-fc6dc8cc09b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:10.425537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb7f90-8acb-4314-979a-fc6dc8cc09b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:48:10.426881 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb7f90-8acb-4314-979a-fc6dc8cc09b0 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:48:10.563716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 745/1509] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:48:10.924698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7bda8-4ba1-47bb-ab8a-4d2aa23b58b2 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:48:10.925967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-83f7bda8-4ba1-47bb-ab8a-4d2aa23b58b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:48:10.937521 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7bda8-4ba1-47bb-ab8a-4d2aa23b58b2 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:48:11.034925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5961f3-6a22-4a69-a026-dfd1344b1229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:48:11.035615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5961f3-6a22-4a69-a026-dfd1344b1229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:48:11.035956 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5961f3-6a22-4a69-a026-dfd1344b1229 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:48:11.036292 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5961f3-6a22-4a69-a026-dfd1344b1229 admin admin] PATH_INFO: `/v3/projects/490dd2d27c814606b618837bd42dd955` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:48:11.047021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5961f3-6a22-4a69-a026-dfd1344b1229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=490dd2d27c814606b618837bd42dd955)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:48:11.048044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: WARNING py.warnings [None req-2b5961f3-6a22-4a69-a026-dfd1344b1229 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 08:48:11.048044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: warnings.warn(msg) Aug 26 08:48:11.048044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: Aug 26 08:48:11.049279 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5961f3-6a22-4a69-a026-dfd1344b1229 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:48:11.106078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2b5961f3-6a22-4a69-a026-dfd1344b1229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '490dd2d27c814606b618837bd42dd955', 'request_id': 'req-2b5961f3-6a22-4a69-a026-dfd1344b1229'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:48:11.120201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2b5961f3-6a22-4a69-a026-dfd1344b1229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '490dd2d27c814606b618837bd42dd955', 'request_id': 'req-2b5961f3-6a22-4a69-a026-dfd1344b1229'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:48:11.128770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2b5961f3-6a22-4a69-a026-dfd1344b1229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '490dd2d27c814606b618837bd42dd955', 'request_id': 'req-2b5961f3-6a22-4a69-a026-dfd1344b1229'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:48:11.151698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2b5961f3-6a22-4a69-a026-dfd1344b1229 admin admin] The token cache is being invalidate because project 490dd2d27c814606b618837bd42dd955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:48:11.151986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2b5961f3-6a22-4a69-a026-dfd1344b1229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:48:11.153115 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2b5961f3-6a22-4a69-a026-dfd1344b1229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:48:11.154446 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 765/1510] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:48:10 2022] DELETE /identity/v3/projects/490dd2d27c814606b618837bd42dd955 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:48:20.561260 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=62 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:48:21.149866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:49:49.120084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8bd5f-0aa0-4731-9ea8-a78301646391 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:49:49.120701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8bd5f-0aa0-4731-9ea8-a78301646391 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:49:49.120701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8bd5f-0aa0-4731-9ea8-a78301646391 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:49:49.121998 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 08:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:49:49.127523 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab27f5-5c70-466c-bd4a-a4cc6ec3ca06 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:49:49.127935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab27f5-5c70-466c-bd4a-a4cc6ec3ca06 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:49:49.128109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab27f5-5c70-466c-bd4a-a4cc6ec3ca06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:49:49.208555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-3fab27f5-5c70-466c-bd4a-a4cc6ec3ca06 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:49:49.209704 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-3fab27f5-5c70-466c-bd4a-a4cc6ec3ca06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:49:49.310405 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 08:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:49:49.465594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8bd5f-0aa0-4731-9ea8-a78301646391 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:49:49.468041 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-e6d8bd5f-0aa0-4731-9ea8-a78301646391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:49:49.584441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8bd5f-0aa0-4731-9ea8-a78301646391 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:49:49.589925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ef562-964f-4f37-b275-c7931c800969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:49:49.590534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ef562-964f-4f37-b275-c7931c800969 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:49:49.590817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ef562-964f-4f37-b275-c7931c800969 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:49:49.591093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ef562-964f-4f37-b275-c7931c800969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:49:49.599538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ef562-964f-4f37-b275-c7931c800969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:49:49.601157 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ef562-964f-4f37-b275-c7931c800969 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:49:49.610883 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 747/1513] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:49:50.444032 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0a72b-8ab0-404c-b16b-246214408300 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:49:50.444596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0a72b-8ab0-404c-b16b-246214408300 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:49:50.444707 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0a72b-8ab0-404c-b16b-246214408300 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:49:50.446055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 08:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:49:50.450704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5110b-31ff-4b06-8cb8-cc93f5b33132 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:49:50.451184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5110b-31ff-4b06-8cb8-cc93f5b33132 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:49:50.451884 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5110b-31ff-4b06-8cb8-cc93f5b33132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:49:50.471300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-83e5110b-31ff-4b06-8cb8-cc93f5b33132 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:49:50.472496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-83e5110b-31ff-4b06-8cb8-cc93f5b33132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:49:50.480308 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 08:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:49:50.632743 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0a72b-8ab0-404c-b16b-246214408300 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:49:50.647703 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0a72b-8ab0-404c-b16b-246214408300 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:49:50.653186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce5389-f3c5-49cc-bf9c-28a55614b0a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:49:50.653779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce5389-f3c5-49cc-bf9c-28a55614b0a7 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:49:50.654066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce5389-f3c5-49cc-bf9c-28a55614b0a7 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:49:50.654341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce5389-f3c5-49cc-bf9c-28a55614b0a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:49:50.662354 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce5389-f3c5-49cc-bf9c-28a55614b0a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:49:50.663931 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce5389-f3c5-49cc-bf9c-28a55614b0a7 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:49:50.673342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 768/1516] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:49:53.231681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f83e9-acda-4d72-b3f0-864593bbc63b None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:49:53.232212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f83e9-acda-4d72-b3f0-864593bbc63b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:49:53.232212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f83e9-acda-4d72-b3f0-864593bbc63b None None] PATH_INFO: `/v3` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:49:53.233476 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 749/1517] 10.222.0.98 () {54 vars in 925 bytes} [Fri Aug 26 08:49:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:49:53.240606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69c286-2b2c-44fa-aa63-e2ed5880548f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:49:53.241036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69c286-2b2c-44fa-aa63-e2ed5880548f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:49:53.241182 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69c286-2b2c-44fa-aa63-e2ed5880548f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:49:53.298954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-1c69c286-2b2c-44fa-aa63-e2ed5880548f None None] MFA Rules not processed for user `95abbd88e549427abbf5699efed0451a`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:49:53.300145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1c69c286-2b2c-44fa-aa63-e2ed5880548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:49:53.316241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:49:53.372684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 769/1518] 10.222.0.98 () {58 vars in 1015 bytes} [Fri Aug 26 08:49:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:49:57.610620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7cacf-1c2d-4b12-953a-3a2e5c5900ab None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:49:57.611097 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7cacf-1c2d-4b12-953a-3a2e5c5900ab None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:49:57.611097 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7cacf-1c2d-4b12-953a-3a2e5c5900ab None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:49:57.612413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 750/1519] 10.222.0.76 () {54 vars in 961 bytes} [Fri Aug 26 08:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:49:57.617481 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9f543-916f-4586-9f19-42c59e998ca0 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:49:57.617926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9f543-916f-4586-9f19-42c59e998ca0 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:49:57.618036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9f543-916f-4586-9f19-42c59e998ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:49:57.637760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-46b9f543-916f-4586-9f19-42c59e998ca0 None None] MFA Rules not processed for user `95abbd88e549427abbf5699efed0451a`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:49:57.639001 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-46b9f543-916f-4586-9f19-42c59e998ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:49:57.647526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 770/1520] 10.222.0.76 () {58 vars in 1058 bytes} [Fri Aug 26 08:49:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:49:57.655760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7cacf-1c2d-4b12-953a-3a2e5c5900ab None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:49:57.669405 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7cacf-1c2d-4b12-953a-3a2e5c5900ab None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:49:57.674780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98325d-1acb-4c57-8a7b-2e6f714a4bf4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95abbd88e549427abbf5699efed0451a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:49:57.675369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98325d-1acb-4c57-8a7b-2e6f714a4bf4 service placement] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:49:57.675650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98325d-1acb-4c57-8a7b-2e6f714a4bf4 service placement] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:49:57.675921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98325d-1acb-4c57-8a7b-2e6f714a4bf4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:49:57.684186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98325d-1acb-4c57-8a7b-2e6f714a4bf4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:49:57.686473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98325d-1acb-4c57-8a7b-2e6f714a4bf4 service placement] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:49:57.696762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 751/1521] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:49:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:50:01.907006 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7a246-3163-460c-8785-0880a86d5c13 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:01.907590 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7a246-3163-460c-8785-0880a86d5c13 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:01.907590 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7a246-3163-460c-8785-0880a86d5c13 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:01.908905 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 08:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:50:01.913756 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7edb6e-1a31-4ac7-b3a3-25202c2c01ed None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:01.914206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7edb6e-1a31-4ac7-b3a3-25202c2c01ed None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:01.914322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7edb6e-1a31-4ac7-b3a3-25202c2c01ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:01.933677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-be7edb6e-1a31-4ac7-b3a3-25202c2c01ed None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:50:01.934855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-be7edb6e-1a31-4ac7-b3a3-25202c2c01ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:50:01.942858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 08:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:50:02.098882 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7a246-3163-460c-8785-0880a86d5c13 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:50:02.113463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7a246-3163-460c-8785-0880a86d5c13 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:50:02.118950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fa1ca-804e-456b-8259-13749b03372a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:50:02.119549 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fa1ca-804e-456b-8259-13749b03372a service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:02.119836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fa1ca-804e-456b-8259-13749b03372a service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:02.120117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fa1ca-804e-456b-8259-13749b03372a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:02.128069 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fa1ca-804e-456b-8259-13749b03372a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:50:02.129684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fa1ca-804e-456b-8259-13749b03372a service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:50:02.138994 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 772/1524] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:50:02.952076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc5697-153d-4c59-8336-5fe45c2e1cdc None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:02.952515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc5697-153d-4c59-8336-5fe45c2e1cdc None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:02.952699 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc5697-153d-4c59-8336-5fe45c2e1cdc None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:02.954140 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 08:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:50:02.959187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fdee3-21e3-4a0b-b20c-266111b7c80a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:02.959659 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fdee3-21e3-4a0b-b20c-266111b7c80a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:02.959770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fdee3-21e3-4a0b-b20c-266111b7c80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:02.980109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-492fdee3-21e3-4a0b-b20c-266111b7c80a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:50:02.981382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-492fdee3-21e3-4a0b-b20c-266111b7c80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:50:02.989775 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 08:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:50:03.151104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc5697-153d-4c59-8336-5fe45c2e1cdc None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:50:03.165707 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc5697-153d-4c59-8336-5fe45c2e1cdc None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:50:03.171713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04f475-7ea7-4b35-b155-3187969bb748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:50:03.172298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04f475-7ea7-4b35-b155-3187969bb748 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:03.172578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04f475-7ea7-4b35-b155-3187969bb748 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:03.172850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04f475-7ea7-4b35-b155-3187969bb748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:03.180712 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04f475-7ea7-4b35-b155-3187969bb748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:50:03.182308 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04f475-7ea7-4b35-b155-3187969bb748 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:50:03.191704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 754/1527] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:50:07.212329 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a0898-3254-42bf-9276-6772e2314aa1 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:07.212838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a0898-3254-42bf-9276-6772e2314aa1 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:07.212838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a0898-3254-42bf-9276-6772e2314aa1 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:07.214198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 08:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:50:07.219728 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350435b4-96f9-4972-8dab-354d742159c1 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:07.220195 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350435b4-96f9-4972-8dab-354d742159c1 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:07.220311 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350435b4-96f9-4972-8dab-354d742159c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:07.239493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-350435b4-96f9-4972-8dab-354d742159c1 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:50:07.240669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-350435b4-96f9-4972-8dab-354d742159c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:50:07.249212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 08:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:50:07.534023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a0898-3254-42bf-9276-6772e2314aa1 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:50:07.535706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-642a0898-3254-42bf-9276-6772e2314aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:50:07.614796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a0898-3254-42bf-9276-6772e2314aa1 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:50:07.618315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197dfb4-3326-4c2c-8be0-d37fd0ac423b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:50:07.618926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197dfb4-3326-4c2c-8be0-d37fd0ac423b service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:07.619207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197dfb4-3326-4c2c-8be0-d37fd0ac423b service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:07.619480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197dfb4-3326-4c2c-8be0-d37fd0ac423b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:07.628576 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197dfb4-3326-4c2c-8be0-d37fd0ac423b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:50:07.630069 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197dfb4-3326-4c2c-8be0-d37fd0ac423b service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:50:07.639345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 775/1530] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:50:09.540166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6ba59-b1a7-44b7-aa68-e004602ee5b7 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:09.540719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6ba59-b1a7-44b7-aa68-e004602ee5b7 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:09.540719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6ba59-b1a7-44b7-aa68-e004602ee5b7 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:09.542072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 08:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:50:09.547994 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4e8fa-93ae-43b1-8789-8cf8859f8915 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:09.548423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4e8fa-93ae-43b1-8789-8cf8859f8915 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:09.548528 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4e8fa-93ae-43b1-8789-8cf8859f8915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:09.568482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-aab4e8fa-93ae-43b1-8789-8cf8859f8915 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:50:09.569725 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-aab4e8fa-93ae-43b1-8789-8cf8859f8915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:50:09.578411 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 08:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:50:09.863434 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6ba59-b1a7-44b7-aa68-e004602ee5b7 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:50:09.874101 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6ba59-b1a7-44b7-aa68-e004602ee5b7 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:50:09.877554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0086e9-082c-4a5b-9a87-1fc0bba73df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:50:09.878145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0086e9-082c-4a5b-9a87-1fc0bba73df4 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:09.878426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0086e9-082c-4a5b-9a87-1fc0bba73df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:09.878700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0086e9-082c-4a5b-9a87-1fc0bba73df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:09.887376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0086e9-082c-4a5b-9a87-1fc0bba73df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:50:09.888785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0086e9-082c-4a5b-9a87-1fc0bba73df4 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:50:09.898133 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 757/1533] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:50:13.307081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988d12-e328-4b53-8921-0da722d2e35e None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:13.307653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988d12-e328-4b53-8921-0da722d2e35e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:13.307653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988d12-e328-4b53-8921-0da722d2e35e None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:13.308889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 08:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:50:13.314873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f222a-90f2-4fdc-ab5c-a0ba366805bf None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:13.315318 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f222a-90f2-4fdc-ab5c-a0ba366805bf None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:13.315420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f222a-90f2-4fdc-ab5c-a0ba366805bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:13.322956 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=81 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:50:13.335541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-614f222a-90f2-4fdc-ab5c-a0ba366805bf None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:50:13.336777 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-614f222a-90f2-4fdc-ab5c-a0ba366805bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:50:13.344837 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 08:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:50:13.897809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e988d12-e328-4b53-8921-0da722d2e35e None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:50:13.899471 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-3e988d12-e328-4b53-8921-0da722d2e35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:50:13.964864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:50:13.979406 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e988d12-e328-4b53-8921-0da722d2e35e None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:50:13.983028 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8558017-807d-4bb7-8208-110f9efd8d0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:50:13.983656 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558017-807d-4bb7-8208-110f9efd8d0f service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:13.983936 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558017-807d-4bb7-8208-110f9efd8d0f service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:13.984211 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558017-807d-4bb7-8208-110f9efd8d0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:13.992839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8558017-807d-4bb7-8208-110f9efd8d0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:50:13.994298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8558017-807d-4bb7-8208-110f9efd8d0f service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:50:14.003497 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 778/1536] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:50:15.927744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67241810-6bd5-4396-925f-96144520c23e None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:15.928322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67241810-6bd5-4396-925f-96144520c23e None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:15.928322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67241810-6bd5-4396-925f-96144520c23e None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:15.929663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 08:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:50:15.934984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c6f43-9a08-43e0-a875-8a16c61536f6 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:15.935388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c6f43-9a08-43e0-a875-8a16c61536f6 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:15.936074 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c6f43-9a08-43e0-a875-8a16c61536f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:15.956009 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-fe1c6f43-9a08-43e0-a875-8a16c61536f6 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:50:15.957257 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-fe1c6f43-9a08-43e0-a875-8a16c61536f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:50:15.964954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 08:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:50:16.514757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67241810-6bd5-4396-925f-96144520c23e None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:50:16.516462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-67241810-6bd5-4396-925f-96144520c23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:50:16.529260 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67241810-6bd5-4396-925f-96144520c23e None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:50:16.532725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301c517-1748-490a-b8ff-7f1163c722a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:50:16.533357 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301c517-1748-490a-b8ff-7f1163c722a9 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:50:16.533642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301c517-1748-490a-b8ff-7f1163c722a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:50:16.533921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301c517-1748-490a-b8ff-7f1163c722a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:50:16.542613 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301c517-1748-490a-b8ff-7f1163c722a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:50:16.544023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301c517-1748-490a-b8ff-7f1163c722a9 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:50:16.553768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 760/1539] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:50:25.950717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=11 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:50:26.549680 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=8 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:50.690984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6548929-d8cd-4486-8425-f6a9262aa4e4 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:50.693297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6548929-d8cd-4486-8425-f6a9262aa4e4 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:50.693297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6548929-d8cd-4486-8425-f6a9262aa4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:50.722203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-e6548929-d8cd-4486-8425-f6a9262aa4e4 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:50.723676 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e6548929-d8cd-4486-8425-f6a9262aa4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:50.736533 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 780/1540] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:50.746215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6be93-ac42-4fb1-8aa5-db1c334eddd7 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:50.747199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6be93-ac42-4fb1-8aa5-db1c334eddd7 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:50.747651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6be93-ac42-4fb1-8aa5-db1c334eddd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:50.778124 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-46c6be93-ac42-4fb1-8aa5-db1c334eddd7 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:50.779682 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-46c6be93-ac42-4fb1-8aa5-db1c334eddd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:50.793221 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 761/1541] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:51:50.798386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6548929-d8cd-4486-8425-f6a9262aa4e4 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:50.815839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6548929-d8cd-4486-8425-f6a9262aa4e4 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:50.825312 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff37fc5-e3d1-4801-804f-ea10bf603174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:50.825951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff37fc5-e3d1-4801-804f-ea10bf603174 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:50.826233 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff37fc5-e3d1-4801-804f-ea10bf603174 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:50.826505 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff37fc5-e3d1-4801-804f-ea10bf603174 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:50.827171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff37fc5-e3d1-4801-804f-ea10bf603174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:51:50.827476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff37fc5-e3d1-4801-804f-ea10bf603174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:50.829218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff37fc5-e3d1-4801-804f-ea10bf603174 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:50.851117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 781/1542] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:51:50.859331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6be93-ac42-4fb1-8aa5-db1c334eddd7 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:50.874770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6be93-ac42-4fb1-8aa5-db1c334eddd7 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:50.885442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6398ed-1af7-4fa8-90b2-20f3f8b8b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:50.886368 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6398ed-1af7-4fa8-90b2-20f3f8b8b6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:50.886828 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6398ed-1af7-4fa8-90b2-20f3f8b8b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:50.887281 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6398ed-1af7-4fa8-90b2-20f3f8b8b6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:50.888110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6398ed-1af7-4fa8-90b2-20f3f8b8b6a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:50.890284 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6398ed-1af7-4fa8-90b2-20f3f8b8b6a2 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:50.950360 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 762/1543] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:51:50 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:50.955210 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff37fc5-e3d1-4801-804f-ea10bf603174 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:50.971847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff37fc5-e3d1-4801-804f-ea10bf603174 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:50.996787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfe06a-21f1-4beb-84e1-2c5a3be7138a None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:50.997112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfe06a-21f1-4beb-84e1-2c5a3be7138a None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:50.997385 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfe06a-21f1-4beb-84e1-2c5a3be7138a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.029410 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-c5cfe06a-21f1-4beb-84e1-2c5a3be7138a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:51.030646 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c5cfe06a-21f1-4beb-84e1-2c5a3be7138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:51.061636 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420adc7-74ad-4e10-a7e2-92bf38ad1cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.062403 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420adc7-74ad-4e10-a7e2-92bf38ad1cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.062693 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420adc7-74ad-4e10-a7e2-92bf38ad1cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.063278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420adc7-74ad-4e10-a7e2-92bf38ad1cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.063930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420adc7-74ad-4e10-a7e2-92bf38ad1cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.071157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420adc7-74ad-4e10-a7e2-92bf38ad1cd3 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.116686 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 782/1544] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:51:50 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:51.119893 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3e858-0cff-40e4-979a-9f687203f2e3 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.120938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3e858-0cff-40e4-979a-9f687203f2e3 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.121330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3e858-0cff-40e4-979a-9f687203f2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.151932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-17b3e858-0cff-40e4-979a-9f687203f2e3 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:51.153189 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-17b3e858-0cff-40e4-979a-9f687203f2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:51.153894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 763/1545] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:51:51.155208 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e92cfa-7fcd-4594-9110-1e0bde9301b5 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.155499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e92cfa-7fcd-4594-9110-1e0bde9301b5 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.155779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e92cfa-7fcd-4594-9110-1e0bde9301b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.162028 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 783/1546] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:51.162918 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3e858-0cff-40e4-979a-9f687203f2e3 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.175715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3e858-0cff-40e4-979a-9f687203f2e3 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.181176 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cd740-8bc5-4383-82b5-d68261599651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.181791 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cd740-8bc5-4383-82b5-d68261599651 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.182076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cd740-8bc5-4383-82b5-d68261599651 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.182353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cd740-8bc5-4383-82b5-d68261599651 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.182997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cd740-8bc5-4383-82b5-d68261599651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.184670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cd740-8bc5-4383-82b5-d68261599651 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.185383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-f8e92cfa-7fcd-4594-9110-1e0bde9301b5 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:51.186610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-f8e92cfa-7fcd-4594-9110-1e0bde9301b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:51.195596 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 764/1547] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:51.199222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 784/1548] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:51.199222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d6880-0c9c-4056-97b3-53145b1e920a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.199222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d6880-0c9c-4056-97b3-53145b1e920a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.199222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d6880-0c9c-4056-97b3-53145b1e920a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.204761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8de818-8138-46c7-88a8-fd80fb778a8c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.205092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8de818-8138-46c7-88a8-fd80fb778a8c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.205366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8de818-8138-46c7-88a8-fd80fb778a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.222311 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-7b8d6880-0c9c-4056-97b3-53145b1e920a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:51.223557 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-7b8d6880-0c9c-4056-97b3-53145b1e920a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:51.225223 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ec8de818-8138-46c7-88a8-fd80fb778a8c None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:51.226387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ec8de818-8138-46c7-88a8-fd80fb778a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:51.231591 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 785/1549] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:51.232907 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bda95-06cb-4e2c-9f2f-383e35269e73 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.233225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bda95-06cb-4e2c-9f2f-383e35269e73 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.233499 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bda95-06cb-4e2c-9f2f-383e35269e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.238532 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 765/1550] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:51.240498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198efb9-fbb2-4689-96a7-8b599c353a1c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.240786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198efb9-fbb2-4689-96a7-8b599c353a1c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.241086 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198efb9-fbb2-4689-96a7-8b599c353a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.260588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-7198efb9-fbb2-4689-96a7-8b599c353a1c None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:51.260862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-eb1bda95-06cb-4e2c-9f2f-383e35269e73 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:51.261813 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7198efb9-fbb2-4689-96a7-8b599c353a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:51.262058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-eb1bda95-06cb-4e2c-9f2f-383e35269e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:51.270325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 766/1551] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:51.270788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 786/1552] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:51.272602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bda95-06cb-4e2c-9f2f-383e35269e73 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.272746 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db56c7-330c-4b45-adf9-1728b06fcb50 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.272746 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db56c7-330c-4b45-adf9-1728b06fcb50 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.272746 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db56c7-330c-4b45-adf9-1728b06fcb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.287820 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bda95-06cb-4e2c-9f2f-383e35269e73 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.292523 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cb1a8-4ada-445b-b291-ab49ea195a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.293177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cb1a8-4ada-445b-b291-ab49ea195a03 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.293461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cb1a8-4ada-445b-b291-ab49ea195a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.293734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cb1a8-4ada-445b-b291-ab49ea195a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.294688 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cb1a8-4ada-445b-b291-ab49ea195a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.296095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cb1a8-4ada-445b-b291-ab49ea195a03 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.301374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-e7db56c7-330c-4b45-adf9-1728b06fcb50 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:51.302597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-e7db56c7-330c-4b45-adf9-1728b06fcb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:51.307781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 787/1553] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:51.309034 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ba225-14bd-4c67-9347-f7be7919a5c8 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.309329 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ba225-14bd-4c67-9347-f7be7919a5c8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.309604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ba225-14bd-4c67-9347-f7be7919a5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.318620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 767/1554] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:51.318620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32546f61-465a-4104-b8f1-954f636fa547 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.318620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32546f61-465a-4104-b8f1-954f636fa547 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.318620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32546f61-465a-4104-b8f1-954f636fa547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.335873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-f90ba225-14bd-4c67-9347-f7be7919a5c8 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:51.337231 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f90ba225-14bd-4c67-9347-f7be7919a5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:51.337374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-32546f61-465a-4104-b8f1-954f636fa547 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:51.338486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-32546f61-465a-4104-b8f1-954f636fa547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:51.345356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 788/1555] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:51.346652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 768/1556] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:51.347730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78fe18-3957-42d7-8f50-9e1490c05991 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.348055 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78fe18-3957-42d7-8f50-9e1490c05991 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.348325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78fe18-3957-42d7-8f50-9e1490c05991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.350166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57223df8-dc31-4e73-9c6c-57407fa323fe None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.350479 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57223df8-dc31-4e73-9c6c-57407fa323fe None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.350827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57223df8-dc31-4e73-9c6c-57407fa323fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.367547 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ce78fe18-3957-42d7-8f50-9e1490c05991 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:51.368643 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ce78fe18-3957-42d7-8f50-9e1490c05991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:51.369869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-57223df8-dc31-4e73-9c6c-57407fa323fe None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:51.371037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-57223df8-dc31-4e73-9c6c-57407fa323fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:51.376300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 769/1557] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:51.377092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78fe18-3957-42d7-8f50-9e1490c05991 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.382823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 789/1558] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:51.382823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57223df8-dc31-4e73-9c6c-57407fa323fe None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.386831 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78fe18-3957-42d7-8f50-9e1490c05991 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.391283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517d238-64d6-442e-9c49-28f8dcf6712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.391862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d238-64d6-442e-9c49-28f8dcf6712a admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.391987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57223df8-dc31-4e73-9c6c-57407fa323fe None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.392147 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d238-64d6-442e-9c49-28f8dcf6712a admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.392407 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d238-64d6-442e-9c49-28f8dcf6712a admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.393103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517d238-64d6-442e-9c49-28f8dcf6712a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:51:51.393399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517d238-64d6-442e-9c49-28f8dcf6712a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.394401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: WARNING py.warnings [None req-d517d238-64d6-442e-9c49-28f8dcf6712a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 08:51:51.394401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: warnings.warn(msg) Aug 26 08:51:51.394401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: Aug 26 08:51:51.395260 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517d238-64d6-442e-9c49-28f8dcf6712a admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.396732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58911b59-cb6b-40d4-bff3-02f8bc3e8719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.397358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58911b59-cb6b-40d4-bff3-02f8bc3e8719 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.397642 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58911b59-cb6b-40d4-bff3-02f8bc3e8719 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.397915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58911b59-cb6b-40d4-bff3-02f8bc3e8719 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.398550 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58911b59-cb6b-40d4-bff3-02f8bc3e8719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:51:51.398857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58911b59-cb6b-40d4-bff3-02f8bc3e8719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.400430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58911b59-cb6b-40d4-bff3-02f8bc3e8719 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.407436 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 770/1559] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:51:51.408213 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517d238-64d6-442e-9c49-28f8dcf6712a admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.418906 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 790/1560] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:51:51.418906 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0161c8-1614-4728-8b99-b576803e46db None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.418906 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0161c8-1614-4728-8b99-b576803e46db None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.418906 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0161c8-1614-4728-8b99-b576803e46db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.420585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517d238-64d6-442e-9c49-28f8dcf6712a admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.426068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d6494-b83b-44fd-b66e-104fef795672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.426749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d6494-b83b-44fd-b66e-104fef795672 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.427033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d6494-b83b-44fd-b66e-104fef795672 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.427312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d6494-b83b-44fd-b66e-104fef795672 admin admin] PATH_INFO: `/v3/projects/981a309f5874434c9bd21d627248c34f/users/c4310623b295488486ed8918d03b9503/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.434599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-dc0161c8-1614-4728-8b99-b576803e46db None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:51.435795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-dc0161c8-1614-4728-8b99-b576803e46db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:51.442184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d6494-b83b-44fd-b66e-104fef795672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=981a309f5874434c9bd21d627248c34f, user_id=c4310623b295488486ed8918d03b9503, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.444081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 791/1561] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:51.444814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d6494-b83b-44fd-b66e-104fef795672 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.444930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0161c8-1614-4728-8b99-b576803e46db None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.454260 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0161c8-1614-4728-8b99-b576803e46db None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.459076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 771/1562] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:51:51 2022] PUT /identity/v3/projects/981a309f5874434c9bd21d627248c34f/users/c4310623b295488486ed8918d03b9503/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:51.460058 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317c120-c3be-4b2c-b47a-2424dc637e9d None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.460342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317c120-c3be-4b2c-b47a-2424dc637e9d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.460618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317c120-c3be-4b2c-b47a-2424dc637e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.479783 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-4317c120-c3be-4b2c-b47a-2424dc637e9d None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:51.480975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-4317c120-c3be-4b2c-b47a-2424dc637e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:51.515789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:51.523680 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:51.524211 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8385f-0276-4047-9a26-79aeb24284d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.525284 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8385f-0276-4047-9a26-79aeb24284d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.525682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8385f-0276-4047-9a26-79aeb24284d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.526146 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8385f-0276-4047-9a26-79aeb24284d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.526888 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8385f-0276-4047-9a26-79aeb24284d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:51:51.527276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8385f-0276-4047-9a26-79aeb24284d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.529165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8385f-0276-4047-9a26-79aeb24284d8 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.541113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 792/1563] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:51:51.542074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 772/1564] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:51.545755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8385f-0276-4047-9a26-79aeb24284d8 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.545867 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317c120-c3be-4b2c-b47a-2424dc637e9d None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.552752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317c120-c3be-4b2c-b47a-2424dc637e9d None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.556398 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8385f-0276-4047-9a26-79aeb24284d8 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.558123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f7613-f32e-4e95-baa7-74e6e49516fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.558709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f7613-f32e-4e95-baa7-74e6e49516fd admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.558989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f7613-f32e-4e95-baa7-74e6e49516fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.559264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f7613-f32e-4e95-baa7-74e6e49516fd admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.559906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f7613-f32e-4e95-baa7-74e6e49516fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:51:51.560208 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f7613-f32e-4e95-baa7-74e6e49516fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.561461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37456d-e713-4c3b-9550-66f01ea1d241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.561830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f7613-f32e-4e95-baa7-74e6e49516fd admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.562199 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37456d-e713-4c3b-9550-66f01ea1d241 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.562613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37456d-e713-4c3b-9550-66f01ea1d241 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.562966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37456d-e713-4c3b-9550-66f01ea1d241 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.563670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37456d-e713-4c3b-9550-66f01ea1d241 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:51:51.564100 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37456d-e713-4c3b-9550-66f01ea1d241 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.566437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37456d-e713-4c3b-9550-66f01ea1d241 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.575428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 773/1565] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:51:51.575628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f7613-f32e-4e95-baa7-74e6e49516fd admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.589940 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 793/1566] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:51:51.589940 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37456d-e713-4c3b-9550-66f01ea1d241 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.590238 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f7613-f32e-4e95-baa7-74e6e49516fd admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.596039 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37456d-e713-4c3b-9550-66f01ea1d241 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.598525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e982589-630b-4679-8824-4e1e34b3b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.599134 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e982589-630b-4679-8824-4e1e34b3b7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.599418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e982589-630b-4679-8824-4e1e34b3b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.599698 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e982589-630b-4679-8824-4e1e34b3b7e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.600329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e982589-630b-4679-8824-4e1e34b3b7e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.600875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaed756-9e61-435e-a4e4-efdd6f629dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.601525 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaed756-9e61-435e-a4e4-efdd6f629dff admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.601809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaed756-9e61-435e-a4e4-efdd6f629dff admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.602086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaed756-9e61-435e-a4e4-efdd6f629dff admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.602270 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e982589-630b-4679-8824-4e1e34b3b7e4 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.602884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaed756-9e61-435e-a4e4-efdd6f629dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.603912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: WARNING py.warnings [None req-6aaed756-9e61-435e-a4e4-efdd6f629dff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 08:51:51.603912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: warnings.warn(msg) Aug 26 08:51:51.603912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: Aug 26 08:51:51.605121 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaed756-9e61-435e-a4e4-efdd6f629dff admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.631826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 774/1567] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:51.632718 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e982589-630b-4679-8824-4e1e34b3b7e4 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.640105 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 794/1568] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:51.640105 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91fb5d-b591-4f44-88e2-7c07584bdaa8 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.640105 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91fb5d-b591-4f44-88e2-7c07584bdaa8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.640105 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91fb5d-b591-4f44-88e2-7c07584bdaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.665650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-1b91fb5d-b591-4f44-88e2-7c07584bdaa8 None None] MFA Rules not processed for user `c4310623b295488486ed8918d03b9503`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:51.666853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1b91fb5d-b591-4f44-88e2-7c07584bdaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:51.695387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e982589-630b-4679-8824-4e1e34b3b7e4 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.732031 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 795/1569] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:51.732890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91fb5d-b591-4f44-88e2-7c07584bdaa8 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.759681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b4720-c704-4c39-a43d-32ac40d3607e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.760286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b4720-c704-4c39-a43d-32ac40d3607e admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.760573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b4720-c704-4c39-a43d-32ac40d3607e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.760844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b4720-c704-4c39-a43d-32ac40d3607e admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.761522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b4720-c704-4c39-a43d-32ac40d3607e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:51:51.761878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b4720-c704-4c39-a43d-32ac40d3607e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.763671 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b4720-c704-4c39-a43d-32ac40d3607e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.776015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 775/1570] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:51:51.776943 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b4720-c704-4c39-a43d-32ac40d3607e admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.790878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b4720-c704-4c39-a43d-32ac40d3607e admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.795401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edf408-6be0-40fe-be0c-edf10a192a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.795991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edf408-6be0-40fe-be0c-edf10a192a22 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.796275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edf408-6be0-40fe-be0c-edf10a192a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.796549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edf408-6be0-40fe-be0c-edf10a192a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.797209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edf408-6be0-40fe-be0c-edf10a192a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.799135 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edf408-6be0-40fe-be0c-edf10a192a22 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.802468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91fb5d-b591-4f44-88e2-7c07584bdaa8 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.807051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e61c56-8c26-4374-8ff6-505650802612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.807663 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e61c56-8c26-4374-8ff6-505650802612 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.807975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e61c56-8c26-4374-8ff6-505650802612 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.808255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e61c56-8c26-4374-8ff6-505650802612 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.808908 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e61c56-8c26-4374-8ff6-505650802612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:51:51.809256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e61c56-8c26-4374-8ff6-505650802612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.811148 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e61c56-8c26-4374-8ff6-505650802612 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.823585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 796/1571] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:51:51.824463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e61c56-8c26-4374-8ff6-505650802612 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.828358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 776/1572] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:51.829457 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edf408-6be0-40fe-be0c-edf10a192a22 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.836482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e61c56-8c26-4374-8ff6-505650802612 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.862998 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:51.873125 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:51.893115 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edf408-6be0-40fe-be0c-edf10a192a22 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.896632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d74c77-b817-443c-8d88-693770844557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.897367 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d74c77-b817-443c-8d88-693770844557 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.897561 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafb74a-8c3e-4801-be8b-8800768522c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.897840 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d74c77-b817-443c-8d88-693770844557 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.898158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafb74a-8c3e-4801-be8b-8800768522c6 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.898286 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d74c77-b817-443c-8d88-693770844557 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.898448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafb74a-8c3e-4801-be8b-8800768522c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.898761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafb74a-8c3e-4801-be8b-8800768522c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.899015 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d74c77-b817-443c-8d88-693770844557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.899495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafb74a-8c3e-4801-be8b-8800768522c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.900870 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d74c77-b817-443c-8d88-693770844557 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.901436 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafb74a-8c3e-4801-be8b-8800768522c6 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:51.930514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 797/1573] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:51.930514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d74c77-b817-443c-8d88-693770844557 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.930829 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 777/1574] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:51.930829 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafb74a-8c3e-4801-be8b-8800768522c6 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:51.993139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d74c77-b817-443c-8d88-693770844557 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.993781 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafb74a-8c3e-4801-be8b-8800768522c6 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:51.997718 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424b756-1725-4949-8501-cbb62bf79965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.998317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424b756-1725-4949-8501-cbb62bf79965 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.998564 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3202d27-9873-4ef7-aa20-b456f4921a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:51.998718 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424b756-1725-4949-8501-cbb62bf79965 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.998862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424b756-1725-4949-8501-cbb62bf79965 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:51.999173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3202d27-9873-4ef7-aa20-b456f4921a01 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:51.999457 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3202d27-9873-4ef7-aa20-b456f4921a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:51.999565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424b756-1725-4949-8501-cbb62bf79965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:51.999748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3202d27-9873-4ef7-aa20-b456f4921a01 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.000385 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3202d27-9873-4ef7-aa20-b456f4921a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.001418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: WARNING py.warnings [None req-e3202d27-9873-4ef7-aa20-b456f4921a01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 08:51:52.001418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: warnings.warn(msg) Aug 26 08:51:52.001418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: Aug 26 08:51:52.001686 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424b756-1725-4949-8501-cbb62bf79965 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.002652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3202d27-9873-4ef7-aa20-b456f4921a01 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.024509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 798/1575] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:52.028034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 778/1576] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:51:51 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:52.028188 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504429a5-7c94-4def-9f39-f44140c6948a None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.028188 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504429a5-7c94-4def-9f39-f44140c6948a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.028397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3202d27-9873-4ef7-aa20-b456f4921a01 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.028497 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504429a5-7c94-4def-9f39-f44140c6948a None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.028497 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 799/1577] 10.222.0.76 () {54 vars in 962 bytes} [Fri Aug 26 08:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:51:52.029841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504429a5-7c94-4def-9f39-f44140c6948a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.037220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3202d27-9873-4ef7-aa20-b456f4921a01 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.041818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e3e82-aaa1-4029-8ee1-bf18ac817990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.042414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e3e82-aaa1-4029-8ee1-bf18ac817990 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.042697 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e3e82-aaa1-4029-8ee1-bf18ac817990 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.042973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e3e82-aaa1-4029-8ee1-bf18ac817990 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.043435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504429a5-7c94-4def-9f39-f44140c6948a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.043590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e3e82-aaa1-4029-8ee1-bf18ac817990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.045573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e3e82-aaa1-4029-8ee1-bf18ac817990 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.047898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88776cd9-e01b-40fd-98fb-dbd5f622d676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.048482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88776cd9-e01b-40fd-98fb-dbd5f622d676 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.048768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88776cd9-e01b-40fd-98fb-dbd5f622d676 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.049092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88776cd9-e01b-40fd-98fb-dbd5f622d676 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.049839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88776cd9-e01b-40fd-98fb-dbd5f622d676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.051624 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88776cd9-e01b-40fd-98fb-dbd5f622d676 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.072834 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 779/1578] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:51:52 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:52.073827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e3e82-aaa1-4029-8ee1-bf18ac817990 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.080104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 800/1579] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:51:52 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:52.081321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88776cd9-e01b-40fd-98fb-dbd5f622d676 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.139258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e3e82-aaa1-4029-8ee1-bf18ac817990 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.150901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88776cd9-e01b-40fd-98fb-dbd5f622d676 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.155553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fe393-5dbe-4c9d-b979-92a928056d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.156163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fe393-5dbe-4c9d-b979-92a928056d0d admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.156450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fe393-5dbe-4c9d-b979-92a928056d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.156728 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fe393-5dbe-4c9d-b979-92a928056d0d admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.157390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fe393-5dbe-4c9d-b979-92a928056d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.159894 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fe393-5dbe-4c9d-b979-92a928056d0d admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.168293 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:52.181225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 801/1580] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:51:52 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:52.182107 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fe393-5dbe-4c9d-b979-92a928056d0d admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.191913 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fe393-5dbe-4c9d-b979-92a928056d0d admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.196721 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8322d0e-d7ed-4c3b-8f43-d5070f073312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.197427 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8322d0e-d7ed-4c3b-8f43-d5070f073312 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.197817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8322d0e-d7ed-4c3b-8f43-d5070f073312 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.198181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8322d0e-d7ed-4c3b-8f43-d5070f073312 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.198312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69519916-c52e-4f1f-be44-046e16e46c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.198922 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519916-c52e-4f1f-be44-046e16e46c95 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.199052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8322d0e-d7ed-4c3b-8f43-d5070f073312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.199335 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519916-c52e-4f1f-be44-046e16e46c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.199640 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519916-c52e-4f1f-be44-046e16e46c95 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.200316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69519916-c52e-4f1f-be44-046e16e46c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.201228 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8322d0e-d7ed-4c3b-8f43-d5070f073312 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.202173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69519916-c52e-4f1f-be44-046e16e46c95 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.223805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 802/1581] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:51:52 2022] POST /identity/v3/users => generated 303 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:52.224708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8322d0e-d7ed-4c3b-8f43-d5070f073312 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.225426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 780/1582] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:51:52 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:52.226438 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69519916-c52e-4f1f-be44-046e16e46c95 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.232565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:52.236662 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69519916-c52e-4f1f-be44-046e16e46c95 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.238268 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8322d0e-d7ed-4c3b-8f43-d5070f073312 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.241370 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb11e6-d2e1-4156-b51f-f2f300fa4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.241961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb11e6-d2e1-4156-b51f-f2f300fa4713 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.242236 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb11e6-d2e1-4156-b51f-f2f300fa4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.242509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb11e6-d2e1-4156-b51f-f2f300fa4713 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.243144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb11e6-d2e1-4156-b51f-f2f300fa4713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.243996 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee430b-9c2d-4768-8b31-93dee65e57a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.244619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee430b-9c2d-4768-8b31-93dee65e57a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.244734 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb11e6-d2e1-4156-b51f-f2f300fa4713 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.244901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee430b-9c2d-4768-8b31-93dee65e57a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.245205 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee430b-9c2d-4768-8b31-93dee65e57a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.245995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee430b-9c2d-4768-8b31-93dee65e57a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.247578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee430b-9c2d-4768-8b31-93dee65e57a8 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.257698 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 781/1583] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:52.257698 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405b29d-da49-4031-a0b5-127fbd9e08cf None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.257698 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405b29d-da49-4031-a0b5-127fbd9e08cf None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.257698 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405b29d-da49-4031-a0b5-127fbd9e08cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.271740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 803/1584] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:52.271740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee430b-9c2d-4768-8b31-93dee65e57a8 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.279199 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee430b-9c2d-4768-8b31-93dee65e57a8 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.284459 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2293a0d-c197-419d-a805-10eddd7c4ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.285075 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2293a0d-c197-419d-a805-10eddd7c4ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.285359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2293a0d-c197-419d-a805-10eddd7c4ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.285632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2293a0d-c197-419d-a805-10eddd7c4ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.286246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2293a0d-c197-419d-a805-10eddd7c4ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.288150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2293a0d-c197-419d-a805-10eddd7c4ed2 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.297984 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-1405b29d-da49-4031-a0b5-127fbd9e08cf None None] MFA Rules not processed for user `b63d6e588f6e4b598b75a2ec13bea25d`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:52.299459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1405b29d-da49-4031-a0b5-127fbd9e08cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:52.308211 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 804/1585] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:51:52 2022] POST /identity/v3/users => generated 287 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:52.309014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2293a0d-c197-419d-a805-10eddd7c4ed2 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.318216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2293a0d-c197-419d-a805-10eddd7c4ed2 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.323032 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1dc3ff-5525-4d4d-b311-64fe725fac3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.323626 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dc3ff-5525-4d4d-b311-64fe725fac3c admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.323911 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dc3ff-5525-4d4d-b311-64fe725fac3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.324194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dc3ff-5525-4d4d-b311-64fe725fac3c admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.324815 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1dc3ff-5525-4d4d-b311-64fe725fac3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.327013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1dc3ff-5525-4d4d-b311-64fe725fac3c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.351226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 805/1586] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:51:52 2022] POST /identity/v3/users => generated 292 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:52.351226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1dc3ff-5525-4d4d-b311-64fe725fac3c admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.358507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1dc3ff-5525-4d4d-b311-64fe725fac3c admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.363220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e5f8d-e1cb-404f-9019-be2e29c9fc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.363797 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e5f8d-e1cb-404f-9019-be2e29c9fc8f admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.364083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e5f8d-e1cb-404f-9019-be2e29c9fc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.364360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e5f8d-e1cb-404f-9019-be2e29c9fc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.365078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e5f8d-e1cb-404f-9019-be2e29c9fc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.366642 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e5f8d-e1cb-404f-9019-be2e29c9fc8f admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.373061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 782/1587] 10.222.0.76 () {58 vars in 1059 bytes} [Fri Aug 26 08:51:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:52.373900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405b29d-da49-4031-a0b5-127fbd9e08cf None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.380982 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 806/1588] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:52.380982 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e5f8d-e1cb-404f-9019-be2e29c9fc8f admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.386552 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405b29d-da49-4031-a0b5-127fbd9e08cf None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.388532 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e5f8d-e1cb-404f-9019-be2e29c9fc8f admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.391088 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c863f6-4ecc-4267-8ca8-063d916c8246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.391677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c863f6-4ecc-4267-8ca8-063d916c8246 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.391960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c863f6-4ecc-4267-8ca8-063d916c8246 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.392232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c863f6-4ecc-4267-8ca8-063d916c8246 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.392903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c863f6-4ecc-4267-8ca8-063d916c8246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.393638 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db25ff9-ac2f-4abe-b1a5-c90d1e9bd43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.394239 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db25ff9-ac2f-4abe-b1a5-c90d1e9bd43c admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.394519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db25ff9-ac2f-4abe-b1a5-c90d1e9bd43c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.394791 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db25ff9-ac2f-4abe-b1a5-c90d1e9bd43c admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.395048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c863f6-4ecc-4267-8ca8-063d916c8246 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.395412 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db25ff9-ac2f-4abe-b1a5-c90d1e9bd43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.396960 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db25ff9-ac2f-4abe-b1a5-c90d1e9bd43c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.408517 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 783/1589] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:52.408517 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c863f6-4ecc-4267-8ca8-063d916c8246 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.409440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 807/1590] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:52.409440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db25ff9-ac2f-4abe-b1a5-c90d1e9bd43c admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.417559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db25ff9-ac2f-4abe-b1a5-c90d1e9bd43c admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.419799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c863f6-4ecc-4267-8ca8-063d916c8246 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.422110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7d8ba-eb20-44e8-ba10-f75b95b17abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.422688 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7d8ba-eb20-44e8-ba10-f75b95b17abf admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.423007 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7d8ba-eb20-44e8-ba10-f75b95b17abf admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.423276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7d8ba-eb20-44e8-ba10-f75b95b17abf admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.423903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7d8ba-eb20-44e8-ba10-f75b95b17abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.424358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a794713-ea86-4171-ad8f-a8ec1b62a86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.424942 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794713-ea86-4171-ad8f-a8ec1b62a86a admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.425261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794713-ea86-4171-ad8f-a8ec1b62a86a admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.425537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794713-ea86-4171-ad8f-a8ec1b62a86a admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.425664 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7d8ba-eb20-44e8-ba10-f75b95b17abf admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.426173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a794713-ea86-4171-ad8f-a8ec1b62a86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.427734 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a794713-ea86-4171-ad8f-a8ec1b62a86a admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.435181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 808/1591] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:52.435975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7d8ba-eb20-44e8-ba10-f75b95b17abf admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.439197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 784/1592] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:52.440702 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a794713-ea86-4171-ad8f-a8ec1b62a86a admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.445822 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7d8ba-eb20-44e8-ba10-f75b95b17abf admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.450439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d79df2-8814-4178-89d6-170512b085ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.450809 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a794713-ea86-4171-ad8f-a8ec1b62a86a admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.451018 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d79df2-8814-4178-89d6-170512b085ef admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.451302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d79df2-8814-4178-89d6-170512b085ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.451577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d79df2-8814-4178-89d6-170512b085ef admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.452202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d79df2-8814-4178-89d6-170512b085ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.453788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d79df2-8814-4178-89d6-170512b085ef admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.456093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8264b-c6dc-48c1-aad7-67ce18b393f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.456714 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8264b-c6dc-48c1-aad7-67ce18b393f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.457015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8264b-c6dc-48c1-aad7-67ce18b393f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.457307 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8264b-c6dc-48c1-aad7-67ce18b393f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.457938 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8264b-c6dc-48c1-aad7-67ce18b393f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.459482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8264b-c6dc-48c1-aad7-67ce18b393f6 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.464555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 809/1593] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:52.465368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d79df2-8814-4178-89d6-170512b085ef admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.472529 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 785/1594] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:52.473416 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8264b-c6dc-48c1-aad7-67ce18b393f6 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.477796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d79df2-8814-4178-89d6-170512b085ef admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.483648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656838b-5447-4674-84df-44874bad873a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.484280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8264b-c6dc-48c1-aad7-67ce18b393f6 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.484445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656838b-5447-4674-84df-44874bad873a service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.484740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656838b-5447-4674-84df-44874bad873a service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.485036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656838b-5447-4674-84df-44874bad873a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.488819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cca4a-190f-4c19-9f38-b2ccef397223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.489423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cca4a-190f-4c19-9f38-b2ccef397223 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.489701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cca4a-190f-4c19-9f38-b2ccef397223 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.489976 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cca4a-190f-4c19-9f38-b2ccef397223 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.490598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cca4a-190f-4c19-9f38-b2ccef397223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.492140 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cca4a-190f-4c19-9f38-b2ccef397223 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.505222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 786/1595] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:52.505222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cca4a-190f-4c19-9f38-b2ccef397223 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.512425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cca4a-190f-4c19-9f38-b2ccef397223 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.517020 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353213e-81e8-4d68-9693-f4bfdf9786ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.517873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353213e-81e8-4d68-9693-f4bfdf9786ba admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.518724 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353213e-81e8-4d68-9693-f4bfdf9786ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.519003 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353213e-81e8-4d68-9693-f4bfdf9786ba admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.519630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353213e-81e8-4d68-9693-f4bfdf9786ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.521199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353213e-81e8-4d68-9693-f4bfdf9786ba admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.531911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 787/1596] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:52.532758 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353213e-81e8-4d68-9693-f4bfdf9786ba admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.542465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353213e-81e8-4d68-9693-f4bfdf9786ba admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.546750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656838b-5447-4674-84df-44874bad873a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.547162 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbbd77-3c77-4c32-baaa-292f8a8cbe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.547733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbbd77-3c77-4c32-baaa-292f8a8cbe56 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.548016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbbd77-3c77-4c32-baaa-292f8a8cbe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.548292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbbd77-3c77-4c32-baaa-292f8a8cbe56 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.548399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656838b-5447-4674-84df-44874bad873a service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.548914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbbd77-3c77-4c32-baaa-292f8a8cbe56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.550530 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbbd77-3c77-4c32-baaa-292f8a8cbe56 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.557366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 810/1597] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:51:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:51:52.558127 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656838b-5447-4674-84df-44874bad873a service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.564161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 788/1598] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:52.566000 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbbd77-3c77-4c32-baaa-292f8a8cbe56 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.568891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656838b-5447-4674-84df-44874bad873a service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.577440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbbd77-3c77-4c32-baaa-292f8a8cbe56 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.578950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3175c2-26fd-46d6-9f38-fb191e34c2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.579768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3175c2-26fd-46d6-9f38-fb191e34c2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.580057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3175c2-26fd-46d6-9f38-fb191e34c2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.580339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3175c2-26fd-46d6-9f38-fb191e34c2d2 admin admin] PATH_INFO: `/v3/projects/dea40107e44c4077a0d0a5e396b0f823/users/e031367406df4a3d95f2ed9e2eb8efae/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.583173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdbdb9-7d23-44d0-99c6-be98eef21879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.583819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdbdb9-7d23-44d0-99c6-be98eef21879 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.584099 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdbdb9-7d23-44d0-99c6-be98eef21879 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.584375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdbdb9-7d23-44d0-99c6-be98eef21879 admin admin] PATH_INFO: `/v3/projects/f88c5e7347a3409194633c8bd70e1a0a/users/598d44b6fb21463985745e862d0b827f/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.599977 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdbdb9-7d23-44d0-99c6-be98eef21879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f88c5e7347a3409194633c8bd70e1a0a, user_id=598d44b6fb21463985745e862d0b827f, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.600170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3175c2-26fd-46d6-9f38-fb191e34c2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea40107e44c4077a0d0a5e396b0f823, user_id=e031367406df4a3d95f2ed9e2eb8efae, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.601162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: WARNING py.warnings [None req-db3175c2-26fd-46d6-9f38-fb191e34c2d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 08:51:52.601162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: warnings.warn(msg) Aug 26 08:51:52.601162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: Aug 26 08:51:52.602638 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdbdb9-7d23-44d0-99c6-be98eef21879 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.603095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3175c2-26fd-46d6-9f38-fb191e34c2d2 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.612855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:52.618402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 811/1600] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:51:52 2022] PUT /identity/v3/projects/dea40107e44c4077a0d0a5e396b0f823/users/e031367406df4a3d95f2ed9e2eb8efae/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:52.618581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 789/1600] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:51:52 2022] PUT /identity/v3/projects/f88c5e7347a3409194633c8bd70e1a0a/users/598d44b6fb21463985745e862d0b827f/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:52.619355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3175c2-26fd-46d6-9f38-fb191e34c2d2 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.619754 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdbdb9-7d23-44d0-99c6-be98eef21879 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.672514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:52.688581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdbdb9-7d23-44d0-99c6-be98eef21879 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.688845 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3175c2-26fd-46d6-9f38-fb191e34c2d2 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.694307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ccc06-8bc1-4945-96b4-70df0e7da7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.695013 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb42b2d-1fb5-4205-b9dc-af4417c1cd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.695166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ccc06-8bc1-4945-96b4-70df0e7da7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.695366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ccc06-8bc1-4945-96b4-70df0e7da7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.695640 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ccc06-8bc1-4945-96b4-70df0e7da7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.696203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb42b2d-1fb5-4205-b9dc-af4417c1cd61 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.696332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ccc06-8bc1-4945-96b4-70df0e7da7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.696757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb42b2d-1fb5-4205-b9dc-af4417c1cd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.697211 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb42b2d-1fb5-4205-b9dc-af4417c1cd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.697897 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ccc06-8bc1-4945-96b4-70df0e7da7c6 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.698180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb42b2d-1fb5-4205-b9dc-af4417c1cd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.700412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb42b2d-1fb5-4205-b9dc-af4417c1cd61 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.711782 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 812/1601] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:52.711782 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ccc06-8bc1-4945-96b4-70df0e7da7c6 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.715409 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 790/1602] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:52.716372 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb42b2d-1fb5-4205-b9dc-af4417c1cd61 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.722491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ccc06-8bc1-4945-96b4-70df0e7da7c6 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.727127 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaf7b5-bcb3-4148-94b5-d9d79ed9792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.727766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf7b5-bcb3-4148-94b5-d9d79ed9792b admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.728055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf7b5-bcb3-4148-94b5-d9d79ed9792b admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.728331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf7b5-bcb3-4148-94b5-d9d79ed9792b admin admin] PATH_INFO: `/v3/projects/a1d3ea5ec9cd42e8b6cac6d60f15a652/users/0479c86d4cfc40c8a811a390bfd53152/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.731844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb42b2d-1fb5-4205-b9dc-af4417c1cd61 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.737455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474eb054-34dd-4297-9aec-97012b569f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.738251 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eb054-34dd-4297-9aec-97012b569f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.738534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eb054-34dd-4297-9aec-97012b569f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.738852 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eb054-34dd-4297-9aec-97012b569f06 admin admin] PATH_INFO: `/v3/projects/9595989d0802422abd77617455ffee03/users/659a481dcc034fa2a9f0e1de33f50ef6/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.743738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaf7b5-bcb3-4148-94b5-d9d79ed9792b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d3ea5ec9cd42e8b6cac6d60f15a652, user_id=0479c86d4cfc40c8a811a390bfd53152, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.746497 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaf7b5-bcb3-4148-94b5-d9d79ed9792b admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.756289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474eb054-34dd-4297-9aec-97012b569f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9595989d0802422abd77617455ffee03, user_id=659a481dcc034fa2a9f0e1de33f50ef6, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.758946 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474eb054-34dd-4297-9aec-97012b569f06 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.761520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 813/1603] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:51:52 2022] PUT /identity/v3/projects/a1d3ea5ec9cd42e8b6cac6d60f15a652/users/0479c86d4cfc40c8a811a390bfd53152/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:52.762203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaf7b5-bcb3-4148-94b5-d9d79ed9792b admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.778734 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 791/1604] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:51:52 2022] PUT /identity/v3/projects/9595989d0802422abd77617455ffee03/users/659a481dcc034fa2a9f0e1de33f50ef6/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:52.786951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facaf86-5e7e-4045-a4ac-23edc6bbfb61 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.793706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facaf86-5e7e-4045-a4ac-23edc6bbfb61 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.795106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facaf86-5e7e-4045-a4ac-23edc6bbfb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.814310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-9facaf86-5e7e-4045-a4ac-23edc6bbfb61 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:52.815852 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-9facaf86-5e7e-4045-a4ac-23edc6bbfb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:52.840235 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaf7b5-bcb3-4148-94b5-d9d79ed9792b admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.882267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 792/1605] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:52.883636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cd93c-8ee9-4f33-8bbd-0db2fe8ccf82 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.884022 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cd93c-8ee9-4f33-8bbd-0db2fe8ccf82 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.884394 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cd93c-8ee9-4f33-8bbd-0db2fe8ccf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.904378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae7edc-2b8b-4f90-bb20-df392d889013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:52.905086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae7edc-2b8b-4f90-bb20-df392d889013 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:52.905372 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae7edc-2b8b-4f90-bb20-df392d889013 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:52.905650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae7edc-2b8b-4f90-bb20-df392d889013 admin admin] PATH_INFO: `/v3/projects/79f37046a1eb42a9baa2825bef421c59/users/798c692df3b141849d5a4427b3cd1e6c/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:52.911310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-108cd93c-8ee9-4f33-8bbd-0db2fe8ccf82 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:52.912638 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-108cd93c-8ee9-4f33-8bbd-0db2fe8ccf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:52.921648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae7edc-2b8b-4f90-bb20-df392d889013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f37046a1eb42a9baa2825bef421c59, user_id=798c692df3b141849d5a4427b3cd1e6c, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:52.924504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae7edc-2b8b-4f90-bb20-df392d889013 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:52.925752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 793/1606] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:52.927074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cd93c-8ee9-4f33-8bbd-0db2fe8ccf82 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.938606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cd93c-8ee9-4f33-8bbd-0db2fe8ccf82 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:52.941085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 814/1607] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:51:52 2022] PUT /identity/v3/projects/79f37046a1eb42a9baa2825bef421c59/users/798c692df3b141849d5a4427b3cd1e6c/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:52.941947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae7edc-2b8b-4f90-bb20-df392d889013 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:52.993331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:53.004126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6700b-c03c-46fe-ba04-03cf4cb72f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:53.005218 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6700b-c03c-46fe-ba04-03cf4cb72f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.005668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6700b-c03c-46fe-ba04-03cf4cb72f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.006099 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6700b-c03c-46fe-ba04-03cf4cb72f67 admin admin] PATH_INFO: `/v3/projects/5293e13de5704f40b856b251e0064560/users/3a5b31b0082442d38c6d62b79e9c91b8/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.015159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae7edc-2b8b-4f90-bb20-df392d889013 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:53.036365 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:53.036472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888842c-8331-41ce-88e6-683eaeaa33a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:53.036472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888842c-8331-41ce-88e6-683eaeaa33a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.036472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888842c-8331-41ce-88e6-683eaeaa33a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.036723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888842c-8331-41ce-88e6-683eaeaa33a4 admin admin] PATH_INFO: `/v3/projects/4c42cd7f76934fc89de8ef4ba7946873/users/73233b4755c54002b51edeeb688d659c/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.045484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6700b-c03c-46fe-ba04-03cf4cb72f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5293e13de5704f40b856b251e0064560, user_id=3a5b31b0082442d38c6d62b79e9c91b8, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:53.055038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6700b-c03c-46fe-ba04-03cf4cb72f67 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:53.078073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 794/1608] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:51:52 2022] PUT /identity/v3/projects/5293e13de5704f40b856b251e0064560/users/3a5b31b0082442d38c6d62b79e9c91b8/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:53.080158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc82dd-551c-48e3-a32a-0f1cdd8402aa None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.081789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc82dd-551c-48e3-a32a-0f1cdd8402aa None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.082177 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc82dd-551c-48e3-a32a-0f1cdd8402aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.083693 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888842c-8331-41ce-88e6-683eaeaa33a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c42cd7f76934fc89de8ef4ba7946873, user_id=73233b4755c54002b51edeeb688d659c, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:53.087330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888842c-8331-41ce-88e6-683eaeaa33a4 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:53.104734 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-5dbc82dd-551c-48e3-a32a-0f1cdd8402aa None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:53.105698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 815/1609] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:51:52 2022] PUT /identity/v3/projects/4c42cd7f76934fc89de8ef4ba7946873/users/73233b4755c54002b51edeeb688d659c/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:53.106774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5dbc82dd-551c-48e3-a32a-0f1cdd8402aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:53.107165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d2353-2ff5-4df4-a557-659657020637 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.107458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d2353-2ff5-4df4-a557-659657020637 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.107737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d2353-2ff5-4df4-a557-659657020637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.161924 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-449d2353-2ff5-4df4-a557-659657020637 None None] MFA Rules not processed for user `659a481dcc034fa2a9f0e1de33f50ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:53.163148 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-449d2353-2ff5-4df4-a557-659657020637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:53.208200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 795/1610] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:53.209477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc82dd-551c-48e3-a32a-0f1cdd8402aa None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:53.211527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5dbc82dd-551c-48e3-a32a-0f1cdd8402aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:53.246126 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 816/1611] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:53 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:53.247500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d2353-2ff5-4df4-a557-659657020637 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:53.248972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-449d2353-2ff5-4df4-a557-659657020637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:53.281847 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc82dd-551c-48e3-a32a-0f1cdd8402aa None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:53.287232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7e4f9-d9af-495b-b28d-4e530f2aaf46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:53.288109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7e4f9-d9af-495b-b28d-4e530f2aaf46 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.288399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7e4f9-d9af-495b-b28d-4e530f2aaf46 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.288679 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7e4f9-d9af-495b-b28d-4e530f2aaf46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.300262 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7e4f9-d9af-495b-b28d-4e530f2aaf46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:53.301997 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7e4f9-d9af-495b-b28d-4e530f2aaf46 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:53.312237 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 796/1612] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:51:53.313618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265c00d-fdd5-4abf-a367-736b458ae51b None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.314026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265c00d-fdd5-4abf-a367-736b458ae51b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.314414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265c00d-fdd5-4abf-a367-736b458ae51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.317264 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d2353-2ff5-4df4-a557-659657020637 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:53.323079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28c322-b8ce-4e0a-872b-1a38ce11fb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:53.323722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28c322-b8ce-4e0a-872b-1a38ce11fb4b service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.323989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28c322-b8ce-4e0a-872b-1a38ce11fb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.324267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28c322-b8ce-4e0a-872b-1a38ce11fb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.337199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-7265c00d-fdd5-4abf-a367-736b458ae51b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:53.337814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28c322-b8ce-4e0a-872b-1a38ce11fb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:53.338766 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7265c00d-fdd5-4abf-a367-736b458ae51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:53.340370 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28c322-b8ce-4e0a-872b-1a38ce11fb4b service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:53.348725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 797/1613] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:53.350322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9d038-8519-49df-9450-b45ed18aa9b8 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.350666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9d038-8519-49df-9450-b45ed18aa9b8 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.350989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9d038-8519-49df-9450-b45ed18aa9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.353496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 817/1614] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:51:53.354805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d897a-3566-4ae8-b8ff-91451402028e None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.355298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d897a-3566-4ae8-b8ff-91451402028e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.355670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d897a-3566-4ae8-b8ff-91451402028e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.383451 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-a1e9d038-8519-49df-9450-b45ed18aa9b8 None None] MFA Rules not processed for user `3a5b31b0082442d38c6d62b79e9c91b8`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:53.384875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a1e9d038-8519-49df-9450-b45ed18aa9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:53.386247 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-e29d897a-3566-4ae8-b8ff-91451402028e None None] MFA Rules not processed for user `73233b4755c54002b51edeeb688d659c`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:53.387489 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e29d897a-3566-4ae8-b8ff-91451402028e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:53.452296 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:53.462768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 798/1615] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:53.464043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408e9ca-4c4f-4484-8cb7-0b0bd31a9ae9 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.464178 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 818/1616] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:53.464324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408e9ca-4c4f-4484-8cb7-0b0bd31a9ae9 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.464724 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408e9ca-4c4f-4484-8cb7-0b0bd31a9ae9 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.465200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d897a-3566-4ae8-b8ff-91451402028e None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:53.465991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 799/1617] 10.222.0.76 () {54 vars in 962 bytes} [Fri Aug 26 08:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:51:53.472091 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408e9ca-4c4f-4484-8cb7-0b0bd31a9ae9 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:53.486106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d897a-3566-4ae8-b8ff-91451402028e None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:53.486483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408e9ca-4c4f-4484-8cb7-0b0bd31a9ae9 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:53.490414 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe39557-2952-47f6-9b8f-96a6bca8dffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:53.491082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe39557-2952-47f6-9b8f-96a6bca8dffc service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.491371 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe39557-2952-47f6-9b8f-96a6bca8dffc service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.491647 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe39557-2952-47f6-9b8f-96a6bca8dffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.491874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3cca7-8f4f-48a1-b33c-891e628b73b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:53.492483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3cca7-8f4f-48a1-b33c-891e628b73b2 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.492765 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3cca7-8f4f-48a1-b33c-891e628b73b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.493084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3cca7-8f4f-48a1-b33c-891e628b73b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.494022 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3cca7-8f4f-48a1-b33c-891e628b73b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:53.496236 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3cca7-8f4f-48a1-b33c-891e628b73b2 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:53.503439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe39557-2952-47f6-9b8f-96a6bca8dffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:53.504889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe39557-2952-47f6-9b8f-96a6bca8dffc service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:53.509242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:53.518888 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 819/1618] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:51:53.519737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe39557-2952-47f6-9b8f-96a6bca8dffc service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:53.529290 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 800/1619] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:51:53 2022] POST /identity/v3/projects => generated 403 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:53.529519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe39557-2952-47f6-9b8f-96a6bca8dffc service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:53.530335 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3cca7-8f4f-48a1-b33c-891e628b73b2 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:53.598528 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f02e4-4848-40ad-b74f-29600f92a06d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:53.599186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f02e4-4848-40ad-b74f-29600f92a06d service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.599472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f02e4-4848-40ad-b74f-29600f92a06d service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.599754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f02e4-4848-40ad-b74f-29600f92a06d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.617724 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3cca7-8f4f-48a1-b33c-891e628b73b2 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:53.623789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ead9bb-6c75-411d-b672-e20b49c9c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:53.624678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ead9bb-6c75-411d-b672-e20b49c9c93f admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.624955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ead9bb-6c75-411d-b672-e20b49c9c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.625271 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ead9bb-6c75-411d-b672-e20b49c9c93f admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.625924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ead9bb-6c75-411d-b672-e20b49c9c93f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:53.628394 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ead9bb-6c75-411d-b672-e20b49c9c93f admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:53.663203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 801/1620] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:51:53 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:53.663203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4668d-0e22-4d9a-a864-678a91a53c34 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.663203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4668d-0e22-4d9a-a864-678a91a53c34 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.663203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4668d-0e22-4d9a-a864-678a91a53c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.682473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f02e4-4848-40ad-b74f-29600f92a06d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:53.683679 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-3bb4668d-0e22-4d9a-a864-678a91a53c34 None None] MFA Rules not processed for user `b63d6e588f6e4b598b75a2ec13bea25d`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:53.684424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f02e4-4848-40ad-b74f-29600f92a06d service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:53.684908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3bb4668d-0e22-4d9a-a864-678a91a53c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:53.697379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 820/1621] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:51:53.698569 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f02e4-4848-40ad-b74f-29600f92a06d service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:53.771391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 802/1622] 10.222.0.76 () {58 vars in 1059 bytes} [Fri Aug 26 08:51:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:53.777131 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4668d-0e22-4d9a-a864-678a91a53c34 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:53.797021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f02e4-4848-40ad-b74f-29600f92a06d service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:53.804144 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ecd88-1591-4ca7-99c6-b798847fc19b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:53.804979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ecd88-1591-4ca7-99c6-b798847fc19b service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.805365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ecd88-1591-4ca7-99c6-b798847fc19b service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.805717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ecd88-1591-4ca7-99c6-b798847fc19b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.836953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:53.863311 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4668d-0e22-4d9a-a864-678a91a53c34 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:53.868729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a793c6d-b0d6-4443-9a4c-2e8f98008dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:53.869221 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a793c6d-b0d6-4443-9a4c-2e8f98008dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.869726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a793c6d-b0d6-4443-9a4c-2e8f98008dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.870061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a793c6d-b0d6-4443-9a4c-2e8f98008dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.871300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a793c6d-b0d6-4443-9a4c-2e8f98008dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:53.873142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a793c6d-b0d6-4443-9a4c-2e8f98008dd7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:53.878423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ecd88-1591-4ca7-99c6-b798847fc19b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:53.880127 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ecd88-1591-4ca7-99c6-b798847fc19b service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:53.891943 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 821/1623] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:51:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:51:53.892785 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ecd88-1591-4ca7-99c6-b798847fc19b service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:53.894720 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:53.906686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 803/1624] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:51:53 2022] POST /identity/v3/users => generated 308 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:53.907215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1f803-e813-4648-805f-5a840241fa9b None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.907651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1f803-e813-4648-805f-5a840241fa9b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.907989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1f803-e813-4648-805f-5a840241fa9b None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.916148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 804/1625] 10.222.0.76 () {54 vars in 912 bytes} [Fri Aug 26 08:51:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:51:53.917748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1f803-e813-4648-805f-5a840241fa9b None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:53.919426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ecd88-1591-4ca7-99c6-b798847fc19b service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:53.930017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eeb62a-794b-497e-8b68-120f5be49ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:53.930017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eeb62a-794b-497e-8b68-120f5be49ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.930017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eeb62a-794b-497e-8b68-120f5be49ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.930017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eeb62a-794b-497e-8b68-120f5be49ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.930778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eeb62a-794b-497e-8b68-120f5be49ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:53.932500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eeb62a-794b-497e-8b68-120f5be49ac7 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:53.949231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1f803-e813-4648-805f-5a840241fa9b None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:53.957888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eaaa8-b745-4c85-b8b4-c7bb9db6bcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:53.958959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eaaa8-b745-4c85-b8b4-c7bb9db6bcff admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.959245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eaaa8-b745-4c85-b8b4-c7bb9db6bcff admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.959613 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eaaa8-b745-4c85-b8b4-c7bb9db6bcff admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.960314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4eaaa8-b745-4c85-b8b4-c7bb9db6bcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:53.962994 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4eaaa8-b745-4c85-b8b4-c7bb9db6bcff admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:53.965110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 822/1626] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:51:53 2022] POST /identity/v3/users => generated 292 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:53.966482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797265b-28ef-47ba-a3ea-ecea0e1e9a69 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:53.966955 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797265b-28ef-47ba-a3ea-ecea0e1e9a69 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:53.967501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797265b-28ef-47ba-a3ea-ecea0e1e9a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:53.983188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 805/1627] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:53.984266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eaaa8-b745-4c85-b8b4-c7bb9db6bcff admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:53.990194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-e797265b-28ef-47ba-a3ea-ecea0e1e9a69 None None] MFA Rules not processed for user `b63d6e588f6e4b598b75a2ec13bea25d`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:53.991478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e797265b-28ef-47ba-a3ea-ecea0e1e9a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:53.997443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eaaa8-b745-4c85-b8b4-c7bb9db6bcff admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:54.003095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 823/1628] 10.222.0.76 () {58 vars in 1009 bytes} [Fri Aug 26 08:51:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:54.004063 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797265b-28ef-47ba-a3ea-ecea0e1e9a69 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:54.013740 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ca81a-bbed-49c1-8601-8411ab44bdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:54.014430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ca81a-bbed-49c1-8601-8411ab44bdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:54.014706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ca81a-bbed-49c1-8601-8411ab44bdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:54.014984 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ca81a-bbed-49c1-8601-8411ab44bdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:54.015681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ca81a-bbed-49c1-8601-8411ab44bdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:54.016721 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797265b-28ef-47ba-a3ea-ecea0e1e9a69 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:54.017485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ca81a-bbed-49c1-8601-8411ab44bdd9 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:54.027672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bb6a4-5d27-4414-b116-210f74da5791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:54.030885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bb6a4-5d27-4414-b116-210f74da5791 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:54.031307 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 806/1629] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:54.034269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008da67-7691-4fc5-9e26-f44e49d30c0d None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:54.035001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008da67-7691-4fc5-9e26-f44e49d30c0d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:54.035162 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008da67-7691-4fc5-9e26-f44e49d30c0d None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:54.036897 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bb6a4-5d27-4414-b116-210f74da5791 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:54.037238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bb6a4-5d27-4414-b116-210f74da5791 admin admin] PATH_INFO: `/v3/projects/0fcbd660cb2f410f9680874637b5002a/users/75ecec7ffc004ae8b8b49b699bc17f17/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:54.037494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 807/1630] 10.222.0.76 () {54 vars in 912 bytes} [Fri Aug 26 08:51:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:51:54.038444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008da67-7691-4fc5-9e26-f44e49d30c0d None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:54.068096 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bb6a4-5d27-4414-b116-210f74da5791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fcbd660cb2f410f9680874637b5002a, user_id=75ecec7ffc004ae8b8b49b699bc17f17, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:54.072370 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bb6a4-5d27-4414-b116-210f74da5791 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:54.110370 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 824/1631] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:51:54 2022] PUT /identity/v3/projects/0fcbd660cb2f410f9680874637b5002a/users/75ecec7ffc004ae8b8b49b699bc17f17/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:54.111414 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bb6a4-5d27-4414-b116-210f74da5791 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:54.156809 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008da67-7691-4fc5-9e26-f44e49d30c0d None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:54.252854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e070f-a7db-4072-91d4-f3d802ee3cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:54.253508 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e070f-a7db-4072-91d4-f3d802ee3cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:54.253790 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e070f-a7db-4072-91d4-f3d802ee3cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:54.254063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e070f-a7db-4072-91d4-f3d802ee3cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:54.299823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bb6a4-5d27-4414-b116-210f74da5791 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:54.317749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d686334-c1f6-49d4-a9a6-770930c9c428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:54.319639 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d686334-c1f6-49d4-a9a6-770930c9c428 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:54.320300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d686334-c1f6-49d4-a9a6-770930c9c428 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:54.320604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d686334-c1f6-49d4-a9a6-770930c9c428 admin admin] PATH_INFO: `/v3/projects/b57fa41f43824327987471cccc679a7c/users/88c244a279e0454591177705038fc81d/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:54.357506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d686334-c1f6-49d4-a9a6-770930c9c428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b57fa41f43824327987471cccc679a7c, user_id=88c244a279e0454591177705038fc81d, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:54.365155 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d686334-c1f6-49d4-a9a6-770930c9c428 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:54.392316 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 825/1632] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:51:54 2022] PUT /identity/v3/projects/b57fa41f43824327987471cccc679a7c/users/88c244a279e0454591177705038fc81d/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:54.394016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c72ab-eefb-4518-be73-458f478b459b None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:54.394321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c72ab-eefb-4518-be73-458f478b459b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:54.394654 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c72ab-eefb-4518-be73-458f478b459b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:54.405295 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e070f-a7db-4072-91d4-f3d802ee3cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:54.407032 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e070f-a7db-4072-91d4-f3d802ee3cc2 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:54.418139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-918c72ab-eefb-4518-be73-458f478b459b None None] MFA Rules not processed for user `b63d6e588f6e4b598b75a2ec13bea25d`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:54.419484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-918c72ab-eefb-4518-be73-458f478b459b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:54.423140 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 808/1633] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:51:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:51:54.424177 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e070f-a7db-4072-91d4-f3d802ee3cc2 service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:54.438687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e070f-a7db-4072-91d4-f3d802ee3cc2 service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:54.482958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:54.514928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 826/1634] 10.222.0.76 () {58 vars in 1009 bytes} [Fri Aug 26 08:51:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:54.516045 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c72ab-eefb-4518-be73-458f478b459b None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:54.526442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:54.595000 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c72ab-eefb-4518-be73-458f478b459b None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:54.600323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefb589-2602-4958-983d-14742c0f174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:54.601178 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefb589-2602-4958-983d-14742c0f174a admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:54.601566 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefb589-2602-4958-983d-14742c0f174a admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:54.601992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefb589-2602-4958-983d-14742c0f174a admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:54.602744 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefb589-2602-4958-983d-14742c0f174a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:54.604526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefb589-2602-4958-983d-14742c0f174a admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:54.616307 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4065b0c-8eb2-4472-89c9-a2dea261b421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:54.616933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4065b0c-8eb2-4472-89c9-a2dea261b421 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:54.617477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4065b0c-8eb2-4472-89c9-a2dea261b421 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:54.617911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4065b0c-8eb2-4472-89c9-a2dea261b421 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:54.618566 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4065b0c-8eb2-4472-89c9-a2dea261b421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:54.619491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 827/1635] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:54.620171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4065b0c-8eb2-4472-89c9-a2dea261b421 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:54.620723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefb589-2602-4958-983d-14742c0f174a admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:54.634145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 809/1636] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:54.637783 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4065b0c-8eb2-4472-89c9-a2dea261b421 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:54.680817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4065b0c-8eb2-4472-89c9-a2dea261b421 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:54.696957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24b590-5035-4a67-a162-2c8770b35672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:54.697740 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24b590-5035-4a67-a162-2c8770b35672 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:54.698268 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24b590-5035-4a67-a162-2c8770b35672 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:54.698647 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24b590-5035-4a67-a162-2c8770b35672 admin admin] PATH_INFO: `/v3/projects/b57fa41f43824327987471cccc679a7c/users/88c244a279e0454591177705038fc81d/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:54.702241 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24b590-5035-4a67-a162-2c8770b35672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b57fa41f43824327987471cccc679a7c, user_id=88c244a279e0454591177705038fc81d, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:54.707477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24b590-5035-4a67-a162-2c8770b35672 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:54.713331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefb589-2602-4958-983d-14742c0f174a admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:54.722003 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5503dda-c583-46f4-983d-414cc7e386c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:54.722633 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5503dda-c583-46f4-983d-414cc7e386c2 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:54.722916 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5503dda-c583-46f4-983d-414cc7e386c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:54.723195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5503dda-c583-46f4-983d-414cc7e386c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:54.737086 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 810/1637] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:51:54 2022] PUT /identity/v3/projects/b57fa41f43824327987471cccc679a7c/users/88c244a279e0454591177705038fc81d/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:54.739741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24b590-5035-4a67-a162-2c8770b35672 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:54.753792 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5503dda-c583-46f4-983d-414cc7e386c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:54.754989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5503dda-c583-46f4-983d-414cc7e386c2 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:54.783221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 828/1638] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:51:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:51:54.785812 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f5a27-1fd6-4d41-a2da-0c4566ee1ab6 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:54.786108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f5a27-1fd6-4d41-a2da-0c4566ee1ab6 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:54.786507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f5a27-1fd6-4d41-a2da-0c4566ee1ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:54.859446 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-5e0f5a27-1fd6-4d41-a2da-0c4566ee1ab6 None None] MFA Rules not processed for user `88c244a279e0454591177705038fc81d`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:54.862618 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-5e0f5a27-1fd6-4d41-a2da-0c4566ee1ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:54.868598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24b590-5035-4a67-a162-2c8770b35672 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:54.883919 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407177d-a79a-497e-8b95-07eb7bd98b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:54.885259 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407177d-a79a-497e-8b95-07eb7bd98b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:54.887023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407177d-a79a-497e-8b95-07eb7bd98b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:54.887398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407177d-a79a-497e-8b95-07eb7bd98b24 admin admin] PATH_INFO: `/v3/projects/0fcbd660cb2f410f9680874637b5002a/users/75ecec7ffc004ae8b8b49b699bc17f17/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:54.892239 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407177d-a79a-497e-8b95-07eb7bd98b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fcbd660cb2f410f9680874637b5002a, user_id=75ecec7ffc004ae8b8b49b699bc17f17, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:54.897885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407177d-a79a-497e-8b95-07eb7bd98b24 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:54.938290 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 811/1639] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:51:54 2022] PUT /identity/v3/projects/0fcbd660cb2f410f9680874637b5002a/users/75ecec7ffc004ae8b8b49b699bc17f17/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:54.938290 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407177d-a79a-497e-8b95-07eb7bd98b24 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:55.067190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 829/1640] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:55.068661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be562abd-0acc-44ca-a0e0-61b1b32cd0da None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:55.068951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be562abd-0acc-44ca-a0e0-61b1b32cd0da None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:55.069294 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be562abd-0acc-44ca-a0e0-61b1b32cd0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:55.140837 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407177d-a79a-497e-8b95-07eb7bd98b24 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:55.156297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bec66-e636-4b06-a4d9-cf06b043069a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:55.157400 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bec66-e636-4b06-a4d9-cf06b043069a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:55.157687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bec66-e636-4b06-a4d9-cf06b043069a admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:55.157964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bec66-e636-4b06-a4d9-cf06b043069a admin admin] PATH_INFO: `/v3/users/c4310623b295488486ed8918d03b9503` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:55.160709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bec66-e636-4b06-a4d9-cf06b043069a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4310623b295488486ed8918d03b9503)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:55.162609 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bec66-e636-4b06-a4d9-cf06b043069a admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:55.167987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-be562abd-0acc-44ca-a0e0-61b1b32cd0da None None] MFA Rules not processed for user `75ecec7ffc004ae8b8b49b699bc17f17`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:55.169281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-be562abd-0acc-44ca-a0e0-61b1b32cd0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:55.187129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:55.271068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-663bec66-e636-4b06-a4d9-cf06b043069a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4310623b295488486ed8918d03b9503'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:55.276359 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:55.282058 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-663bec66-e636-4b06-a4d9-cf06b043069a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4310623b295488486ed8918d03b9503'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:55.284186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-663bec66-e636-4b06-a4d9-cf06b043069a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4310623b295488486ed8918d03b9503'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:55.286247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-663bec66-e636-4b06-a4d9-cf06b043069a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4310623b295488486ed8918d03b9503'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:55.301093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-663bec66-e636-4b06-a4d9-cf06b043069a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4310623b295488486ed8918d03b9503'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:55.332344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 812/1641] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:51:54 2022] DELETE /identity/v3/users/c4310623b295488486ed8918d03b9503 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:55.333477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bec66-e636-4b06-a4d9-cf06b043069a admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:55.335043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-663bec66-e636-4b06-a4d9-cf06b043069a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:55.352812 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 830/1642] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:55 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:55.352812 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8da1dc-a025-4986-87af-d8f181980059 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:55.352812 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8da1dc-a025-4986-87af-d8f181980059 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:55.352812 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8da1dc-a025-4986-87af-d8f181980059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:55.390460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-7d8da1dc-a025-4986-87af-d8f181980059 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:55.396623 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-7d8da1dc-a025-4986-87af-d8f181980059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:55.429953 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bec66-e636-4b06-a4d9-cf06b043069a admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:55.436520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e70c20-ac77-43c4-ae44-7066c24c937d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:55.440590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e70c20-ac77-43c4-ae44-7066c24c937d service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:55.441046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e70c20-ac77-43c4-ae44-7066c24c937d service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:55.443098 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e70c20-ac77-43c4-ae44-7066c24c937d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:55.446986 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-54e70c20-ac77-43c4-ae44-7066c24c937d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:55.499367 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 831/1643] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:55.560315 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e70c20-ac77-43c4-ae44-7066c24c937d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:55.561910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e70c20-ac77-43c4-ae44-7066c24c937d service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:55.578754 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 813/1644] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:51:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:51:55.598903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8da1dc-a025-4986-87af-d8f181980059 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:55.601134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-7d8da1dc-a025-4986-87af-d8f181980059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:55.625053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8da1dc-a025-4986-87af-d8f181980059 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:55.634792 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2e9bc-22de-4d58-aef0-b19046b8d304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:55.635554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2e9bc-22de-4d58-aef0-b19046b8d304 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:55.635867 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2e9bc-22de-4d58-aef0-b19046b8d304 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:55.636128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2e9bc-22de-4d58-aef0-b19046b8d304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:55.684063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e70c20-ac77-43c4-ae44-7066c24c937d service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:55.686706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-54e70c20-ac77-43c4-ae44-7066c24c937d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:55.793980 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2e9bc-22de-4d58-aef0-b19046b8d304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:55.795510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2e9bc-22de-4d58-aef0-b19046b8d304 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:55.824810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 832/1645] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:51:55 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:51:55.860718 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e70c20-ac77-43c4-ae44-7066c24c937d service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:55.875354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f86785-5d27-4780-9daf-a6663f29cd57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:55.876687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f86785-5d27-4780-9daf-a6663f29cd57 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:55.877016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f86785-5d27-4780-9daf-a6663f29cd57 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:55.880635 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f86785-5d27-4780-9daf-a6663f29cd57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:55.900980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f86785-5d27-4780-9daf-a6663f29cd57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:55.902988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f86785-5d27-4780-9daf-a6663f29cd57 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:55.945637 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 814/1646] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:51:56.253271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2e9bc-22de-4d58-aef0-b19046b8d304 service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:56.255271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b0d2e9bc-22de-4d58-aef0-b19046b8d304 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:56.278009 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2e9bc-22de-4d58-aef0-b19046b8d304 service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:56.287799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74080863-a6d9-4925-b992-667a6600af04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:56.288571 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74080863-a6d9-4925-b992-667a6600af04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:56.288776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74080863-a6d9-4925-b992-667a6600af04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:56.289096 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74080863-a6d9-4925-b992-667a6600af04 admin admin] PATH_INFO: `/v3/users/659a481dcc034fa2a9f0e1de33f50ef6` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:56.290346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74080863-a6d9-4925-b992-667a6600af04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=659a481dcc034fa2a9f0e1de33f50ef6)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:56.291428 dv-cinder-852364-5-smb devstack@keystone.service[87893]: WARNING py.warnings [None req-74080863-a6d9-4925-b992-667a6600af04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 08:51:56.291428 dv-cinder-852364-5-smb devstack@keystone.service[87893]: warnings.warn(msg) Aug 26 08:51:56.291428 dv-cinder-852364-5-smb devstack@keystone.service[87893]: Aug 26 08:51:56.292895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74080863-a6d9-4925-b992-667a6600af04 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:56.366293 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:56.399923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-74080863-a6d9-4925-b992-667a6600af04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '659a481dcc034fa2a9f0e1de33f50ef6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:56.417336 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-74080863-a6d9-4925-b992-667a6600af04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '659a481dcc034fa2a9f0e1de33f50ef6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:56.418602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-74080863-a6d9-4925-b992-667a6600af04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '659a481dcc034fa2a9f0e1de33f50ef6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:56.439224 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-74080863-a6d9-4925-b992-667a6600af04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '659a481dcc034fa2a9f0e1de33f50ef6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:56.486142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-74080863-a6d9-4925-b992-667a6600af04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '659a481dcc034fa2a9f0e1de33f50ef6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:56.499758 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45b5b7-6c9a-4732-a88c-97ba72744b74 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:56.500049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45b5b7-6c9a-4732-a88c-97ba72744b74 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:56.500327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45b5b7-6c9a-4732-a88c-97ba72744b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:56.504601 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 833/1647] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:51:56 2022] DELETE /identity/v3/users/659a481dcc034fa2a9f0e1de33f50ef6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:56.544593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-eb45b5b7-6c9a-4732-a88c-97ba72744b74 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:56.545904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-eb45b5b7-6c9a-4732-a88c-97ba72744b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:56.593735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:56.657707 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74080863-a6d9-4925-b992-667a6600af04 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:56.660409 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-74080863-a6d9-4925-b992-667a6600af04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:56.691905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 815/1648] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:56.698404 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74080863-a6d9-4925-b992-667a6600af04 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:56.707536 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf3c87-8130-4e3d-a71e-51204a0ca7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:56.710236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf3c87-8130-4e3d-a71e-51204a0ca7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:56.710236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf3c87-8130-4e3d-a71e-51204a0ca7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:56.710236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf3c87-8130-4e3d-a71e-51204a0ca7f5 admin admin] PATH_INFO: `/v3/users/3a5b31b0082442d38c6d62b79e9c91b8` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:56.711815 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf3c87-8130-4e3d-a71e-51204a0ca7f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5b31b0082442d38c6d62b79e9c91b8)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:56.715587 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf3c87-8130-4e3d-a71e-51204a0ca7f5 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:56.740556 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45b5b7-6c9a-4732-a88c-97ba72744b74 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:56.744093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-eb45b5b7-6c9a-4732-a88c-97ba72744b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:56.840825 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-54bf3c87-8130-4e3d-a71e-51204a0ca7f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5b31b0082442d38c6d62b79e9c91b8'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:56.861447 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-54bf3c87-8130-4e3d-a71e-51204a0ca7f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5b31b0082442d38c6d62b79e9c91b8'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:56.863065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-54bf3c87-8130-4e3d-a71e-51204a0ca7f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5b31b0082442d38c6d62b79e9c91b8'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:56.876749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-54bf3c87-8130-4e3d-a71e-51204a0ca7f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5b31b0082442d38c6d62b79e9c91b8'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:56.903937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45b5b7-6c9a-4732-a88c-97ba72744b74 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:56.915245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-54bf3c87-8130-4e3d-a71e-51204a0ca7f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5b31b0082442d38c6d62b79e9c91b8'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:56.918528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336c623-9b63-42db-9b9d-1169a11d260e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:56.920408 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336c623-9b63-42db-9b9d-1169a11d260e service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:56.922047 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336c623-9b63-42db-9b9d-1169a11d260e service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:56.922490 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336c623-9b63-42db-9b9d-1169a11d260e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:56.929264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d336c623-9b63-42db-9b9d-1169a11d260e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:56.934937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 834/1649] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:51:56 2022] DELETE /identity/v3/users/3a5b31b0082442d38c6d62b79e9c91b8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:51:56.942302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c9403-ebbf-4782-b372-4cc7168d2b38 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:56.943525 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c9403-ebbf-4782-b372-4cc7168d2b38 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:56.944073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c9403-ebbf-4782-b372-4cc7168d2b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:56.970448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336c623-9b63-42db-9b9d-1169a11d260e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:56.976651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336c623-9b63-42db-9b9d-1169a11d260e service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:57.015323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-3f7c9403-ebbf-4782-b372-4cc7168d2b38 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:57.017464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 816/1650] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:51:57.017599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-3f7c9403-ebbf-4782-b372-4cc7168d2b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:57.179276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 835/1651] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:57.264583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336c623-9b63-42db-9b9d-1169a11d260e service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:57.267199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d336c623-9b63-42db-9b9d-1169a11d260e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:57.291218 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336c623-9b63-42db-9b9d-1169a11d260e service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:57.416341 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150ffed-8974-4bdb-858c-565e4e82e4c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:57.418419 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ffed-8974-4bdb-858c-565e4e82e4c1 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:57.418747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ffed-8974-4bdb-858c-565e4e82e4c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:57.420443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ffed-8974-4bdb-858c-565e4e82e4c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:57.451870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150ffed-8974-4bdb-858c-565e4e82e4c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:57.455973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150ffed-8974-4bdb-858c-565e4e82e4c1 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:57.476121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 817/1652] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:51:58.380679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c9403-ebbf-4782-b372-4cc7168d2b38 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:58.382193 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-3f7c9403-ebbf-4782-b372-4cc7168d2b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:58.403637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c9403-ebbf-4782-b372-4cc7168d2b38 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:58.411756 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd647c5-10e3-4c86-a0a9-1e5702b194c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:58.413385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd647c5-10e3-4c86-a0a9-1e5702b194c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:58.413847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd647c5-10e3-4c86-a0a9-1e5702b194c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:58.414364 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd647c5-10e3-4c86-a0a9-1e5702b194c0 admin admin] PATH_INFO: `/v3/projects/981a309f5874434c9bd21d627248c34f` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:58.416395 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd647c5-10e3-4c86-a0a9-1e5702b194c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=981a309f5874434c9bd21d627248c34f)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:58.419930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd647c5-10e3-4c86-a0a9-1e5702b194c0 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:58.452125 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:58.546740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2dd647c5-10e3-4c86-a0a9-1e5702b194c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '981a309f5874434c9bd21d627248c34f', 'request_id': 'req-2dd647c5-10e3-4c86-a0a9-1e5702b194c0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:58.575584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2dd647c5-10e3-4c86-a0a9-1e5702b194c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '981a309f5874434c9bd21d627248c34f', 'request_id': 'req-2dd647c5-10e3-4c86-a0a9-1e5702b194c0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:58.608020 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2dd647c5-10e3-4c86-a0a9-1e5702b194c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '981a309f5874434c9bd21d627248c34f', 'request_id': 'req-2dd647c5-10e3-4c86-a0a9-1e5702b194c0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:58.661254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2dd647c5-10e3-4c86-a0a9-1e5702b194c0 admin admin] The token cache is being invalidate because project 981a309f5874434c9bd21d627248c34f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:51:58.661572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2dd647c5-10e3-4c86-a0a9-1e5702b194c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:58.663910 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2dd647c5-10e3-4c86-a0a9-1e5702b194c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:51:58.671242 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 836/1653] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:51:58 2022] DELETE /identity/v3/projects/981a309f5874434c9bd21d627248c34f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:58.675402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3406f-e146-49d6-86be-7877596ad469 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:58.676482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3406f-e146-49d6-86be-7877596ad469 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:58.676913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3406f-e146-49d6-86be-7877596ad469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:58.714036 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-9ec3406f-e146-49d6-86be-7877596ad469 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:58.719671 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-9ec3406f-e146-49d6-86be-7877596ad469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:58.856426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 818/1654] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:58.865133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7102f0-6dd8-4c21-b727-710fa127988a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:58.865430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7102f0-6dd8-4c21-b727-710fa127988a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:58.865713 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7102f0-6dd8-4c21-b727-710fa127988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:58.918058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-ec7102f0-6dd8-4c21-b727-710fa127988a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:51:58.919624 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ec7102f0-6dd8-4c21-b727-710fa127988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:58.981102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3406f-e146-49d6-86be-7877596ad469 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:58.984142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 837/1655] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:51:59.004288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3406f-e146-49d6-86be-7877596ad469 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:59.029271 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba27dc6-2f4b-44b8-ab6b-d6b343271b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:59.030091 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba27dc6-2f4b-44b8-ab6b-d6b343271b8f admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:59.030521 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba27dc6-2f4b-44b8-ab6b-d6b343271b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:59.030946 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba27dc6-2f4b-44b8-ab6b-d6b343271b8f admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:59.031934 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba27dc6-2f4b-44b8-ab6b-d6b343271b8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:51:59.032400 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba27dc6-2f4b-44b8-ab6b-d6b343271b8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:59.036622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba27dc6-2f4b-44b8-ab6b-d6b343271b8f admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:59.045631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:59.070260 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 819/1656] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:51:59.074551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7102f0-6dd8-4c21-b727-710fa127988a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:59.084362 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7102f0-6dd8-4c21-b727-710fa127988a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:59.102852 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02241832-ebb1-4bc3-add7-759d63ae9461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:59.103733 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02241832-ebb1-4bc3-add7-759d63ae9461 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:59.104169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02241832-ebb1-4bc3-add7-759d63ae9461 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:59.104581 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02241832-ebb1-4bc3-add7-759d63ae9461 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:59.105685 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02241832-ebb1-4bc3-add7-759d63ae9461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:59.107784 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02241832-ebb1-4bc3-add7-759d63ae9461 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:59.160108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 838/1657] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:51:59 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:59.161101 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba27dc6-2f4b-44b8-ab6b-d6b343271b8f admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:59.173926 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba27dc6-2f4b-44b8-ab6b-d6b343271b8f admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:59.500372 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1b314-19a4-4e30-9cc4-85318b2c1461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:59.500965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1b314-19a4-4e30-9cc4-85318b2c1461 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:59.501319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1b314-19a4-4e30-9cc4-85318b2c1461 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:59.501588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1b314-19a4-4e30-9cc4-85318b2c1461 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:59.502209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1b314-19a4-4e30-9cc4-85318b2c1461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:59.515324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1b314-19a4-4e30-9cc4-85318b2c1461 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:59.595693 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 820/1658] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:51:59 2022] POST /identity/v3/users => generated 290 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:51:59.601295 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02241832-ebb1-4bc3-add7-759d63ae9461 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:59.622590 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02241832-ebb1-4bc3-add7-759d63ae9461 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:59.637772 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c916a09-44b6-4c6e-ae5a-5f4b713233b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:59.638726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c916a09-44b6-4c6e-ae5a-5f4b713233b9 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:59.638726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c916a09-44b6-4c6e-ae5a-5f4b713233b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:59.639235 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c916a09-44b6-4c6e-ae5a-5f4b713233b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:59.642511 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c916a09-44b6-4c6e-ae5a-5f4b713233b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:59.646907 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c916a09-44b6-4c6e-ae5a-5f4b713233b9 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:59.684984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 839/1659] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:59.689362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1b314-19a4-4e30-9cc4-85318b2c1461 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:59.709056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1b314-19a4-4e30-9cc4-85318b2c1461 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:59.725432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc87ede-9998-40a2-95d8-18746c0662bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:59.726179 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc87ede-9998-40a2-95d8-18746c0662bc admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:59.726578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc87ede-9998-40a2-95d8-18746c0662bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:59.726989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc87ede-9998-40a2-95d8-18746c0662bc admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:59.727782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc87ede-9998-40a2-95d8-18746c0662bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:59.737217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc87ede-9998-40a2-95d8-18746c0662bc admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:59.754069 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c916a09-44b6-4c6e-ae5a-5f4b713233b9 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:59.756979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-2c916a09-44b6-4c6e-ae5a-5f4b713233b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:51:59.790876 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c916a09-44b6-4c6e-ae5a-5f4b713233b9 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:59.798248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 821/1660] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:51:59.799334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc87ede-9998-40a2-95d8-18746c0662bc admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:51:59.827712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b5922-a3c9-48c4-af42-b962b277c6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:59.828387 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b5922-a3c9-48c4-af42-b962b277c6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:59.828674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b5922-a3c9-48c4-af42-b962b277c6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:59.828956 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b5922-a3c9-48c4-af42-b962b277c6bf admin admin] PATH_INFO: `/v3/projects/9595989d0802422abd77617455ffee03` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:59.841938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b5922-a3c9-48c4-af42-b962b277c6bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9595989d0802422abd77617455ffee03)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:59.844177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b5922-a3c9-48c4-af42-b962b277c6bf admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:59.863834 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc87ede-9998-40a2-95d8-18746c0662bc admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:51:59.878011 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d258ef8-b7e8-456f-ae2e-8d5ef20e3e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:51:59.878698 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d258ef8-b7e8-456f-ae2e-8d5ef20e3e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:59.878982 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d258ef8-b7e8-456f-ae2e-8d5ef20e3e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:59.879257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d258ef8-b7e8-456f-ae2e-8d5ef20e3e99 admin admin] PATH_INFO: `/v3/projects/d827518b7856497c8b21af4c2b72f707/users/c417a0616cb64c8fa0d1b3f638d1a532/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:51:59.918503 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d258ef8-b7e8-456f-ae2e-8d5ef20e3e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d827518b7856497c8b21af4c2b72f707, user_id=c417a0616cb64c8fa0d1b3f638d1a532, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:51:59.926097 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d258ef8-b7e8-456f-ae2e-8d5ef20e3e99 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:51:59.972285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 822/1661] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:51:59 2022] PUT /identity/v3/projects/d827518b7856497c8b21af4c2b72f707/users/c417a0616cb64c8fa0d1b3f638d1a532/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:51:59.982800 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f15e7-5fc6-4af0-b4a6-468049277006 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:51:59.983093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f15e7-5fc6-4af0-b4a6-468049277006 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:51:59.983396 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f15e7-5fc6-4af0-b4a6-468049277006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:00.008435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1c8b5922-a3c9-48c4-af42-b962b277c6bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9595989d0802422abd77617455ffee03', 'request_id': 'req-1c8b5922-a3c9-48c4-af42-b962b277c6bf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:00.030105 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1c8b5922-a3c9-48c4-af42-b962b277c6bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9595989d0802422abd77617455ffee03', 'request_id': 'req-1c8b5922-a3c9-48c4-af42-b962b277c6bf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:00.045112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-b56f15e7-5fc6-4af0-b4a6-468049277006 None None] MFA Rules not processed for user `c417a0616cb64c8fa0d1b3f638d1a532`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:00.049228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b56f15e7-5fc6-4af0-b4a6-468049277006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:00.055716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1c8b5922-a3c9-48c4-af42-b962b277c6bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9595989d0802422abd77617455ffee03', 'request_id': 'req-1c8b5922-a3c9-48c4-af42-b962b277c6bf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:00.078695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1c8b5922-a3c9-48c4-af42-b962b277c6bf admin admin] The token cache is being invalidate because project 9595989d0802422abd77617455ffee03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:00.079000 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1c8b5922-a3c9-48c4-af42-b962b277c6bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:00.081639 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1c8b5922-a3c9-48c4-af42-b962b277c6bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:00.084897 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 840/1662] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:51:59 2022] DELETE /identity/v3/projects/9595989d0802422abd77617455ffee03 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:52:00.089148 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b5922-a3c9-48c4-af42-b962b277c6bf admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:00.094045 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1c8b5922-a3c9-48c4-af42-b962b277c6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:00.248498 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:00.264652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 823/1663] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:51:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:52:00.275602 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f15e7-5fc6-4af0-b4a6-468049277006 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:00.281471 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b56f15e7-5fc6-4af0-b4a6-468049277006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:00.288254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b5922-a3c9-48c4-af42-b962b277c6bf admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:00.297076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ef19f-a4e3-44a8-b4a9-3571fd614170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:00.298039 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ef19f-a4e3-44a8-b4a9-3571fd614170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:00.298517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ef19f-a4e3-44a8-b4a9-3571fd614170 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:00.299546 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ef19f-a4e3-44a8-b4a9-3571fd614170 admin admin] PATH_INFO: `/v3/users/75ecec7ffc004ae8b8b49b699bc17f17` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:00.302342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ef19f-a4e3-44a8-b4a9-3571fd614170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ecec7ffc004ae8b8b49b699bc17f17)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:00.306124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ef19f-a4e3-44a8-b4a9-3571fd614170 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:00.314190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f15e7-5fc6-4af0-b4a6-468049277006 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:00.331364 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ef5ab-6f4d-497d-b155-1d3f83917065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:00.332254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ef5ab-6f4d-497d-b155-1d3f83917065 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:00.332547 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ef5ab-6f4d-497d-b155-1d3f83917065 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:00.332898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ef5ab-6f4d-497d-b155-1d3f83917065 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:00.334279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ef5ab-6f4d-497d-b155-1d3f83917065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:00.341769 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ef5ab-6f4d-497d-b155-1d3f83917065 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:00.420254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-830ef19f-a4e3-44a8-b4a9-3571fd614170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ecec7ffc004ae8b8b49b699bc17f17'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:00.441873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 824/1664] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:00 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:00.442052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-830ef19f-a4e3-44a8-b4a9-3571fd614170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ecec7ffc004ae8b8b49b699bc17f17'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:00.442773 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-830ef19f-a4e3-44a8-b4a9-3571fd614170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ecec7ffc004ae8b8b49b699bc17f17'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:00.446320 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ef5ab-6f4d-497d-b155-1d3f83917065 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:00.453389 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-830ef19f-a4e3-44a8-b4a9-3571fd614170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ecec7ffc004ae8b8b49b699bc17f17'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:00.483255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-830ef19f-a4e3-44a8-b4a9-3571fd614170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ecec7ffc004ae8b8b49b699bc17f17'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:00.498157 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:00.503083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 841/1665] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:00 2022] DELETE /identity/v3/users/75ecec7ffc004ae8b8b49b699bc17f17 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:00.615341 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ef5ab-6f4d-497d-b155-1d3f83917065 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:00.739059 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eec80-bc81-440a-a4b3-985af2376468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:00.740251 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eec80-bc81-440a-a4b3-985af2376468 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:00.740542 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eec80-bc81-440a-a4b3-985af2376468 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:00.740820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eec80-bc81-440a-a4b3-985af2376468 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:00.741477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400eec80-bc81-440a-a4b3-985af2376468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:00.743575 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400eec80-bc81-440a-a4b3-985af2376468 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:00.820886 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 825/1666] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:00 2022] POST /identity/v3/users => generated 296 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:00.826091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ef19f-a4e3-44a8-b4a9-3571fd614170 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:00.827572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-830ef19f-a4e3-44a8-b4a9-3571fd614170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:00.850648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ef19f-a4e3-44a8-b4a9-3571fd614170 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:00.869039 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ad472-5550-4232-8da0-dc224afda422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:00.869746 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ad472-5550-4232-8da0-dc224afda422 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:00.870040 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ad472-5550-4232-8da0-dc224afda422 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:00.870468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ad472-5550-4232-8da0-dc224afda422 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:00.871171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ad472-5550-4232-8da0-dc224afda422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:00.877209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ad472-5550-4232-8da0-dc224afda422 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:00.901877 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 842/1667] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:00.906059 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eec80-bc81-440a-a4b3-985af2376468 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:00.917249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eec80-bc81-440a-a4b3-985af2376468 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:00.927993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a05f88-ec23-45d3-855b-8546a94155af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:00.928802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a05f88-ec23-45d3-855b-8546a94155af admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:00.929252 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a05f88-ec23-45d3-855b-8546a94155af admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:00.929692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a05f88-ec23-45d3-855b-8546a94155af admin admin] PATH_INFO: `/v3/projects/c43a520560cc4480a30bb1c6d0bf52fc/users/c902c849545b42d58438fc2f0da831c0/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:00.951860 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a05f88-ec23-45d3-855b-8546a94155af admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43a520560cc4480a30bb1c6d0bf52fc, user_id=c902c849545b42d58438fc2f0da831c0, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:00.955236 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a05f88-ec23-45d3-855b-8546a94155af admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:00.985150 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 826/1668] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:00 2022] PUT /identity/v3/projects/c43a520560cc4480a30bb1c6d0bf52fc/users/c902c849545b42d58438fc2f0da831c0/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:00.987488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ad472-5550-4232-8da0-dc224afda422 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:01.003750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ad472-5550-4232-8da0-dc224afda422 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:01.187055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5364c-08b3-4db4-9919-88b97a730bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:01.187682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5364c-08b3-4db4-9919-88b97a730bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:01.187956 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5364c-08b3-4db4-9919-88b97a730bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:01.188231 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5364c-08b3-4db4-9919-88b97a730bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:01.188936 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5364c-08b3-4db4-9919-88b97a730bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:01.193451 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5364c-08b3-4db4-9919-88b97a730bd5 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:01.229793 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 843/1669] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:01.230791 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a05f88-ec23-45d3-855b-8546a94155af admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:01.251655 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a05f88-ec23-45d3-855b-8546a94155af admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:01.263979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36aa79-f77e-42b8-98eb-b31336991d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:01.267119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36aa79-f77e-42b8-98eb-b31336991d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:01.268653 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36aa79-f77e-42b8-98eb-b31336991d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:01.269153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36aa79-f77e-42b8-98eb-b31336991d5d admin admin] PATH_INFO: `/v3/projects/c43a520560cc4480a30bb1c6d0bf52fc/users/c902c849545b42d58438fc2f0da831c0/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:01.276445 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36aa79-f77e-42b8-98eb-b31336991d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43a520560cc4480a30bb1c6d0bf52fc, user_id=c902c849545b42d58438fc2f0da831c0, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:01.284741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36aa79-f77e-42b8-98eb-b31336991d5d admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:01.304236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5364c-08b3-4db4-9919-88b97a730bd5 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:01.306562 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0bf5364c-08b3-4db4-9919-88b97a730bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:01.317819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 827/1670] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:01 2022] PUT /identity/v3/projects/c43a520560cc4480a30bb1c6d0bf52fc/users/c902c849545b42d58438fc2f0da831c0/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:01.329236 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6621c7-d234-460f-8259-525f72d04931 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:01.329614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6621c7-d234-460f-8259-525f72d04931 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:01.330063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6621c7-d234-460f-8259-525f72d04931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:01.352959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5364c-08b3-4db4-9919-88b97a730bd5 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:01.399536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-db6621c7-d234-460f-8259-525f72d04931 None None] MFA Rules not processed for user `c902c849545b42d58438fc2f0da831c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:01.401817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-db6621c7-d234-460f-8259-525f72d04931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:01.426493 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:01.454855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c1edd-f68b-4456-8691-c36183edccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:01.459389 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c1edd-f68b-4456-8691-c36183edccd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:01.459706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c1edd-f68b-4456-8691-c36183edccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:01.460271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c1edd-f68b-4456-8691-c36183edccd4 admin admin] PATH_INFO: `/v3/projects/5293e13de5704f40b856b251e0064560` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:01.462930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c1edd-f68b-4456-8691-c36183edccd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5293e13de5704f40b856b251e0064560)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:01.464873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c1edd-f68b-4456-8691-c36183edccd4 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:01.588460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-906c1edd-f68b-4456-8691-c36183edccd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5293e13de5704f40b856b251e0064560', 'request_id': 'req-906c1edd-f68b-4456-8691-c36183edccd4'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:01.596765 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 828/1671] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:52:01.605353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-906c1edd-f68b-4456-8691-c36183edccd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5293e13de5704f40b856b251e0064560', 'request_id': 'req-906c1edd-f68b-4456-8691-c36183edccd4'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:01.609875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6621c7-d234-460f-8259-525f72d04931 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:01.611241 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-db6621c7-d234-460f-8259-525f72d04931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:01.619424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:01.635169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-906c1edd-f68b-4456-8691-c36183edccd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5293e13de5704f40b856b251e0064560', 'request_id': 'req-906c1edd-f68b-4456-8691-c36183edccd4'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:01.656584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-906c1edd-f68b-4456-8691-c36183edccd4 admin admin] The token cache is being invalidate because project 5293e13de5704f40b856b251e0064560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:01.656881 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-906c1edd-f68b-4456-8691-c36183edccd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:01.659237 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-906c1edd-f68b-4456-8691-c36183edccd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:01.665412 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 844/1672] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:01 2022] DELETE /identity/v3/projects/5293e13de5704f40b856b251e0064560 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:01.666568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c1edd-f68b-4456-8691-c36183edccd4 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:01.669692 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-906c1edd-f68b-4456-8691-c36183edccd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:01.772372 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6621c7-d234-460f-8259-525f72d04931 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:01.853093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c1edd-f68b-4456-8691-c36183edccd4 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:01.868888 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe385277-bd0c-48fa-9ba5-2eacc65302c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:01.869827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe385277-bd0c-48fa-9ba5-2eacc65302c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:01.870249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe385277-bd0c-48fa-9ba5-2eacc65302c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:01.870663 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe385277-bd0c-48fa-9ba5-2eacc65302c5 admin admin] PATH_INFO: `/v3/users/88c244a279e0454591177705038fc81d` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:01.872155 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe385277-bd0c-48fa-9ba5-2eacc65302c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c244a279e0454591177705038fc81d)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:01.874135 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe385277-bd0c-48fa-9ba5-2eacc65302c5 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:01.878340 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf4635-c257-4afc-aa26-a2459be11307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:01.879058 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf4635-c257-4afc-aa26-a2459be11307 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:01.879418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf4635-c257-4afc-aa26-a2459be11307 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:01.879784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf4635-c257-4afc-aa26-a2459be11307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:01.883737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a5bf4635-c257-4afc-aa26-a2459be11307 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:01.963796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf4635-c257-4afc-aa26-a2459be11307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:01.965793 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf4635-c257-4afc-aa26-a2459be11307 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:01.992865 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 829/1673] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:01.995377 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-fe385277-bd0c-48fa-9ba5-2eacc65302c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c244a279e0454591177705038fc81d'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:02.021722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-fe385277-bd0c-48fa-9ba5-2eacc65302c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c244a279e0454591177705038fc81d'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:02.022378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-fe385277-bd0c-48fa-9ba5-2eacc65302c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c244a279e0454591177705038fc81d'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:02.036169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-fe385277-bd0c-48fa-9ba5-2eacc65302c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c244a279e0454591177705038fc81d'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:02.082068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-fe385277-bd0c-48fa-9ba5-2eacc65302c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c244a279e0454591177705038fc81d'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:02.095823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 845/1674] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:01 2022] DELETE /identity/v3/users/88c244a279e0454591177705038fc81d => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:02.335592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf4635-c257-4afc-aa26-a2459be11307 service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:02.336651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a5bf4635-c257-4afc-aa26-a2459be11307 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:02.368960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf4635-c257-4afc-aa26-a2459be11307 service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:02.487910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e23237-8b33-471c-93bd-96c3f34efa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:02.489140 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e23237-8b33-471c-93bd-96c3f34efa8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:02.489841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e23237-8b33-471c-93bd-96c3f34efa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:02.490265 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e23237-8b33-471c-93bd-96c3f34efa8b admin admin] PATH_INFO: `/v3/users/73233b4755c54002b51edeeb688d659c` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:02.492146 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e23237-8b33-471c-93bd-96c3f34efa8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=73233b4755c54002b51edeeb688d659c)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:02.494366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e23237-8b33-471c-93bd-96c3f34efa8b admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:02.513881 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:02.588042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-58e23237-8b33-471c-93bd-96c3f34efa8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73233b4755c54002b51edeeb688d659c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:02.608897 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-58e23237-8b33-471c-93bd-96c3f34efa8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73233b4755c54002b51edeeb688d659c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:02.611237 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-58e23237-8b33-471c-93bd-96c3f34efa8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73233b4755c54002b51edeeb688d659c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:02.612034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-58e23237-8b33-471c-93bd-96c3f34efa8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73233b4755c54002b51edeeb688d659c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:02.628875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-58e23237-8b33-471c-93bd-96c3f34efa8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73233b4755c54002b51edeeb688d659c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:02.684145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 830/1675] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:02 2022] DELETE /identity/v3/users/73233b4755c54002b51edeeb688d659c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:02.686029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4be571-8ac5-4fd4-ae9d-78e1628e84ad None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:02.686217 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4be571-8ac5-4fd4-ae9d-78e1628e84ad None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:02.686434 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4be571-8ac5-4fd4-ae9d-78e1628e84ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:02.700533 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:02.719143 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-4f4be571-8ac5-4fd4-ae9d-78e1628e84ad None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:02.720433 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4f4be571-8ac5-4fd4-ae9d-78e1628e84ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:02.907836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 846/1676] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:02.926295 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e23237-8b33-471c-93bd-96c3f34efa8b admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:02.927900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-58e23237-8b33-471c-93bd-96c3f34efa8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:02.991811 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4be571-8ac5-4fd4-ae9d-78e1628e84ad None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:02.993359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4f4be571-8ac5-4fd4-ae9d-78e1628e84ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:03.010990 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4be571-8ac5-4fd4-ae9d-78e1628e84ad None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:03.040313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89618aaa-6a24-47af-9d18-142b6b0ca163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:03.041054 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89618aaa-6a24-47af-9d18-142b6b0ca163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:03.041351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89618aaa-6a24-47af-9d18-142b6b0ca163 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:03.041632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89618aaa-6a24-47af-9d18-142b6b0ca163 admin admin] PATH_INFO: `/v3/projects/0fcbd660cb2f410f9680874637b5002a` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:03.048569 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89618aaa-6a24-47af-9d18-142b6b0ca163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fcbd660cb2f410f9680874637b5002a)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:03.050560 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89618aaa-6a24-47af-9d18-142b6b0ca163 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:03.064303 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e23237-8b33-471c-93bd-96c3f34efa8b admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:03.071647 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96436b00-5e50-41a5-ba09-f11cdc9b6331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:03.072488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96436b00-5e50-41a5-ba09-f11cdc9b6331 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:03.073318 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96436b00-5e50-41a5-ba09-f11cdc9b6331 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:03.074462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96436b00-5e50-41a5-ba09-f11cdc9b6331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:03.100691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96436b00-5e50-41a5-ba09-f11cdc9b6331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:03.104788 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96436b00-5e50-41a5-ba09-f11cdc9b6331 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:03.148669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 831/1677] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:03.157598 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-89618aaa-6a24-47af-9d18-142b6b0ca163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fcbd660cb2f410f9680874637b5002a', 'request_id': 'req-89618aaa-6a24-47af-9d18-142b6b0ca163'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:03.175026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-89618aaa-6a24-47af-9d18-142b6b0ca163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fcbd660cb2f410f9680874637b5002a', 'request_id': 'req-89618aaa-6a24-47af-9d18-142b6b0ca163'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:03.197222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-89618aaa-6a24-47af-9d18-142b6b0ca163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fcbd660cb2f410f9680874637b5002a', 'request_id': 'req-89618aaa-6a24-47af-9d18-142b6b0ca163'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:03.226467 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-89618aaa-6a24-47af-9d18-142b6b0ca163 admin admin] The token cache is being invalidate because project 0fcbd660cb2f410f9680874637b5002a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:03.226786 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-89618aaa-6a24-47af-9d18-142b6b0ca163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:03.227507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-89618aaa-6a24-47af-9d18-142b6b0ca163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:03.229343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 847/1678] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:02 2022] DELETE /identity/v3/projects/0fcbd660cb2f410f9680874637b5002a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:52:03.235056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7836b-c4a7-4ef0-b88a-9d5d2f3ba1d4 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:03.235592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7836b-c4a7-4ef0-b88a-9d5d2f3ba1d4 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:03.236048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7836b-c4a7-4ef0-b88a-9d5d2f3ba1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:03.303972 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-61c7836b-c4a7-4ef0-b88a-9d5d2f3ba1d4 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:03.305388 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-61c7836b-c4a7-4ef0-b88a-9d5d2f3ba1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:03.438854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 832/1679] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:03.447234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e9c77-a12c-4a5e-8c1f-3a417b64193a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:03.447638 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e9c77-a12c-4a5e-8c1f-3a417b64193a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:03.448022 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e9c77-a12c-4a5e-8c1f-3a417b64193a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:03.487540 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-b34e9c77-a12c-4a5e-8c1f-3a417b64193a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:03.488961 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b34e9c77-a12c-4a5e-8c1f-3a417b64193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:03.510365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 848/1680] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:03.514593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7836b-c4a7-4ef0-b88a-9d5d2f3ba1d4 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:03.526220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7836b-c4a7-4ef0-b88a-9d5d2f3ba1d4 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:03.542898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39a61a-67ef-46a7-bea8-42d62e309c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:03.543931 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39a61a-67ef-46a7-bea8-42d62e309c69 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:03.567831 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39a61a-67ef-46a7-bea8-42d62e309c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:03.568345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39a61a-67ef-46a7-bea8-42d62e309c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:03.569505 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39a61a-67ef-46a7-bea8-42d62e309c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:52:03.569505 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39a61a-67ef-46a7-bea8-42d62e309c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:03.579433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39a61a-67ef-46a7-bea8-42d62e309c69 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:03.622959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e9c77-a12c-4a5e-8c1f-3a417b64193a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:03.626691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 833/1681] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:52:03.639524 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e9c77-a12c-4a5e-8c1f-3a417b64193a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:03.649786 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd298d25-56fc-4737-bc06-a2ef23c7a282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:03.650748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd298d25-56fc-4737-bc06-a2ef23c7a282 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:03.651034 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd298d25-56fc-4737-bc06-a2ef23c7a282 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:03.651312 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd298d25-56fc-4737-bc06-a2ef23c7a282 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:03.651977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd298d25-56fc-4737-bc06-a2ef23c7a282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:03.653939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd298d25-56fc-4737-bc06-a2ef23c7a282 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:03.737867 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39a61a-67ef-46a7-bea8-42d62e309c69 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:03.745532 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 849/1682] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:03 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:03.751478 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39a61a-67ef-46a7-bea8-42d62e309c69 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:03.829871 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:03.935738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c8f78-c2ab-4e41-8417-a1369f6f0c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:03.936397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c8f78-c2ab-4e41-8417-a1369f6f0c4f admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:03.936650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c8f78-c2ab-4e41-8417-a1369f6f0c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:03.939131 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c8f78-c2ab-4e41-8417-a1369f6f0c4f admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:03.939849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c8f78-c2ab-4e41-8417-a1369f6f0c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:03.948933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c8f78-c2ab-4e41-8417-a1369f6f0c4f admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:04.004366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 834/1683] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:03 2022] POST /identity/v3/users => generated 284 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:04.008896 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd298d25-56fc-4737-bc06-a2ef23c7a282 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:04.024350 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd298d25-56fc-4737-bc06-a2ef23c7a282 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:04.029808 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0c218-8766-4e58-9abe-70a4cc57f43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:04.030439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0c218-8766-4e58-9abe-70a4cc57f43c admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:04.030742 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0c218-8766-4e58-9abe-70a4cc57f43c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:04.031024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0c218-8766-4e58-9abe-70a4cc57f43c admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:04.031840 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0c218-8766-4e58-9abe-70a4cc57f43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:04.034135 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0c218-8766-4e58-9abe-70a4cc57f43c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:04.054141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c8f78-c2ab-4e41-8417-a1369f6f0c4f admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:04.063231 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 850/1684] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:04.073042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c8f78-c2ab-4e41-8417-a1369f6f0c4f admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:04.079645 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7abe45-5d46-4286-8c36-2fcc8e430bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:04.081193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7abe45-5d46-4286-8c36-2fcc8e430bdc admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:04.081484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7abe45-5d46-4286-8c36-2fcc8e430bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:04.081764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7abe45-5d46-4286-8c36-2fcc8e430bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:04.082425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7abe45-5d46-4286-8c36-2fcc8e430bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:04.084119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7abe45-5d46-4286-8c36-2fcc8e430bdc admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:04.106136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0c218-8766-4e58-9abe-70a4cc57f43c admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:04.116674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0c218-8766-4e58-9abe-70a4cc57f43c admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:04.118056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 835/1685] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:04.122053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de588c93-25f1-4476-808d-b3d716d3f630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:04.122727 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de588c93-25f1-4476-808d-b3d716d3f630 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:04.123012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de588c93-25f1-4476-808d-b3d716d3f630 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:04.123578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de588c93-25f1-4476-808d-b3d716d3f630 admin admin] PATH_INFO: `/v3/projects/e0aff92d66cf47c2959f96abbd050175/users/155f21ffd31d4a92965f259319d66e38/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:04.141858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de588c93-25f1-4476-808d-b3d716d3f630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0aff92d66cf47c2959f96abbd050175, user_id=155f21ffd31d4a92965f259319d66e38, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:04.145560 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de588c93-25f1-4476-808d-b3d716d3f630 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:04.179747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e335-df80-4edd-b5db-5071ebe38f49 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:04.180690 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e335-df80-4edd-b5db-5071ebe38f49 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:04.180690 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e335-df80-4edd-b5db-5071ebe38f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:04.189023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 851/1686] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:04 2022] PUT /identity/v3/projects/e0aff92d66cf47c2959f96abbd050175/users/155f21ffd31d4a92965f259319d66e38/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:04.215300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-8d52e335-df80-4edd-b5db-5071ebe38f49 None None] MFA Rules not processed for user `155f21ffd31d4a92965f259319d66e38`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:04.217403 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-8d52e335-df80-4edd-b5db-5071ebe38f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:04.324870 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de588c93-25f1-4476-808d-b3d716d3f630 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:04.339709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 836/1687] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:04.361304 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:04.421741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52e335-df80-4edd-b5db-5071ebe38f49 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:04.423450 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-8d52e335-df80-4edd-b5db-5071ebe38f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:04.476774 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de588c93-25f1-4476-808d-b3d716d3f630 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:04.492388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1db36-7ac7-413b-b77c-850e15bf7e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:04.493040 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1db36-7ac7-413b-b77c-850e15bf7e04 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:04.493329 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1db36-7ac7-413b-b77c-850e15bf7e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:04.493613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1db36-7ac7-413b-b77c-850e15bf7e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:04.494254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1db36-7ac7-413b-b77c-850e15bf7e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:04.496199 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1db36-7ac7-413b-b77c-850e15bf7e04 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:04.537931 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52e335-df80-4edd-b5db-5071ebe38f49 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:04.543658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2e42b-2cf3-44ef-86c3-7799c7cd15dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:04.544474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2e42b-2cf3-44ef-86c3-7799c7cd15dd service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:04.544853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2e42b-2cf3-44ef-86c3-7799c7cd15dd service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:04.545363 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2e42b-2cf3-44ef-86c3-7799c7cd15dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:04.547806 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-26a2e42b-2cf3-44ef-86c3-7799c7cd15dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:04.582495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 852/1688] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:04 2022] POST /identity/v3/projects => generated 367 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:04.583905 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1db36-7ac7-413b-b77c-850e15bf7e04 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:04.680446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:04.734179 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2e42b-2cf3-44ef-86c3-7799c7cd15dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:04.735842 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2e42b-2cf3-44ef-86c3-7799c7cd15dd service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:04.738643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1db36-7ac7-413b-b77c-850e15bf7e04 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:04.750739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c785a-82f0-4bed-b59d-e9ba7990a18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:04.754069 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c785a-82f0-4bed-b59d-e9ba7990a18c admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:04.754542 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c785a-82f0-4bed-b59d-e9ba7990a18c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:04.755561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c785a-82f0-4bed-b59d-e9ba7990a18c admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:04.759195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c785a-82f0-4bed-b59d-e9ba7990a18c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:04.764707 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c785a-82f0-4bed-b59d-e9ba7990a18c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:04.787589 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 837/1689] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:52:04.840321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2e42b-2cf3-44ef-86c3-7799c7cd15dd service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:04.842527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-26a2e42b-2cf3-44ef-86c3-7799c7cd15dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:04.851766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 853/1690] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:04 2022] POST /identity/v3/users => generated 290 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:04.856325 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c785a-82f0-4bed-b59d-e9ba7990a18c admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:04.870803 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2e42b-2cf3-44ef-86c3-7799c7cd15dd service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:04.883458 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65eb8a-69f0-4436-8f74-4fca37247286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:04.884360 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65eb8a-69f0-4436-8f74-4fca37247286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:04.884808 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65eb8a-69f0-4436-8f74-4fca37247286 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:04.885270 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65eb8a-69f0-4436-8f74-4fca37247286 admin admin] PATH_INFO: `/v3/projects/4c42cd7f76934fc89de8ef4ba7946873` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:04.886709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65eb8a-69f0-4436-8f74-4fca37247286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c42cd7f76934fc89de8ef4ba7946873)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:04.887917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: WARNING py.warnings [None req-6b65eb8a-69f0-4436-8f74-4fca37247286 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 08:52:04.887917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: warnings.warn(msg) Aug 26 08:52:04.887917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: Aug 26 08:52:04.888681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c785a-82f0-4bed-b59d-e9ba7990a18c admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:04.890068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65eb8a-69f0-4436-8f74-4fca37247286 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:04.899795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a080a-0893-46b6-96d1-2c5397103287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:04.900633 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a080a-0893-46b6-96d1-2c5397103287 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:04.901674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a080a-0893-46b6-96d1-2c5397103287 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:04.901965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a080a-0893-46b6-96d1-2c5397103287 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:04.903320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a080a-0893-46b6-96d1-2c5397103287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:04.904951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a080a-0893-46b6-96d1-2c5397103287 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:04.926112 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 854/1691] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:04.927265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a080a-0893-46b6-96d1-2c5397103287 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:04.940671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a080a-0893-46b6-96d1-2c5397103287 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:04.946535 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0fd90-9858-47c6-bb4e-69ab8017c060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:04.947584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0fd90-9858-47c6-bb4e-69ab8017c060 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:04.947795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0fd90-9858-47c6-bb4e-69ab8017c060 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:04.948200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0fd90-9858-47c6-bb4e-69ab8017c060 admin admin] PATH_INFO: `/v3/projects/6577007266b44184b1f2be3baa049306/users/bbdf738822f34b8daba15cc71f336b35/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:04.977181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0fd90-9858-47c6-bb4e-69ab8017c060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6577007266b44184b1f2be3baa049306, user_id=bbdf738822f34b8daba15cc71f336b35, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:04.981271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0fd90-9858-47c6-bb4e-69ab8017c060 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:05.023582 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 855/1692] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:04 2022] PUT /identity/v3/projects/6577007266b44184b1f2be3baa049306/users/bbdf738822f34b8daba15cc71f336b35/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:05.030716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0fd90-9858-47c6-bb4e-69ab8017c060 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:05.062065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6b65eb8a-69f0-4436-8f74-4fca37247286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c42cd7f76934fc89de8ef4ba7946873', 'request_id': 'req-6b65eb8a-69f0-4436-8f74-4fca37247286'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:05.105774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6b65eb8a-69f0-4436-8f74-4fca37247286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c42cd7f76934fc89de8ef4ba7946873', 'request_id': 'req-6b65eb8a-69f0-4436-8f74-4fca37247286'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:05.135484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6b65eb8a-69f0-4436-8f74-4fca37247286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c42cd7f76934fc89de8ef4ba7946873', 'request_id': 'req-6b65eb8a-69f0-4436-8f74-4fca37247286'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:05.153151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6b65eb8a-69f0-4436-8f74-4fca37247286 admin admin] The token cache is being invalidate because project 4c42cd7f76934fc89de8ef4ba7946873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:05.154158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6b65eb8a-69f0-4436-8f74-4fca37247286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:05.155146 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6b65eb8a-69f0-4436-8f74-4fca37247286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:05.181104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 838/1693] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:04 2022] DELETE /identity/v3/projects/4c42cd7f76934fc89de8ef4ba7946873 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:05.186652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1952e-37c9-4ce4-8809-d8e9ac9ad1f3 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:05.187445 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1952e-37c9-4ce4-8809-d8e9ac9ad1f3 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:05.188334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1952e-37c9-4ce4-8809-d8e9ac9ad1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:05.251223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0fd90-9858-47c6-bb4e-69ab8017c060 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:05.257889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:05.271648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-12b1952e-37c9-4ce4-8809-d8e9ac9ad1f3 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:05.281270 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-12b1952e-37c9-4ce4-8809-d8e9ac9ad1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:05.400555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf77f4e-c6ab-45cb-9eb7-9c33257d78b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:05.401450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf77f4e-c6ab-45cb-9eb7-9c33257d78b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:05.401874 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf77f4e-c6ab-45cb-9eb7-9c33257d78b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:05.402279 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf77f4e-c6ab-45cb-9eb7-9c33257d78b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:05.403275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf77f4e-c6ab-45cb-9eb7-9c33257d78b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:05.405088 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf77f4e-c6ab-45cb-9eb7-9c33257d78b7 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:05.434220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 856/1694] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:05.438321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf77f4e-c6ab-45cb-9eb7-9c33257d78b7 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:05.443396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-baf77f4e-c6ab-45cb-9eb7-9c33257d78b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:05.471402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf77f4e-c6ab-45cb-9eb7-9c33257d78b7 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:05.486040 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1db6a3-eae5-4bb2-8b70-8a77cff67aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:05.487075 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1db6a3-eae5-4bb2-8b70-8a77cff67aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:05.487368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1db6a3-eae5-4bb2-8b70-8a77cff67aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:05.487651 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1db6a3-eae5-4bb2-8b70-8a77cff67aa8 admin admin] PATH_INFO: `/v3/projects/6577007266b44184b1f2be3baa049306/users/bbdf738822f34b8daba15cc71f336b35/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:05.489734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1db6a3-eae5-4bb2-8b70-8a77cff67aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6577007266b44184b1f2be3baa049306, user_id=bbdf738822f34b8daba15cc71f336b35, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:05.492391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1db6a3-eae5-4bb2-8b70-8a77cff67aa8 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:05.502704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 839/1695] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:52:05.504559 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b898703-c7de-4877-830f-8886b6a21f44 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:05.504927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b898703-c7de-4877-830f-8886b6a21f44 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:05.505437 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b898703-c7de-4877-830f-8886b6a21f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:05.519266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 857/1696] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:05 2022] PUT /identity/v3/projects/6577007266b44184b1f2be3baa049306/users/bbdf738822f34b8daba15cc71f336b35/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:05.529382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1cccb-6ab1-4084-8f0d-12caa931076c None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:05.529676 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1cccb-6ab1-4084-8f0d-12caa931076c None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:05.529960 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1cccb-6ab1-4084-8f0d-12caa931076c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:05.544872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-3b898703-c7de-4877-830f-8886b6a21f44 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:05.547764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3b898703-c7de-4877-830f-8886b6a21f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:05.589053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-04d1cccb-6ab1-4084-8f0d-12caa931076c None None] MFA Rules not processed for user `bbdf738822f34b8daba15cc71f336b35`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:05.590538 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-04d1cccb-6ab1-4084-8f0d-12caa931076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:05.742993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 840/1697] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:05.742993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b898703-c7de-4877-830f-8886b6a21f44 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:05.744449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 858/1698] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:52:05.745500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1cccb-6ab1-4084-8f0d-12caa931076c None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:05.751033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3b898703-c7de-4877-830f-8886b6a21f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:05.771796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:05.776983 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1cccb-6ab1-4084-8f0d-12caa931076c None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:05.781602 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b898703-c7de-4877-830f-8886b6a21f44 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:05.793939 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26400b7f-ddb4-4030-ad15-d2445d36df4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:05.794861 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26400b7f-ddb4-4030-ad15-d2445d36df4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:05.795152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26400b7f-ddb4-4030-ad15-d2445d36df4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:05.795427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26400b7f-ddb4-4030-ad15-d2445d36df4b admin admin] PATH_INFO: `/v3/projects/b57fa41f43824327987471cccc679a7c` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:05.795971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc910276-ab6f-4c5b-b5b2-a490f94acdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:05.796670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc910276-ab6f-4c5b-b5b2-a490f94acdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:05.796871 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc910276-ab6f-4c5b-b5b2-a490f94acdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:05.797181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc910276-ab6f-4c5b-b5b2-a490f94acdf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:05.797413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26400b7f-ddb4-4030-ad15-d2445d36df4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b57fa41f43824327987471cccc679a7c)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:05.797845 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc910276-ab6f-4c5b-b5b2-a490f94acdf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:52:05.798151 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc910276-ab6f-4c5b-b5b2-a490f94acdf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:05.801041 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc910276-ab6f-4c5b-b5b2-a490f94acdf3 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:05.802169 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26400b7f-ddb4-4030-ad15-d2445d36df4b admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:05.826569 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 859/1699] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:52:05.827611 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc910276-ab6f-4c5b-b5b2-a490f94acdf3 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:05.839425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-bc910276-ab6f-4c5b-b5b2-a490f94acdf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:05.953181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc910276-ab6f-4c5b-b5b2-a490f94acdf3 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:05.958069 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-26400b7f-ddb4-4030-ad15-d2445d36df4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b57fa41f43824327987471cccc679a7c', 'request_id': 'req-26400b7f-ddb4-4030-ad15-d2445d36df4b'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:05.979478 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-26400b7f-ddb4-4030-ad15-d2445d36df4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b57fa41f43824327987471cccc679a7c', 'request_id': 'req-26400b7f-ddb4-4030-ad15-d2445d36df4b'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:06.003374 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:06.010607 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-26400b7f-ddb4-4030-ad15-d2445d36df4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b57fa41f43824327987471cccc679a7c', 'request_id': 'req-26400b7f-ddb4-4030-ad15-d2445d36df4b'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:06.053522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-26400b7f-ddb4-4030-ad15-d2445d36df4b admin admin] The token cache is being invalidate because project b57fa41f43824327987471cccc679a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:06.054912 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-26400b7f-ddb4-4030-ad15-d2445d36df4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:06.057597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-26400b7f-ddb4-4030-ad15-d2445d36df4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:06.061326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 841/1700] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:05 2022] DELETE /identity/v3/projects/b57fa41f43824327987471cccc679a7c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:06.063010 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26400b7f-ddb4-4030-ad15-d2445d36df4b admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:06.071127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-26400b7f-ddb4-4030-ad15-d2445d36df4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:06.082406 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f13ed2-0664-4669-a4c3-683f46ae957f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:06.083033 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f13ed2-0664-4669-a4c3-683f46ae957f service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:06.083320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f13ed2-0664-4669-a4c3-683f46ae957f service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:06.083597 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f13ed2-0664-4669-a4c3-683f46ae957f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:06.087814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-08f13ed2-0664-4669-a4c3-683f46ae957f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:06.216829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f13ed2-0664-4669-a4c3-683f46ae957f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:06.218605 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f13ed2-0664-4669-a4c3-683f46ae957f service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:06.252728 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 860/1701] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:06.254395 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c259231-deb5-498e-a5b4-673ed14cc9a1 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:06.257519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c259231-deb5-498e-a5b4-673ed14cc9a1 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:06.257960 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c259231-deb5-498e-a5b4-673ed14cc9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:06.260611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26400b7f-ddb4-4030-ad15-d2445d36df4b admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:06.273585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c302881-dc6b-49ec-b18c-785906d9705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:06.274043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c302881-dc6b-49ec-b18c-785906d9705f admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:06.274515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c302881-dc6b-49ec-b18c-785906d9705f admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:06.277190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c302881-dc6b-49ec-b18c-785906d9705f admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:06.278011 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c302881-dc6b-49ec-b18c-785906d9705f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:06.301732 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c302881-dc6b-49ec-b18c-785906d9705f admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:06.307506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0c259231-deb5-498e-a5b4-673ed14cc9a1 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:06.310193 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0c259231-deb5-498e-a5b4-673ed14cc9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:06.326028 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 861/1702] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:06.334761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d8ebe-6188-4328-ad2b-7ce18ae50de2 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:06.335134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d8ebe-6188-4328-ad2b-7ce18ae50de2 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:06.335424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d8ebe-6188-4328-ad2b-7ce18ae50de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:06.383044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-559d8ebe-6188-4328-ad2b-7ce18ae50de2 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:06.386141 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-559d8ebe-6188-4328-ad2b-7ce18ae50de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:06.415839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 862/1703] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:52:06.416678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d8ebe-6188-4328-ad2b-7ce18ae50de2 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:06.421850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 842/1704] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:06 2022] POST /identity/v3/projects => generated 373 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:06.424977 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c302881-dc6b-49ec-b18c-785906d9705f admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:06.426107 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-559d8ebe-6188-4328-ad2b-7ce18ae50de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:06.453286 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d8ebe-6188-4328-ad2b-7ce18ae50de2 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:06.587332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5bbbf-0fb6-4f52-84cf-77f9f9655914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:06.587332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5bbbf-0fb6-4f52-84cf-77f9f9655914 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:06.587332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5bbbf-0fb6-4f52-84cf-77f9f9655914 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:06.587332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5bbbf-0fb6-4f52-84cf-77f9f9655914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:06.589551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ddb5bbbf-0fb6-4f52-84cf-77f9f9655914 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:06.708789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c302881-dc6b-49ec-b18c-785906d9705f admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:06.739458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5bbbf-0fb6-4f52-84cf-77f9f9655914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:06.741017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5bbbf-0fb6-4f52-84cf-77f9f9655914 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:06.751176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1ce45-c83b-4a73-a89f-5eb34f05c3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:06.751743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1ce45-c83b-4a73-a89f-5eb34f05c3ef admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:06.753130 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1ce45-c83b-4a73-a89f-5eb34f05c3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:06.753425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1ce45-c83b-4a73-a89f-5eb34f05c3ef admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:06.757594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1ce45-c83b-4a73-a89f-5eb34f05c3ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:52:06.757977 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1ce45-c83b-4a73-a89f-5eb34f05c3ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:06.759662 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1ce45-c83b-4a73-a89f-5eb34f05c3ef admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:06.779335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 863/1705] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:06.780305 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5bbbf-0fb6-4f52-84cf-77f9f9655914 service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:06.790046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 843/1706] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:52:06.794814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1ce45-c83b-4a73-a89f-5eb34f05c3ef admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:06.813561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5bbbf-0fb6-4f52-84cf-77f9f9655914 service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:06.823370 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1ce45-c83b-4a73-a89f-5eb34f05c3ef admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:06.832575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7110f-8b6b-445c-a0fb-e7886868fdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:06.833232 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7110f-8b6b-445c-a0fb-e7886868fdba admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:06.833514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7110f-8b6b-445c-a0fb-e7886868fdba admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:06.833700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e66ebe-e7be-463e-bab4-61d1a83f9dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:06.833822 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7110f-8b6b-445c-a0fb-e7886868fdba admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:06.834403 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7110f-8b6b-445c-a0fb-e7886868fdba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:06.834521 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e66ebe-e7be-463e-bab4-61d1a83f9dcb admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:06.834898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e66ebe-e7be-463e-bab4-61d1a83f9dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:06.835701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e66ebe-e7be-463e-bab4-61d1a83f9dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:06.836344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e66ebe-e7be-463e-bab4-61d1a83f9dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:06.839604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7110f-8b6b-445c-a0fb-e7886868fdba admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:06.843954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e66ebe-e7be-463e-bab4-61d1a83f9dcb admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:06.856729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:06.864963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:06.893238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 864/1707] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:06 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:06.899192 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7110f-8b6b-445c-a0fb-e7886868fdba admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:06.923509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 844/1708] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:06 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:06.924494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e66ebe-e7be-463e-bab4-61d1a83f9dcb admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:06.931686 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7110f-8b6b-445c-a0fb-e7886868fdba admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:07.200929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dafcd-4012-4d4c-a7eb-936584065b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:07.201686 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dafcd-4012-4d4c-a7eb-936584065b66 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:07.202124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dafcd-4012-4d4c-a7eb-936584065b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:07.202505 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dafcd-4012-4d4c-a7eb-936584065b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:07.203181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dafcd-4012-4d4c-a7eb-936584065b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:07.204823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dafcd-4012-4d4c-a7eb-936584065b66 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:07.207744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e66ebe-e7be-463e-bab4-61d1a83f9dcb admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:07.229892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560b25a-ff08-4e8d-8533-a6f6b5be51d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:07.230805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560b25a-ff08-4e8d-8533-a6f6b5be51d5 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:07.230805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560b25a-ff08-4e8d-8533-a6f6b5be51d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:07.231106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560b25a-ff08-4e8d-8533-a6f6b5be51d5 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:07.231746 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560b25a-ff08-4e8d-8533-a6f6b5be51d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:07.233866 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560b25a-ff08-4e8d-8533-a6f6b5be51d5 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:07.249128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 865/1709] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:07.250781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c7f51-5eaa-4bde-94e3-9c05925597be None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:07.250967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c7f51-5eaa-4bde-94e3-9c05925597be None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:07.251253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c7f51-5eaa-4bde-94e3-9c05925597be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:07.313042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 845/1710] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:06 2022] POST /identity/v3/users => generated 284 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:07.313827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560b25a-ff08-4e8d-8533-a6f6b5be51d5 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:07.354071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560b25a-ff08-4e8d-8533-a6f6b5be51d5 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:07.370682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-fc7c7f51-5eaa-4bde-94e3-9c05925597be None None] MFA Rules not processed for user `798c692df3b141849d5a4427b3cd1e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:07.372337 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27ca1e-f324-4ef8-b84a-bc41c0e5f7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:07.373129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27ca1e-f324-4ef8-b84a-bc41c0e5f7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:07.373421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27ca1e-f324-4ef8-b84a-bc41c0e5f7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:07.373700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27ca1e-f324-4ef8-b84a-bc41c0e5f7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:07.374363 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27ca1e-f324-4ef8-b84a-bc41c0e5f7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:07.375364 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-fc7c7f51-5eaa-4bde-94e3-9c05925597be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:07.375980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27ca1e-f324-4ef8-b84a-bc41c0e5f7c0 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:07.421366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 846/1711] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:07.422351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27ca1e-f324-4ef8-b84a-bc41c0e5f7c0 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:07.463541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27ca1e-f324-4ef8-b84a-bc41c0e5f7c0 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:07.493776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424aab23-4bd0-420b-8239-91c8f19be591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:07.495023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424aab23-4bd0-420b-8239-91c8f19be591 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:07.495023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424aab23-4bd0-420b-8239-91c8f19be591 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:07.495023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424aab23-4bd0-420b-8239-91c8f19be591 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:07.495734 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424aab23-4bd0-420b-8239-91c8f19be591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:07.497399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424aab23-4bd0-420b-8239-91c8f19be591 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:07.544775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 847/1712] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:07.545663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424aab23-4bd0-420b-8239-91c8f19be591 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:07.594526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 866/1713] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:07.596433 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c7f51-5eaa-4bde-94e3-9c05925597be None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:07.598880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424aab23-4bd0-420b-8239-91c8f19be591 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:07.627903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ec1a1-fcea-415c-b6dc-df048aa63c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:07.628630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ec1a1-fcea-415c-b6dc-df048aa63c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:07.628919 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ec1a1-fcea-415c-b6dc-df048aa63c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:07.629224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ec1a1-fcea-415c-b6dc-df048aa63c3e admin admin] PATH_INFO: `/v3/projects/0a6c8b7602434aff927ccdb2a1f8ce1f/users/60875191b8c54d6d827eb36210810154/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:07.631065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c7f51-5eaa-4bde-94e3-9c05925597be None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:07.648812 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58653cce-ab56-4913-8419-09bcbedc42d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:07.649671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58653cce-ab56-4913-8419-09bcbedc42d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:07.650869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58653cce-ab56-4913-8419-09bcbedc42d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:07.651872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58653cce-ab56-4913-8419-09bcbedc42d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:07.654016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58653cce-ab56-4913-8419-09bcbedc42d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:07.655861 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58653cce-ab56-4913-8419-09bcbedc42d0 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:07.679338 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ec1a1-fcea-415c-b6dc-df048aa63c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6c8b7602434aff927ccdb2a1f8ce1f, user_id=60875191b8c54d6d827eb36210810154, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:07.682169 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ec1a1-fcea-415c-b6dc-df048aa63c3e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:07.696571 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 867/1714] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:07.698763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58653cce-ab56-4913-8419-09bcbedc42d0 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:07.702923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-58653cce-ab56-4913-8419-09bcbedc42d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:07.721306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 848/1715] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:07 2022] PUT /identity/v3/projects/0a6c8b7602434aff927ccdb2a1f8ce1f/users/60875191b8c54d6d827eb36210810154/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:07.725391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ec1a1-fcea-415c-b6dc-df048aa63c3e admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:07.861443 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58653cce-ab56-4913-8419-09bcbedc42d0 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:07.868986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:07.918796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ec1a1-fcea-415c-b6dc-df048aa63c3e admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:07.945877 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f051d-8d8b-413b-9182-eedc93159542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:07.946436 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f051d-8d8b-413b-9182-eedc93159542 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:07.946720 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f051d-8d8b-413b-9182-eedc93159542 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:07.946995 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f051d-8d8b-413b-9182-eedc93159542 admin admin] PATH_INFO: `/v3/projects/6e094e62302847d388771a966524e1bd/users/ee6b3642a7b647c3a8a677f26ac4eb62/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:07.983764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f051d-8d8b-413b-9182-eedc93159542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e094e62302847d388771a966524e1bd, user_id=ee6b3642a7b647c3a8a677f26ac4eb62, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:07.991086 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f051d-8d8b-413b-9182-eedc93159542 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:08.032737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 849/1716] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:07 2022] PUT /identity/v3/projects/6e094e62302847d388771a966524e1bd/users/ee6b3642a7b647c3a8a677f26ac4eb62/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:08.034349 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aace8-f5e4-4a10-804b-bb19291faa73 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:08.034645 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aace8-f5e4-4a10-804b-bb19291faa73 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:08.034922 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aace8-f5e4-4a10-804b-bb19291faa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:08.069967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe119d7-3e90-48a8-8087-bcd70ef3ab2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:08.071663 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe119d7-3e90-48a8-8087-bcd70ef3ab2c service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:08.073331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe119d7-3e90-48a8-8087-bcd70ef3ab2c service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:08.073781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe119d7-3e90-48a8-8087-bcd70ef3ab2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:08.096561 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:08.115013 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-e47aace8-f5e4-4a10-804b-bb19291faa73 None None] MFA Rules not processed for user `60875191b8c54d6d827eb36210810154`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:08.116277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-e47aace8-f5e4-4a10-804b-bb19291faa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:08.287420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 850/1717] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:08.288743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5af96-2d68-4d06-a2c2-fc2ef1736165 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:08.289060 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5af96-2d68-4d06-a2c2-fc2ef1736165 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:08.289332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5af96-2d68-4d06-a2c2-fc2ef1736165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:08.301945 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe119d7-3e90-48a8-8087-bcd70ef3ab2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:08.303825 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe119d7-3e90-48a8-8087-bcd70ef3ab2c service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:08.352648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 868/1718] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:08.355995 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-c5d5af96-2d68-4d06-a2c2-fc2ef1736165 None None] MFA Rules not processed for user `ee6b3642a7b647c3a8a677f26ac4eb62`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:08.357470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c5d5af96-2d68-4d06-a2c2-fc2ef1736165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:08.364284 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe119d7-3e90-48a8-8087-bcd70ef3ab2c service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:08.416160 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe119d7-3e90-48a8-8087-bcd70ef3ab2c service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:08.591105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 851/1719] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:08.596498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5af96-2d68-4d06-a2c2-fc2ef1736165 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:08.654879 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e455811-9a00-4233-af94-cc1466090b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:08.661429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e455811-9a00-4233-af94-cc1466090b90 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:08.664698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e455811-9a00-4233-af94-cc1466090b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:08.665014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e455811-9a00-4233-af94-cc1466090b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:08.665807 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e455811-9a00-4233-af94-cc1466090b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:08.678008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e455811-9a00-4233-af94-cc1466090b90 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:08.789344 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 869/1720] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:08 2022] POST /identity/v3/projects => generated 371 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:08.810238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697236e-d91b-4733-8d08-d39237d846ff None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:08.810544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697236e-d91b-4733-8d08-d39237d846ff None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:08.812445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697236e-d91b-4733-8d08-d39237d846ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:08.867908 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-a697236e-d91b-4733-8d08-d39237d846ff None None] MFA Rules not processed for user `0479c86d4cfc40c8a811a390bfd53152`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:08.869575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a697236e-d91b-4733-8d08-d39237d846ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:08.875709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5af96-2d68-4d06-a2c2-fc2ef1736165 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:08.937455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:08.949574 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:08.982653 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3facb83-2037-48d1-b903-6b05f7e24aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:08.984027 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3facb83-2037-48d1-b903-6b05f7e24aeb admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:08.985027 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3facb83-2037-48d1-b903-6b05f7e24aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:08.985027 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3facb83-2037-48d1-b903-6b05f7e24aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:08.985694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3facb83-2037-48d1-b903-6b05f7e24aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:08.990027 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3facb83-2037-48d1-b903-6b05f7e24aeb admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:09.039676 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 852/1721] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:08 2022] POST /identity/v3/projects => generated 369 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:09.039676 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3facb83-2037-48d1-b903-6b05f7e24aeb admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:09.106999 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 870/1722] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:09.108493 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d94b6-144a-4a35-be0f-ce24f1e8778f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:09.108774 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d94b6-144a-4a35-be0f-ce24f1e8778f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:09.109067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d94b6-144a-4a35-be0f-ce24f1e8778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:09.187901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0f5d94b6-144a-4a35-be0f-ce24f1e8778f None None] MFA Rules not processed for user `e031367406df4a3d95f2ed9e2eb8efae`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:09.191602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0f5d94b6-144a-4a35-be0f-ce24f1e8778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:09.219461 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3facb83-2037-48d1-b903-6b05f7e24aeb admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:09.238019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23c045-99b3-46d5-b95b-54965d157696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:09.238453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23c045-99b3-46d5-b95b-54965d157696 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:09.238738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23c045-99b3-46d5-b95b-54965d157696 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:09.239013 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23c045-99b3-46d5-b95b-54965d157696 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:09.241980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23c045-99b3-46d5-b95b-54965d157696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:09.244057 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23c045-99b3-46d5-b95b-54965d157696 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:09.307737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 853/1723] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:09 2022] POST /identity/v3/users => generated 292 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:09.309884 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23c045-99b3-46d5-b95b-54965d157696 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:09.349747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23c045-99b3-46d5-b95b-54965d157696 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:09.369450 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0d4fc-e837-47fe-b9bc-f8734fbeb316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:09.371329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0d4fc-e837-47fe-b9bc-f8734fbeb316 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:09.371616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0d4fc-e837-47fe-b9bc-f8734fbeb316 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:09.371893 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0d4fc-e837-47fe-b9bc-f8734fbeb316 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:09.372538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0d4fc-e837-47fe-b9bc-f8734fbeb316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:09.375897 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0d4fc-e837-47fe-b9bc-f8734fbeb316 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:09.424181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 871/1724] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:09.424181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dac7af-b439-41ad-940f-08c4ca78b58b None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:09.424181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dac7af-b439-41ad-940f-08c4ca78b58b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:09.424181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dac7af-b439-41ad-940f-08c4ca78b58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:09.451493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 854/1725] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:09 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:09.452048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0d4fc-e837-47fe-b9bc-f8734fbeb316 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:09.490374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0d4fc-e837-47fe-b9bc-f8734fbeb316 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:09.496095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-35dac7af-b439-41ad-940f-08c4ca78b58b None None] MFA Rules not processed for user `0479c86d4cfc40c8a811a390bfd53152`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:09.497477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-35dac7af-b439-41ad-940f-08c4ca78b58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:09.508688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521441f-1bf5-419d-a9ba-45ed7dd9a5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:09.511603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521441f-1bf5-419d-a9ba-45ed7dd9a5eb admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:09.511892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521441f-1bf5-419d-a9ba-45ed7dd9a5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:09.512169 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521441f-1bf5-419d-a9ba-45ed7dd9a5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:09.512841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521441f-1bf5-419d-a9ba-45ed7dd9a5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:09.519033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521441f-1bf5-419d-a9ba-45ed7dd9a5eb admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:09.560258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 855/1726] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:09.565229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521441f-1bf5-419d-a9ba-45ed7dd9a5eb admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:09.570933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7521441f-1bf5-419d-a9ba-45ed7dd9a5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:09.717090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 872/1727] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:09.720191 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dac7af-b439-41ad-940f-08c4ca78b58b None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:09.768083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dac7af-b439-41ad-940f-08c4ca78b58b None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:09.780358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4a79e-cf6a-41a2-a72d-31abf319e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:09.781274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4a79e-cf6a-41a2-a72d-31abf319e266 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:09.781658 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4a79e-cf6a-41a2-a72d-31abf319e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:09.782795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4a79e-cf6a-41a2-a72d-31abf319e266 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:09.783705 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4a79e-cf6a-41a2-a72d-31abf319e266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:09.788443 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4a79e-cf6a-41a2-a72d-31abf319e266 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:09.820554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 873/1728] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:09.821765 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4a79e-cf6a-41a2-a72d-31abf319e266 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:09.851096 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4a79e-cf6a-41a2-a72d-31abf319e266 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:09.853910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521441f-1bf5-419d-a9ba-45ed7dd9a5eb admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:09.868209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49204be8-24ba-4618-922e-ba8dae17779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:09.868865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49204be8-24ba-4618-922e-ba8dae17779f admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:09.872440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49204be8-24ba-4618-922e-ba8dae17779f admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:09.872440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49204be8-24ba-4618-922e-ba8dae17779f admin admin] PATH_INFO: `/v3/projects/664b56cbc931481daa50b38a2f19f2cb/users/0c56bae7ae8047889bc37505fa259e30/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:09.880793 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fde9ea-7176-479e-b079-2109a716c5fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:09.881468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fde9ea-7176-479e-b079-2109a716c5fb service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:09.881758 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fde9ea-7176-479e-b079-2109a716c5fb service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:09.882044 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fde9ea-7176-479e-b079-2109a716c5fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:09.909809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49204be8-24ba-4618-922e-ba8dae17779f admin admin] RBAC: Authorizing `identity:create_grant(project_id=664b56cbc931481daa50b38a2f19f2cb, user_id=0c56bae7ae8047889bc37505fa259e30, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:09.918333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fde9ea-7176-479e-b079-2109a716c5fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:09.920023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fde9ea-7176-479e-b079-2109a716c5fb service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:09.921357 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49204be8-24ba-4618-922e-ba8dae17779f admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:09.951029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 874/1729] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:09 2022] PUT /identity/v3/projects/664b56cbc931481daa50b38a2f19f2cb/users/0c56bae7ae8047889bc37505fa259e30/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:09.952229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49204be8-24ba-4618-922e-ba8dae17779f admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:09.953082 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 856/1730] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:09.956246 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fde9ea-7176-479e-b079-2109a716c5fb service nova] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:10.005807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fde9ea-7176-479e-b079-2109a716c5fb service nova] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:10.007400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:10.028361 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:10.165020 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49204be8-24ba-4618-922e-ba8dae17779f admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:10.190310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc790645-4c0d-4895-b5ce-1b284cff3c2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:10.191803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc790645-4c0d-4895-b5ce-1b284cff3c2c service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:10.191803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc790645-4c0d-4895-b5ce-1b284cff3c2c service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:10.191803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc790645-4c0d-4895-b5ce-1b284cff3c2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:10.215750 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61d67f-6082-4869-9fa0-a873bbb9a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:10.216441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61d67f-6082-4869-9fa0-a873bbb9a371 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:10.216728 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61d67f-6082-4869-9fa0-a873bbb9a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:10.217393 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61d67f-6082-4869-9fa0-a873bbb9a371 admin admin] PATH_INFO: `/v3/projects/081c30783d1b4db5a60d83ace30eff4e/users/a452064314e74453b89e3670c2dcabdc/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:10.249255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61d67f-6082-4869-9fa0-a873bbb9a371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=081c30783d1b4db5a60d83ace30eff4e, user_id=a452064314e74453b89e3670c2dcabdc, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:10.254568 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61d67f-6082-4869-9fa0-a873bbb9a371 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:10.299430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 857/1731] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:09 2022] PUT /identity/v3/projects/081c30783d1b4db5a60d83ace30eff4e/users/a452064314e74453b89e3670c2dcabdc/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:10.300587 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61d67f-6082-4869-9fa0-a873bbb9a371 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:10.322828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc790645-4c0d-4895-b5ce-1b284cff3c2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:10.324645 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc790645-4c0d-4895-b5ce-1b284cff3c2c service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:10.364236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 875/1732] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:10.365869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc790645-4c0d-4895-b5ce-1b284cff3c2c service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:10.370965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-cc790645-4c0d-4895-b5ce-1b284cff3c2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:10.409787 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc790645-4c0d-4895-b5ce-1b284cff3c2c service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:10.483675 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61d67f-6082-4869-9fa0-a873bbb9a371 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:10.499106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a010e94-4e03-4836-800b-fbdb4cb56354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:10.499921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a010e94-4e03-4836-800b-fbdb4cb56354 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:10.500242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a010e94-4e03-4836-800b-fbdb4cb56354 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:10.500621 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a010e94-4e03-4836-800b-fbdb4cb56354 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:10.501432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a010e94-4e03-4836-800b-fbdb4cb56354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:10.507296 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a010e94-4e03-4836-800b-fbdb4cb56354 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:10.528912 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 858/1733] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:10.528912 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a010e94-4e03-4836-800b-fbdb4cb56354 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:10.552418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a010e94-4e03-4836-800b-fbdb4cb56354 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:10.558806 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504cb78-721f-4b87-9c57-7c59fbf47d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:10.560046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504cb78-721f-4b87-9c57-7c59fbf47d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:10.560336 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504cb78-721f-4b87-9c57-7c59fbf47d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:10.560699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504cb78-721f-4b87-9c57-7c59fbf47d1a admin admin] PATH_INFO: `/v3/users/c417a0616cb64c8fa0d1b3f638d1a532` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:10.562668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504cb78-721f-4b87-9c57-7c59fbf47d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c417a0616cb64c8fa0d1b3f638d1a532)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:10.566480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504cb78-721f-4b87-9c57-7c59fbf47d1a admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:10.566616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263f2a0-6097-46eb-9876-69353e3003fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:10.579602 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263f2a0-6097-46eb-9876-69353e3003fd admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:10.582026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263f2a0-6097-46eb-9876-69353e3003fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:10.582026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263f2a0-6097-46eb-9876-69353e3003fd admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:10.583477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263f2a0-6097-46eb-9876-69353e3003fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:10.591253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263f2a0-6097-46eb-9876-69353e3003fd admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:10.628093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 859/1734] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:10.628853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263f2a0-6097-46eb-9876-69353e3003fd admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:10.678071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263f2a0-6097-46eb-9876-69353e3003fd admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:10.681084 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0504cb78-721f-4b87-9c57-7c59fbf47d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c417a0616cb64c8fa0d1b3f638d1a532'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:10.700306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aa7bf-ff69-44ac-99ff-46fef80863f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:10.700982 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aa7bf-ff69-44ac-99ff-46fef80863f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:10.703659 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aa7bf-ff69-44ac-99ff-46fef80863f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:10.703739 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aa7bf-ff69-44ac-99ff-46fef80863f9 admin admin] PATH_INFO: `/v3/projects/664b56cbc931481daa50b38a2f19f2cb/users/0c56bae7ae8047889bc37505fa259e30/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:10.716071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0504cb78-721f-4b87-9c57-7c59fbf47d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c417a0616cb64c8fa0d1b3f638d1a532'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:10.724206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0aa7bf-ff69-44ac-99ff-46fef80863f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=664b56cbc931481daa50b38a2f19f2cb, user_id=0c56bae7ae8047889bc37505fa259e30, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:10.727148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0aa7bf-ff69-44ac-99ff-46fef80863f9 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:10.729186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0504cb78-721f-4b87-9c57-7c59fbf47d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c417a0616cb64c8fa0d1b3f638d1a532'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:10.745507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:10.765173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0504cb78-721f-4b87-9c57-7c59fbf47d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c417a0616cb64c8fa0d1b3f638d1a532'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:10.787904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 860/1735] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:10 2022] PUT /identity/v3/projects/664b56cbc931481daa50b38a2f19f2cb/users/0c56bae7ae8047889bc37505fa259e30/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:10.788648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aa7bf-ff69-44ac-99ff-46fef80863f9 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:10.807934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0504cb78-721f-4b87-9c57-7c59fbf47d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c417a0616cb64c8fa0d1b3f638d1a532'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:10.831079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 876/1736] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:10 2022] DELETE /identity/v3/users/c417a0616cb64c8fa0d1b3f638d1a532 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:10.835984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34de70b-b562-4aed-a587-47c1ad196b9d None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:10.838737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34de70b-b562-4aed-a587-47c1ad196b9d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:10.839314 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34de70b-b562-4aed-a587-47c1ad196b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:10.930831 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aa7bf-ff69-44ac-99ff-46fef80863f9 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:10.964078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:10.964417 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-b34de70b-b562-4aed-a587-47c1ad196b9d None None] MFA Rules not processed for user `0c56bae7ae8047889bc37505fa259e30`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:10.971697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b34de70b-b562-4aed-a587-47c1ad196b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:11.076940 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3836-36f1-4355-be5d-ac5abc5a212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:11.077743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3836-36f1-4355-be5d-ac5abc5a212a admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:11.078014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3836-36f1-4355-be5d-ac5abc5a212a admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:11.078294 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3836-36f1-4355-be5d-ac5abc5a212a admin admin] PATH_INFO: `/v3/projects/081c30783d1b4db5a60d83ace30eff4e/users/a452064314e74453b89e3670c2dcabdc/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:11.088516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db3836-36f1-4355-be5d-ac5abc5a212a admin admin] RBAC: Authorizing `identity:create_grant(project_id=081c30783d1b4db5a60d83ace30eff4e, user_id=a452064314e74453b89e3670c2dcabdc, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:11.095114 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db3836-36f1-4355-be5d-ac5abc5a212a admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:11.112337 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 861/1737] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:10 2022] PUT /identity/v3/projects/081c30783d1b4db5a60d83ace30eff4e/users/a452064314e74453b89e3670c2dcabdc/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:11.113677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34958e0-ea2f-4fe4-b9ab-309ae8163256 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:11.113975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34958e0-ea2f-4fe4-b9ab-309ae8163256 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:11.114257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34958e0-ea2f-4fe4-b9ab-309ae8163256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:11.137088 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-d34958e0-ea2f-4fe4-b9ab-309ae8163256 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:11.138347 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d34958e0-ea2f-4fe4-b9ab-309ae8163256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:11.191695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 877/1738] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:11.204751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5318a1-9e93-4b5c-bded-ce9da7797a35 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:11.205134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5318a1-9e93-4b5c-bded-ce9da7797a35 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:11.205420 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5318a1-9e93-4b5c-bded-ce9da7797a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:11.281971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-9b5318a1-9e93-4b5c-bded-ce9da7797a35 None None] MFA Rules not processed for user `a452064314e74453b89e3670c2dcabdc`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:11.284846 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9b5318a1-9e93-4b5c-bded-ce9da7797a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:11.291841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 862/1739] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:11.293006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34958e0-ea2f-4fe4-b9ab-309ae8163256 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:11.299670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d34958e0-ea2f-4fe4-b9ab-309ae8163256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:11.446527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34958e0-ea2f-4fe4-b9ab-309ae8163256 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:11.457010 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffbc9f-63cd-42c4-a673-809fb40db945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:11.458653 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffbc9f-63cd-42c4-a673-809fb40db945 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:11.460638 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffbc9f-63cd-42c4-a673-809fb40db945 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:11.462955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffbc9f-63cd-42c4-a673-809fb40db945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:11.516201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 878/1740] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:11.516201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5318a1-9e93-4b5c-bded-ce9da7797a35 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:11.523005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9b5318a1-9e93-4b5c-bded-ce9da7797a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:11.640192 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:11.653959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:11.662934 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffbc9f-63cd-42c4-a673-809fb40db945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:11.670432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffbc9f-63cd-42c4-a673-809fb40db945 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:11.688917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5318a1-9e93-4b5c-bded-ce9da7797a35 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:11.711979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 863/1741] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:11.713615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde0121-cc6d-45d5-be79-20bf34941ffa None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:11.713822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde0121-cc6d-45d5-be79-20bf34941ffa None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:11.714106 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde0121-cc6d-45d5-be79-20bf34941ffa None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:11.715618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 864/1742] 10.222.0.76 () {54 vars in 912 bytes} [Fri Aug 26 08:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:52:11.721049 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f85a6c-6620-4d08-8d81-7330399c4bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:11.722027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f85a6c-6620-4d08-8d81-7330399c4bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:11.722468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f85a6c-6620-4d08-8d81-7330399c4bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:11.722899 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f85a6c-6620-4d08-8d81-7330399c4bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:11.723361 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde0121-cc6d-45d5-be79-20bf34941ffa None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:11.728534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-acde0121-cc6d-45d5-be79-20bf34941ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:11.764563 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f85a6c-6620-4d08-8d81-7330399c4bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:11.766082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f85a6c-6620-4d08-8d81-7330399c4bb9 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:11.771779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde0121-cc6d-45d5-be79-20bf34941ffa None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:11.780440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5c69a-f2db-48c5-8ef6-e8cd201c27aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:11.782322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5c69a-f2db-48c5-8ef6-e8cd201c27aa service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:11.783275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5c69a-f2db-48c5-8ef6-e8cd201c27aa service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:11.783571 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5c69a-f2db-48c5-8ef6-e8cd201c27aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:11.803152 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 879/1743] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:11.804837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c2e66-b19e-407a-ba12-0335a6820c8a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:11.809945 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c2e66-b19e-407a-ba12-0335a6820c8a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:11.815370 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c2e66-b19e-407a-ba12-0335a6820c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:11.816516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5c69a-f2db-48c5-8ef6-e8cd201c27aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:11.835413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5c69a-f2db-48c5-8ef6-e8cd201c27aa service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:11.875286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 865/1744] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:11.978955 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-cd1c2e66-b19e-407a-ba12-0335a6820c8a None None] MFA Rules not processed for user `e8a867070e974a918a906148bbfd1fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:11.980405 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-cd1c2e66-b19e-407a-ba12-0335a6820c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:12.055348 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 880/1745] 10.222.0.76 () {58 vars in 1009 bytes} [Fri Aug 26 08:52:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:12.086729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5c69a-f2db-48c5-8ef6-e8cd201c27aa service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:12.088200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-78b5c69a-f2db-48c5-8ef6-e8cd201c27aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:12.116860 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5c69a-f2db-48c5-8ef6-e8cd201c27aa service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:12.132242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f129bd-a6b9-4dcb-9c28-21abd4529399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:12.134646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c2e66-b19e-407a-ba12-0335a6820c8a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:12.144476 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f129bd-a6b9-4dcb-9c28-21abd4529399 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:12.144653 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f129bd-a6b9-4dcb-9c28-21abd4529399 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:12.144949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f129bd-a6b9-4dcb-9c28-21abd4529399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:12.149237 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c2e66-b19e-407a-ba12-0335a6820c8a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:12.159673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2facc-4eb5-4c96-9fee-93d7f8143561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:12.160220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2facc-4eb5-4c96-9fee-93d7f8143561 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:12.160505 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2facc-4eb5-4c96-9fee-93d7f8143561 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:12.160781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2facc-4eb5-4c96-9fee-93d7f8143561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:12.167788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-78b2facc-4eb5-4c96-9fee-93d7f8143561 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:12.186664 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f129bd-a6b9-4dcb-9c28-21abd4529399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:12.196063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f129bd-a6b9-4dcb-9c28-21abd4529399 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:12.215903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 866/1746] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:12.217398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d68d9c-6c34-4200-84eb-ce294a0936c8 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:12.217694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d68d9c-6c34-4200-84eb-ce294a0936c8 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:12.217972 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d68d9c-6c34-4200-84eb-ce294a0936c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:12.290548 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-22d68d9c-6c34-4200-84eb-ce294a0936c8 None None] MFA Rules not processed for user `598d44b6fb21463985745e862d0b827f`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:12.302498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-22d68d9c-6c34-4200-84eb-ce294a0936c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:12.356258 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2facc-4eb5-4c96-9fee-93d7f8143561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:12.358216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2facc-4eb5-4c96-9fee-93d7f8143561 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:12.387144 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 881/1747] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:12.463354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 867/1748] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:12.475006 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744f3f0-cff1-4a12-a0bb-e24da906d658 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:12.475619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744f3f0-cff1-4a12-a0bb-e24da906d658 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:12.476164 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744f3f0-cff1-4a12-a0bb-e24da906d658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:12.525685 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-b744f3f0-cff1-4a12-a0bb-e24da906d658 None None] MFA Rules not processed for user `598d44b6fb21463985745e862d0b827f`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:12.538160 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b744f3f0-cff1-4a12-a0bb-e24da906d658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:12.561057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 882/1749] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:12.573270 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d68d9c-6c34-4200-84eb-ce294a0936c8 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:12.575087 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-22d68d9c-6c34-4200-84eb-ce294a0936c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:12.709541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d68d9c-6c34-4200-84eb-ce294a0936c8 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:12.718090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef2a8e-73c9-4258-9011-41d057d76965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:12.718864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef2a8e-73c9-4258-9011-41d057d76965 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:12.737886 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef2a8e-73c9-4258-9011-41d057d76965 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:12.738306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef2a8e-73c9-4258-9011-41d057d76965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:12.759601 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef2a8e-73c9-4258-9011-41d057d76965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:12.762304 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef2a8e-73c9-4258-9011-41d057d76965 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:12.814114 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 868/1750] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:13.013609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744f3f0-cff1-4a12-a0bb-e24da906d658 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:13.018646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b744f3f0-cff1-4a12-a0bb-e24da906d658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:13.021028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef2a8e-73c9-4258-9011-41d057d76965 service nova] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:13.023366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-27ef2a8e-73c9-4258-9011-41d057d76965 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:13.085282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744f3f0-cff1-4a12-a0bb-e24da906d658 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:13.087737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef2a8e-73c9-4258-9011-41d057d76965 service nova] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:13.098063 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4e932-3922-4286-b6ac-904bf60ef0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:13.098758 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4e932-3922-4286-b6ac-904bf60ef0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:13.099051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4e932-3922-4286-b6ac-904bf60ef0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:13.100843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eba43e-efab-40c4-bd88-8a446fe2bd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:13.101975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4e932-3922-4286-b6ac-904bf60ef0a0 admin admin] PATH_INFO: `/v3/users/155f21ffd31d4a92965f259319d66e38` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:13.102792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eba43e-efab-40c4-bd88-8a446fe2bd88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:13.103219 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eba43e-efab-40c4-bd88-8a446fe2bd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:13.104984 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eba43e-efab-40c4-bd88-8a446fe2bd88 admin admin] PATH_INFO: `/v3/projects/d827518b7856497c8b21af4c2b72f707` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:13.105537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4e932-3922-4286-b6ac-904bf60ef0a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155f21ffd31d4a92965f259319d66e38)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:13.107720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4e932-3922-4286-b6ac-904bf60ef0a0 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:13.108232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eba43e-efab-40c4-bd88-8a446fe2bd88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d827518b7856497c8b21af4c2b72f707)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:13.114384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eba43e-efab-40c4-bd88-8a446fe2bd88 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:13.224667 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:13.235034 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-62b4e932-3922-4286-b6ac-904bf60ef0a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155f21ffd31d4a92965f259319d66e38'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:13.242567 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-64eba43e-efab-40c4-bd88-8a446fe2bd88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd827518b7856497c8b21af4c2b72f707', 'request_id': 'req-64eba43e-efab-40c4-bd88-8a446fe2bd88'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:13.268313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-62b4e932-3922-4286-b6ac-904bf60ef0a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155f21ffd31d4a92965f259319d66e38'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:13.269515 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-62b4e932-3922-4286-b6ac-904bf60ef0a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155f21ffd31d4a92965f259319d66e38'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:13.290757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-64eba43e-efab-40c4-bd88-8a446fe2bd88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd827518b7856497c8b21af4c2b72f707', 'request_id': 'req-64eba43e-efab-40c4-bd88-8a446fe2bd88'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:13.302098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-62b4e932-3922-4286-b6ac-904bf60ef0a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155f21ffd31d4a92965f259319d66e38'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:13.302689 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-64eba43e-efab-40c4-bd88-8a446fe2bd88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd827518b7856497c8b21af4c2b72f707', 'request_id': 'req-64eba43e-efab-40c4-bd88-8a446fe2bd88'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:13.320552 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-64eba43e-efab-40c4-bd88-8a446fe2bd88 admin admin] The token cache is being invalidate because project d827518b7856497c8b21af4c2b72f707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:13.321214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-64eba43e-efab-40c4-bd88-8a446fe2bd88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:13.328037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-64eba43e-efab-40c4-bd88-8a446fe2bd88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:13.347203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 869/1751] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:13 2022] DELETE /identity/v3/projects/d827518b7856497c8b21af4c2b72f707 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:13.348119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-62b4e932-3922-4286-b6ac-904bf60ef0a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155f21ffd31d4a92965f259319d66e38'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:13.348247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eba43e-efab-40c4-bd88-8a446fe2bd88 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:13.352476 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-64eba43e-efab-40c4-bd88-8a446fe2bd88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:13.369057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 883/1752] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:13 2022] DELETE /identity/v3/users/155f21ffd31d4a92965f259319d66e38 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:13.370143 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4e932-3922-4286-b6ac-904bf60ef0a0 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:13.375432 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-62b4e932-3922-4286-b6ac-904bf60ef0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:13.485752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eba43e-efab-40c4-bd88-8a446fe2bd88 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:13.496347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:13.628799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4e932-3922-4286-b6ac-904bf60ef0a0 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:13.639536 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf68533-4a41-4e65-84d9-98caad29d099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:13.642357 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf68533-4a41-4e65-84d9-98caad29d099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:13.643557 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf68533-4a41-4e65-84d9-98caad29d099 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:13.644047 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf68533-4a41-4e65-84d9-98caad29d099 admin admin] PATH_INFO: `/v3/users/c902c849545b42d58438fc2f0da831c0` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:13.647564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf68533-4a41-4e65-84d9-98caad29d099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c902c849545b42d58438fc2f0da831c0)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:13.652954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf68533-4a41-4e65-84d9-98caad29d099 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:13.692053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b34fc-3a02-4219-8d12-fdab2cd4e3f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95abbd88e549427abbf5699efed0451a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:13.692792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b34fc-3a02-4219-8d12-fdab2cd4e3f8 service placement] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:13.693199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b34fc-3a02-4219-8d12-fdab2cd4e3f8 service placement] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:13.693490 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b34fc-3a02-4219-8d12-fdab2cd4e3f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:13.695869 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-010b34fc-3a02-4219-8d12-fdab2cd4e3f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:13.711718 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b34fc-3a02-4219-8d12-fdab2cd4e3f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:13.713539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b34fc-3a02-4219-8d12-fdab2cd4e3f8 service placement] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:13.728144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 870/1753] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:13.729774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae86ddf-e97e-416f-aabe-69d19f2ac223 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:13.730078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae86ddf-e97e-416f-aabe-69d19f2ac223 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:13.730468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae86ddf-e97e-416f-aabe-69d19f2ac223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:13.763813 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-0ae86ddf-e97e-416f-aabe-69d19f2ac223 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:13.770616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0ae86ddf-e97e-416f-aabe-69d19f2ac223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:13.782230 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-9cf68533-4a41-4e65-84d9-98caad29d099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c902c849545b42d58438fc2f0da831c0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:13.786161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 871/1754] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:13.787801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a1546-738b-4559-906f-b9c1d2b11188 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:13.788105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a1546-738b-4559-906f-b9c1d2b11188 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:13.788390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a1546-738b-4559-906f-b9c1d2b11188 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:13.794747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 872/1755] 10.222.0.76 () {54 vars in 912 bytes} [Fri Aug 26 08:52:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:52:13.801765 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6e0b3-317f-4c99-96fe-310a1ff56ead None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:13.801986 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6e0b3-317f-4c99-96fe-310a1ff56ead None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:13.802269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6e0b3-317f-4c99-96fe-310a1ff56ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:13.812266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-9cf68533-4a41-4e65-84d9-98caad29d099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c902c849545b42d58438fc2f0da831c0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:13.813102 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-9cf68533-4a41-4e65-84d9-98caad29d099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c902c849545b42d58438fc2f0da831c0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:13.837322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-9cf68533-4a41-4e65-84d9-98caad29d099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c902c849545b42d58438fc2f0da831c0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:13.861666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-a9a6e0b3-317f-4c99-96fe-310a1ff56ead None None] MFA Rules not processed for user `e8a867070e974a918a906148bbfd1fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:13.866524 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a9a6e0b3-317f-4c99-96fe-310a1ff56ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:13.912809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-9cf68533-4a41-4e65-84d9-98caad29d099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c902c849545b42d58438fc2f0da831c0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:14.004275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 884/1756] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:13 2022] DELETE /identity/v3/users/c902c849545b42d58438fc2f0da831c0 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:14.004275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf68533-4a41-4e65-84d9-98caad29d099 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:14.017120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9cf68533-4a41-4e65-84d9-98caad29d099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:14.046956 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 873/1757] 10.222.0.76 () {58 vars in 1009 bytes} [Fri Aug 26 08:52:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:14.059207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d266fbb-ed02-446e-b14e-4e7983e2b852 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:14.060405 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d266fbb-ed02-446e-b14e-4e7983e2b852 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:14.060913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d266fbb-ed02-446e-b14e-4e7983e2b852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:14.072137 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:14.110921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-0d266fbb-ed02-446e-b14e-4e7983e2b852 None None] MFA Rules not processed for user `798c692df3b141849d5a4427b3cd1e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:14.114951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0d266fbb-ed02-446e-b14e-4e7983e2b852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:14.346478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf68533-4a41-4e65-84d9-98caad29d099 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:14.367735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 874/1758] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:14.372025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d266fbb-ed02-446e-b14e-4e7983e2b852 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:14.372737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3205176-3c4a-46c8-b4d5-a1f381d2db46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:14.373128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3205176-3c4a-46c8-b4d5-a1f381d2db46 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:14.373413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3205176-3c4a-46c8-b4d5-a1f381d2db46 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:14.373694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3205176-3c4a-46c8-b4d5-a1f381d2db46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:14.380642 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e3205176-3c4a-46c8-b4d5-a1f381d2db46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:14.409284 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d266fbb-ed02-446e-b14e-4e7983e2b852 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:14.430089 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118371b7-5aa3-499c-b556-9995c0ed5252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:14.430841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118371b7-5aa3-499c-b556-9995c0ed5252 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:14.431336 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118371b7-5aa3-499c-b556-9995c0ed5252 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:14.431749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118371b7-5aa3-499c-b556-9995c0ed5252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:14.453016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118371b7-5aa3-499c-b556-9995c0ed5252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:14.456201 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118371b7-5aa3-499c-b556-9995c0ed5252 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:14.489627 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 875/1759] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:14.686784 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3205176-3c4a-46c8-b4d5-a1f381d2db46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:14.688269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3205176-3c4a-46c8-b4d5-a1f381d2db46 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:14.723295 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:14.739474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 885/1760] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:16.040635 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118371b7-5aa3-499c-b556-9995c0ed5252 service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:16.043475 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-118371b7-5aa3-499c-b556-9995c0ed5252 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:16.068367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118371b7-5aa3-499c-b556-9995c0ed5252 service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:16.082090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3daa1-30a7-4eea-8c66-99d9abe407aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:16.082959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3daa1-30a7-4eea-8c66-99d9abe407aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:16.083566 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3daa1-30a7-4eea-8c66-99d9abe407aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:16.083986 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3daa1-30a7-4eea-8c66-99d9abe407aa admin admin] PATH_INFO: `/v3/users/ee6b3642a7b647c3a8a677f26ac4eb62` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:16.087019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3daa1-30a7-4eea-8c66-99d9abe407aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6b3642a7b647c3a8a677f26ac4eb62)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:16.088957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3daa1-30a7-4eea-8c66-99d9abe407aa admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:16.114129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3205176-3c4a-46c8-b4d5-a1f381d2db46 service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:16.116268 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e3205176-3c4a-46c8-b4d5-a1f381d2db46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:16.154311 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3205176-3c4a-46c8-b4d5-a1f381d2db46 service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:16.173917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1424d0-9f96-4933-93d1-79862ec82ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:16.174697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1424d0-9f96-4933-93d1-79862ec82ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:16.175427 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1424d0-9f96-4933-93d1-79862ec82ace admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:16.175933 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1424d0-9f96-4933-93d1-79862ec82ace admin admin] PATH_INFO: `/v3/projects/c43a520560cc4480a30bb1c6d0bf52fc` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:16.178208 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1424d0-9f96-4933-93d1-79862ec82ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43a520560cc4480a30bb1c6d0bf52fc)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:16.182877 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1424d0-9f96-4933-93d1-79862ec82ace admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:16.318334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-bcd3daa1-30a7-4eea-8c66-99d9abe407aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6b3642a7b647c3a8a677f26ac4eb62'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:16.338142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-7a1424d0-9f96-4933-93d1-79862ec82ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43a520560cc4480a30bb1c6d0bf52fc', 'request_id': 'req-7a1424d0-9f96-4933-93d1-79862ec82ace'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:16.354686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-bcd3daa1-30a7-4eea-8c66-99d9abe407aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6b3642a7b647c3a8a677f26ac4eb62'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:16.354686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-bcd3daa1-30a7-4eea-8c66-99d9abe407aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6b3642a7b647c3a8a677f26ac4eb62'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:16.354913 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-7a1424d0-9f96-4933-93d1-79862ec82ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43a520560cc4480a30bb1c6d0bf52fc', 'request_id': 'req-7a1424d0-9f96-4933-93d1-79862ec82ace'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:16.355243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-bcd3daa1-30a7-4eea-8c66-99d9abe407aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6b3642a7b647c3a8a677f26ac4eb62'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:16.377440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-bcd3daa1-30a7-4eea-8c66-99d9abe407aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6b3642a7b647c3a8a677f26ac4eb62'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:16.398859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-7a1424d0-9f96-4933-93d1-79862ec82ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43a520560cc4480a30bb1c6d0bf52fc', 'request_id': 'req-7a1424d0-9f96-4933-93d1-79862ec82ace'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:16.429437 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 876/1761] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:16 2022] DELETE /identity/v3/users/ee6b3642a7b647c3a8a677f26ac4eb62 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:16.431523 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e24a8-0bf1-45d2-bf3a-cc7f8f6c7aa6 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:16.431912 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e24a8-0bf1-45d2-bf3a-cc7f8f6c7aa6 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:16.432204 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e24a8-0bf1-45d2-bf3a-cc7f8f6c7aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:16.432446 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-7a1424d0-9f96-4933-93d1-79862ec82ace admin admin] The token cache is being invalidate because project c43a520560cc4480a30bb1c6d0bf52fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:16.432947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-7a1424d0-9f96-4933-93d1-79862ec82ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:16.438661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-7a1424d0-9f96-4933-93d1-79862ec82ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:16.449626 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 886/1762] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:16 2022] DELETE /identity/v3/projects/c43a520560cc4480a30bb1c6d0bf52fc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:52:16.460119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f2f35-f391-4f1f-961b-1aed7d5b9cb3 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:16.463767 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f2f35-f391-4f1f-961b-1aed7d5b9cb3 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:16.463997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f2f35-f391-4f1f-961b-1aed7d5b9cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:16.481453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-f51e24a8-0bf1-45d2-bf3a-cc7f8f6c7aa6 None None] MFA Rules not processed for user `e031367406df4a3d95f2ed9e2eb8efae`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:16.482920 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-f51e24a8-0bf1-45d2-bf3a-cc7f8f6c7aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:16.578463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-dd8f2f35-f391-4f1f-961b-1aed7d5b9cb3 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:16.579790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-dd8f2f35-f391-4f1f-961b-1aed7d5b9cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:16.716513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 877/1763] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:16.721331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc229b-5513-4495-b120-b0885a1fc1a0 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:16.721639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc229b-5513-4495-b120-b0885a1fc1a0 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:16.721928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc229b-5513-4495-b120-b0885a1fc1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:16.779820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-64cc229b-5513-4495-b120-b0885a1fc1a0 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:16.781124 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-64cc229b-5513-4495-b120-b0885a1fc1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:16.807251 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:16.842567 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 887/1764] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:16.853538 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f2f35-f391-4f1f-961b-1aed7d5b9cb3 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:16.856238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-dd8f2f35-f391-4f1f-961b-1aed7d5b9cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:17.041105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 878/1765] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:17.041105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc229b-5513-4495-b120-b0885a1fc1a0 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:17.041105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-64cc229b-5513-4495-b120-b0885a1fc1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:17.066733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc229b-5513-4495-b120-b0885a1fc1a0 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:17.072900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7bf09-71ce-4883-b4d4-237296fa2a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:17.074034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7bf09-71ce-4883-b4d4-237296fa2a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:17.074683 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7bf09-71ce-4883-b4d4-237296fa2a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:17.075016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7bf09-71ce-4883-b4d4-237296fa2a14 admin admin] PATH_INFO: `/v3/projects/e0aff92d66cf47c2959f96abbd050175` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:17.075129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f2f35-f391-4f1f-961b-1aed7d5b9cb3 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:17.086142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f311ab4-4669-407a-a281-13c98d25b498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:17.088658 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f311ab4-4669-407a-a281-13c98d25b498 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:17.089815 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f311ab4-4669-407a-a281-13c98d25b498 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:17.090427 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f311ab4-4669-407a-a281-13c98d25b498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:17.090752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7bf09-71ce-4883-b4d4-237296fa2a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0aff92d66cf47c2959f96abbd050175)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:17.096692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7bf09-71ce-4883-b4d4-237296fa2a14 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:17.111883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f311ab4-4669-407a-a281-13c98d25b498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:17.114368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f311ab4-4669-407a-a281-13c98d25b498 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:17.170930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 888/1766] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:17.174738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59908f35-ad46-4838-a67b-c18fd204ea80 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:17.175081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59908f35-ad46-4838-a67b-c18fd204ea80 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:17.177432 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59908f35-ad46-4838-a67b-c18fd204ea80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:17.246152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-efd7bf09-71ce-4883-b4d4-237296fa2a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0aff92d66cf47c2959f96abbd050175', 'request_id': 'req-efd7bf09-71ce-4883-b4d4-237296fa2a14'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:17.257620 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-59908f35-ad46-4838-a67b-c18fd204ea80 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:17.259441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-efd7bf09-71ce-4883-b4d4-237296fa2a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0aff92d66cf47c2959f96abbd050175', 'request_id': 'req-efd7bf09-71ce-4883-b4d4-237296fa2a14'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:17.260185 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-59908f35-ad46-4838-a67b-c18fd204ea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:17.271306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-efd7bf09-71ce-4883-b4d4-237296fa2a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0aff92d66cf47c2959f96abbd050175', 'request_id': 'req-efd7bf09-71ce-4883-b4d4-237296fa2a14'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:17.315334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-efd7bf09-71ce-4883-b4d4-237296fa2a14 admin admin] The token cache is being invalidate because project e0aff92d66cf47c2959f96abbd050175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:17.315790 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-efd7bf09-71ce-4883-b4d4-237296fa2a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:17.317321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-efd7bf09-71ce-4883-b4d4-237296fa2a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:17.322139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 879/1767] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:17 2022] DELETE /identity/v3/projects/e0aff92d66cf47c2959f96abbd050175 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:17.326096 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7bf09-71ce-4883-b4d4-237296fa2a14 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:17.330983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-efd7bf09-71ce-4883-b4d4-237296fa2a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:17.339466 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:17.460481 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 889/1768] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:17.462666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6a690-ec4e-420c-8568-0b15e1da4a77 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:17.463314 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6a690-ec4e-420c-8568-0b15e1da4a77 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:17.463666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6a690-ec4e-420c-8568-0b15e1da4a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:17.549377 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-1cb6a690-ec4e-420c-8568-0b15e1da4a77 None None] MFA Rules not processed for user `598d44b6fb21463985745e862d0b827f`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:17.552717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1cb6a690-ec4e-420c-8568-0b15e1da4a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:17.623439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7bf09-71ce-4883-b4d4-237296fa2a14 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:17.639039 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1cb22-7632-467c-8224-9a3d654d49fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:17.639787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1cb22-7632-467c-8224-9a3d654d49fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:17.640090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1cb22-7632-467c-8224-9a3d654d49fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:17.640373 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1cb22-7632-467c-8224-9a3d654d49fc admin admin] PATH_INFO: `/v3/users/bbdf738822f34b8daba15cc71f336b35` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:17.646150 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1cb22-7632-467c-8224-9a3d654d49fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbdf738822f34b8daba15cc71f336b35)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:17.649994 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1cb22-7632-467c-8224-9a3d654d49fc admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:17.793425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:17.818649 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e7f1cb22-7632-467c-8224-9a3d654d49fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbdf738822f34b8daba15cc71f336b35'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:17.851122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e7f1cb22-7632-467c-8224-9a3d654d49fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbdf738822f34b8daba15cc71f336b35'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:17.851552 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e7f1cb22-7632-467c-8224-9a3d654d49fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbdf738822f34b8daba15cc71f336b35'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:17.852452 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e7f1cb22-7632-467c-8224-9a3d654d49fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbdf738822f34b8daba15cc71f336b35'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:17.868123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e7f1cb22-7632-467c-8224-9a3d654d49fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbdf738822f34b8daba15cc71f336b35'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:17.902569 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 890/1769] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:17.905476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6a690-ec4e-420c-8568-0b15e1da4a77 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:17.909530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1cb6a690-ec4e-420c-8568-0b15e1da4a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:17.926290 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 880/1770] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:17 2022] DELETE /identity/v3/users/bbdf738822f34b8daba15cc71f336b35 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:52:17.965928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6a690-ec4e-420c-8568-0b15e1da4a77 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:18.197872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0544df-531b-409b-afd2-c397582e2660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:18.198473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0544df-531b-409b-afd2-c397582e2660 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:18.198764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0544df-531b-409b-afd2-c397582e2660 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:18.199037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0544df-531b-409b-afd2-c397582e2660 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:18.199710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0544df-531b-409b-afd2-c397582e2660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:52:18.200016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0544df-531b-409b-afd2-c397582e2660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:18.201685 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0544df-531b-409b-afd2-c397582e2660 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:18.231083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 891/1771] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:52:18.236026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1cb22-7632-467c-8224-9a3d654d49fc admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:18.250820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1cb22-7632-467c-8224-9a3d654d49fc admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:18.262446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce839c3-51bc-47cf-97c9-caae5b6c7a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:18.263597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce839c3-51bc-47cf-97c9-caae5b6c7a65 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:18.264190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce839c3-51bc-47cf-97c9-caae5b6c7a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:18.264656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce839c3-51bc-47cf-97c9-caae5b6c7a65 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:18.265555 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce839c3-51bc-47cf-97c9-caae5b6c7a65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:18.270278 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce839c3-51bc-47cf-97c9-caae5b6c7a65 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:18.341087 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 881/1772] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:18 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:52:18.342609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0544df-531b-409b-afd2-c397582e2660 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:18.358688 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0544df-531b-409b-afd2-c397582e2660 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:18.364358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d487ee-8e15-4313-9925-ab3008cb0217 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:18.364748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d487ee-8e15-4313-9925-ab3008cb0217 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:18.365162 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d487ee-8e15-4313-9925-ab3008cb0217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:18.535050 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-d7d487ee-8e15-4313-9925-ab3008cb0217 None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:18.537619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d7d487ee-8e15-4313-9925-ab3008cb0217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:18.559544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce32524-a120-427c-a622-3d6045f950dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:18.561483 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce32524-a120-427c-a622-3d6045f950dc admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:18.561483 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce32524-a120-427c-a622-3d6045f950dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:18.561713 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce32524-a120-427c-a622-3d6045f950dc admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:18.565503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce32524-a120-427c-a622-3d6045f950dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:18.571716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce32524-a120-427c-a622-3d6045f950dc admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:18.598077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:18.622774 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 892/1773] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:18 2022] POST /identity/v3/users => generated 291 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:18.631698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce32524-a120-427c-a622-3d6045f950dc admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:18.661618 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce32524-a120-427c-a622-3d6045f950dc admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:18.682228 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b3ad9-da7c-4532-85a2-96aac7927825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:18.682879 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b3ad9-da7c-4532-85a2-96aac7927825 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:18.683142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b3ad9-da7c-4532-85a2-96aac7927825 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:18.683425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b3ad9-da7c-4532-85a2-96aac7927825 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:18.684075 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b3ad9-da7c-4532-85a2-96aac7927825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:18.685731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b3ad9-da7c-4532-85a2-96aac7927825 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:18.713741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 893/1774] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:18.719276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b3ad9-da7c-4532-85a2-96aac7927825 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:18.727652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 882/1775] 10.222.0.76 () {58 vars in 1009 bytes} [Fri Aug 26 08:52:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:18.743727 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b3ad9-da7c-4532-85a2-96aac7927825 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:18.754199 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29219a3c-55f4-4801-9b0e-015718345a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:18.755267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29219a3c-55f4-4801-9b0e-015718345a45 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:18.755734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29219a3c-55f4-4801-9b0e-015718345a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:18.756033 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29219a3c-55f4-4801-9b0e-015718345a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:18.756688 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29219a3c-55f4-4801-9b0e-015718345a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:18.758472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29219a3c-55f4-4801-9b0e-015718345a45 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:18.806227 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 894/1776] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:18.810631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d487ee-8e15-4313-9925-ab3008cb0217 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:18.830906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d487ee-8e15-4313-9925-ab3008cb0217 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:18.844550 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6a2f4-ba60-47a0-8f26-e30426035ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:18.844729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6a2f4-ba60-47a0-8f26-e30426035ded admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:18.845118 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6a2f4-ba60-47a0-8f26-e30426035ded admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:18.845993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6a2f4-ba60-47a0-8f26-e30426035ded admin admin] PATH_INFO: `/v3/projects/cc2998d867514b59812eb2a6904882bc/users/427e96c7b7344fd4b0f071e0faacf834/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:18.893237 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6a2f4-ba60-47a0-8f26-e30426035ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2998d867514b59812eb2a6904882bc, user_id=427e96c7b7344fd4b0f071e0faacf834, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:18.900420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6a2f4-ba60-47a0-8f26-e30426035ded admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:18.951728 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4bd94-090c-4195-a425-7bb230b46f2a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:18.952086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4bd94-090c-4195-a425-7bb230b46f2a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:18.952195 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 883/1777] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:18 2022] PUT /identity/v3/projects/cc2998d867514b59812eb2a6904882bc/users/427e96c7b7344fd4b0f071e0faacf834/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:18.952281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4bd94-090c-4195-a425-7bb230b46f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:19.012065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-45d4bd94-090c-4195-a425-7bb230b46f2a None None] MFA Rules not processed for user `427e96c7b7344fd4b0f071e0faacf834`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:19.013343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-45d4bd94-090c-4195-a425-7bb230b46f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:19.093415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6a2f4-ba60-47a0-8f26-e30426035ded admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:19.096639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-09e6a2f4-ba60-47a0-8f26-e30426035ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:19.250761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 895/1778] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:19.254284 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4bd94-090c-4195-a425-7bb230b46f2a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:19.282284 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:19.452366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4bd94-090c-4195-a425-7bb230b46f2a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:19.459661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a25c-9829-4d23-9c04-3d24946b9e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:19.461401 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a25c-9829-4d23-9c04-3d24946b9e58 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:19.461661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6a2f4-ba60-47a0-8f26-e30426035ded admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:19.461768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a25c-9829-4d23-9c04-3d24946b9e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:19.461768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a25c-9829-4d23-9c04-3d24946b9e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:19.462390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a25c-9829-4d23-9c04-3d24946b9e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:19.464328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a25c-9829-4d23-9c04-3d24946b9e58 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:19.488466 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b07be1-080a-42f7-a130-204858e36b68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:19.489137 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b07be1-080a-42f7-a130-204858e36b68 service swift] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:19.489422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b07be1-080a-42f7-a130-204858e36b68 service swift] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:19.489700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b07be1-080a-42f7-a130-204858e36b68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:19.516715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 896/1779] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:19 2022] POST /identity/v3/projects => generated 379 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:19.518834 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a25c-9829-4d23-9c04-3d24946b9e58 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:19.521175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-3732a25c-9829-4d23-9c04-3d24946b9e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:19.634379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b07be1-080a-42f7-a130-204858e36b68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:19.636460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b07be1-080a-42f7-a130-204858e36b68 service swift] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:19.638704 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:19.648706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 884/1780] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 08:52:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 08:52:19.650328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b07be1-080a-42f7-a130-204858e36b68 service swift] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:19.664581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b07be1-080a-42f7-a130-204858e36b68 service swift] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:19.692180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a25c-9829-4d23-9c04-3d24946b9e58 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:19.709331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be578b7-30f9-4e74-97ce-4f45cd961840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:19.710366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be578b7-30f9-4e74-97ce-4f45cd961840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:19.710824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be578b7-30f9-4e74-97ce-4f45cd961840 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:19.711273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be578b7-30f9-4e74-97ce-4f45cd961840 admin admin] PATH_INFO: `/v3/projects/6e094e62302847d388771a966524e1bd` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:19.718124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be578b7-30f9-4e74-97ce-4f45cd961840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e094e62302847d388771a966524e1bd)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:19.720468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be578b7-30f9-4e74-97ce-4f45cd961840 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:19.796973 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-3be578b7-30f9-4e74-97ce-4f45cd961840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e094e62302847d388771a966524e1bd', 'request_id': 'req-3be578b7-30f9-4e74-97ce-4f45cd961840'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:19.805559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-3be578b7-30f9-4e74-97ce-4f45cd961840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e094e62302847d388771a966524e1bd', 'request_id': 'req-3be578b7-30f9-4e74-97ce-4f45cd961840'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:19.825332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-3be578b7-30f9-4e74-97ce-4f45cd961840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e094e62302847d388771a966524e1bd', 'request_id': 'req-3be578b7-30f9-4e74-97ce-4f45cd961840'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:19.845407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-3be578b7-30f9-4e74-97ce-4f45cd961840 admin admin] The token cache is being invalidate because project 6e094e62302847d388771a966524e1bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:19.845778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-3be578b7-30f9-4e74-97ce-4f45cd961840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:19.846584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-3be578b7-30f9-4e74-97ce-4f45cd961840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:19.854065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 897/1781] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:19 2022] DELETE /identity/v3/projects/6e094e62302847d388771a966524e1bd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:19.855539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be578b7-30f9-4e74-97ce-4f45cd961840 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:19.857236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-3be578b7-30f9-4e74-97ce-4f45cd961840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:19.972593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be578b7-30f9-4e74-97ce-4f45cd961840 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:19.980924 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe6ced-3fd9-4a79-b694-bdc1f425eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:19.981887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe6ced-3fd9-4a79-b694-bdc1f425eedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:19.982789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe6ced-3fd9-4a79-b694-bdc1f425eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:19.983222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe6ced-3fd9-4a79-b694-bdc1f425eedf admin admin] PATH_INFO: `/v3/users/a452064314e74453b89e3670c2dcabdc` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:19.985410 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe6ced-3fd9-4a79-b694-bdc1f425eedf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a452064314e74453b89e3670c2dcabdc)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:19.988547 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe6ced-3fd9-4a79-b694-bdc1f425eedf admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:20.018449 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dc13e-a00b-4e79-a61f-f22bc9b656c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:20.019358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dc13e-a00b-4e79-a61f-f22bc9b656c3 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:20.019751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dc13e-a00b-4e79-a61f-f22bc9b656c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:20.020173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dc13e-a00b-4e79-a61f-f22bc9b656c3 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:20.021558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339dc13e-a00b-4e79-a61f-f22bc9b656c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:20.023792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339dc13e-a00b-4e79-a61f-f22bc9b656c3 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:20.076318 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 885/1782] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:19 2022] POST /identity/v3/users => generated 296 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:20.079994 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dc13e-a00b-4e79-a61f-f22bc9b656c3 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:20.083987 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-339dc13e-a00b-4e79-a61f-f22bc9b656c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:20.087402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-fefe6ced-3fd9-4a79-b694-bdc1f425eedf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a452064314e74453b89e3670c2dcabdc'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:20.109574 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dc13e-a00b-4e79-a61f-f22bc9b656c3 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:20.116864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-fefe6ced-3fd9-4a79-b694-bdc1f425eedf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a452064314e74453b89e3670c2dcabdc'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:20.117917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-fefe6ced-3fd9-4a79-b694-bdc1f425eedf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a452064314e74453b89e3670c2dcabdc'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:20.131295 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad68bba-ac44-4ffb-a5e4-71e67c4532b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:20.131928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad68bba-ac44-4ffb-a5e4-71e67c4532b9 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:20.132215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad68bba-ac44-4ffb-a5e4-71e67c4532b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:20.132491 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad68bba-ac44-4ffb-a5e4-71e67c4532b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:20.133187 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad68bba-ac44-4ffb-a5e4-71e67c4532b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:20.139096 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-fefe6ced-3fd9-4a79-b694-bdc1f425eedf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a452064314e74453b89e3670c2dcabdc'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:20.148152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad68bba-ac44-4ffb-a5e4-71e67c4532b9 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:20.186885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-fefe6ced-3fd9-4a79-b694-bdc1f425eedf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a452064314e74453b89e3670c2dcabdc'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:20.191893 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 886/1783] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:52:20.193033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad68bba-ac44-4ffb-a5e4-71e67c4532b9 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:20.195581 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:20.201711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0ad68bba-ac44-4ffb-a5e4-71e67c4532b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:20.213181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 898/1784] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:19 2022] DELETE /identity/v3/users/a452064314e74453b89e3670c2dcabdc => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:20.225375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad68bba-ac44-4ffb-a5e4-71e67c4532b9 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:20.358110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:20.409055 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c899f4-87f3-47f6-9bca-b707f29932fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:20.409891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c899f4-87f3-47f6-9bca-b707f29932fe admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:20.410178 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c899f4-87f3-47f6-9bca-b707f29932fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:20.410460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c899f4-87f3-47f6-9bca-b707f29932fe admin admin] PATH_INFO: `/v3/projects/ac33b6c49ed94b2fba034f8982243b98/users/58d85ac2a70f43638a14cda603e982c9/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:20.454325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c899f4-87f3-47f6-9bca-b707f29932fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac33b6c49ed94b2fba034f8982243b98, user_id=58d85ac2a70f43638a14cda603e982c9, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:20.457686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c899f4-87f3-47f6-9bca-b707f29932fe admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:20.483551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 887/1785] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:20 2022] PUT /identity/v3/projects/ac33b6c49ed94b2fba034f8982243b98/users/58d85ac2a70f43638a14cda603e982c9/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:20.489406 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe6ced-3fd9-4a79-b694-bdc1f425eedf admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:20.515911 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe6ced-3fd9-4a79-b694-bdc1f425eedf admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:20.723495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a42ee2-ab5e-402d-9bd7-949e0d50beb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:20.724342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a42ee2-ab5e-402d-9bd7-949e0d50beb7 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:20.724793 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a42ee2-ab5e-402d-9bd7-949e0d50beb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:20.725257 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a42ee2-ab5e-402d-9bd7-949e0d50beb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:20.726481 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a42ee2-ab5e-402d-9bd7-949e0d50beb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:20.728540 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a42ee2-ab5e-402d-9bd7-949e0d50beb7 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:20.751333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 899/1786] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:20.752685 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c899f4-87f3-47f6-9bca-b707f29932fe admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:20.776952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c899f4-87f3-47f6-9bca-b707f29932fe admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:20.786244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b51ec-673a-44fc-8ada-aa35b0265b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:20.787623 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b51ec-673a-44fc-8ada-aa35b0265b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:20.787623 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b51ec-673a-44fc-8ada-aa35b0265b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:20.787904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b51ec-673a-44fc-8ada-aa35b0265b36 admin admin] PATH_INFO: `/v3/projects/ac33b6c49ed94b2fba034f8982243b98/users/58d85ac2a70f43638a14cda603e982c9/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:20.791954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b51ec-673a-44fc-8ada-aa35b0265b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac33b6c49ed94b2fba034f8982243b98, user_id=58d85ac2a70f43638a14cda603e982c9, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:20.795957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b51ec-673a-44fc-8ada-aa35b0265b36 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:20.837254 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 888/1787] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:20 2022] PUT /identity/v3/projects/ac33b6c49ed94b2fba034f8982243b98/users/58d85ac2a70f43638a14cda603e982c9/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:20.840339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84748fc7-55f0-405f-ac69-e6d75d51c1f3 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:20.840637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84748fc7-55f0-405f-ac69-e6d75d51c1f3 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:20.841715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84748fc7-55f0-405f-ac69-e6d75d51c1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:20.938399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-84748fc7-55f0-405f-ac69-e6d75d51c1f3 None None] MFA Rules not processed for user `58d85ac2a70f43638a14cda603e982c9`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:20.942342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-84748fc7-55f0-405f-ac69-e6d75d51c1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:21.226880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 900/1788] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:21.240501 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b51ec-673a-44fc-8ada-aa35b0265b36 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:21.242802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-532b51ec-673a-44fc-8ada-aa35b0265b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:21.393119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b51ec-673a-44fc-8ada-aa35b0265b36 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:21.420404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf74b6-ec84-415b-9cb8-6e0bc69fb27e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:21.421496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf74b6-ec84-415b-9cb8-6e0bc69fb27e service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:21.421762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf74b6-ec84-415b-9cb8-6e0bc69fb27e service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:21.422036 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf74b6-ec84-415b-9cb8-6e0bc69fb27e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:21.435036 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf74b6-ec84-415b-9cb8-6e0bc69fb27e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:21.436435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf74b6-ec84-415b-9cb8-6e0bc69fb27e service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:21.483159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 889/1789] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:21.510515 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84748fc7-55f0-405f-ac69-e6d75d51c1f3 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:21.516532 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-84748fc7-55f0-405f-ac69-e6d75d51c1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:21.648232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c024d38-015d-4004-84f8-e354b83695f4 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:21.648652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c024d38-015d-4004-84f8-e354b83695f4 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:21.648938 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c024d38-015d-4004-84f8-e354b83695f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:21.727912 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-9c024d38-015d-4004-84f8-e354b83695f4 None None] MFA Rules not processed for user `e8a867070e974a918a906148bbfd1fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:21.734505 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-9c024d38-015d-4004-84f8-e354b83695f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:21.860503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84748fc7-55f0-405f-ac69-e6d75d51c1f3 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:21.880914 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:21.881607 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:21.881892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:21.882173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29 admin admin] PATH_INFO: `/v3/projects/6577007266b44184b1f2be3baa049306` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:21.897911 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6577007266b44184b1f2be3baa049306)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:21.900012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:21.996044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:22.046325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 890/1790] 10.222.0.98 () {58 vars in 1015 bytes} [Fri Aug 26 08:52:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:22.047319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c024d38-015d-4004-84f8-e354b83695f4 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:22.056562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-9c024d38-015d-4004-84f8-e354b83695f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:22.062529 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6577007266b44184b1f2be3baa049306', 'request_id': 'req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:22.074421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6577007266b44184b1f2be3baa049306', 'request_id': 'req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:22.093163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6577007266b44184b1f2be3baa049306', 'request_id': 'req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:22.115274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29 admin admin] The token cache is being invalidate because project 6577007266b44184b1f2be3baa049306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:22.115738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:22.117234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:22.122881 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 901/1791] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:21 2022] DELETE /identity/v3/projects/6577007266b44184b1f2be3baa049306 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:22.124400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:22.131780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c024d38-015d-4004-84f8-e354b83695f4 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:22.132732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:22.300219 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81048c9a-0603-45c7-bbc2-fd3c73360022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:22.300219 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81048c9a-0603-45c7-bbc2-fd3c73360022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:22.300536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81048c9a-0603-45c7-bbc2-fd3c73360022 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:22.300536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81048c9a-0603-45c7-bbc2-fd3c73360022 admin admin] PATH_INFO: `/v3/projects/081c30783d1b4db5a60d83ace30eff4e` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:22.307110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81048c9a-0603-45c7-bbc2-fd3c73360022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=081c30783d1b4db5a60d83ace30eff4e)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:22.309297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81048c9a-0603-45c7-bbc2-fd3c73360022 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:22.320437 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:22.325829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7033c-cb6b-4c4d-afe8-a8bb477bae29 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:22.338259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003627a-313f-4a76-a34f-dbc01f116530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:22.341059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003627a-313f-4a76-a34f-dbc01f116530 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:22.341423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003627a-313f-4a76-a34f-dbc01f116530 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:22.344501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003627a-313f-4a76-a34f-dbc01f116530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:22.354989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e003627a-313f-4a76-a34f-dbc01f116530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:22.391817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003627a-313f-4a76-a34f-dbc01f116530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:22.395780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003627a-313f-4a76-a34f-dbc01f116530 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:22.419172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 902/1792] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:22.421832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e5462-3418-4ef7-91c1-46ed1a842af6 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:22.422123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e5462-3418-4ef7-91c1-46ed1a842af6 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:22.424494 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e5462-3418-4ef7-91c1-46ed1a842af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:22.496262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-716e5462-3418-4ef7-91c1-46ed1a842af6 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:22.498939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-716e5462-3418-4ef7-91c1-46ed1a842af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:22.516371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-81048c9a-0603-45c7-bbc2-fd3c73360022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '081c30783d1b4db5a60d83ace30eff4e', 'request_id': 'req-81048c9a-0603-45c7-bbc2-fd3c73360022'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:22.540102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-81048c9a-0603-45c7-bbc2-fd3c73360022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '081c30783d1b4db5a60d83ace30eff4e', 'request_id': 'req-81048c9a-0603-45c7-bbc2-fd3c73360022'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:22.565564 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-81048c9a-0603-45c7-bbc2-fd3c73360022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '081c30783d1b4db5a60d83ace30eff4e', 'request_id': 'req-81048c9a-0603-45c7-bbc2-fd3c73360022'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:22.596513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 903/1793] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:22.597738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e5462-3418-4ef7-91c1-46ed1a842af6 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:22.599392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-716e5462-3418-4ef7-91c1-46ed1a842af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:22.606770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-81048c9a-0603-45c7-bbc2-fd3c73360022 admin admin] The token cache is being invalidate because project 081c30783d1b4db5a60d83ace30eff4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:22.606770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-81048c9a-0603-45c7-bbc2-fd3c73360022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:22.614452 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e5462-3418-4ef7-91c1-46ed1a842af6 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:22.614744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-81048c9a-0603-45c7-bbc2-fd3c73360022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:22.621344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 891/1794] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:22 2022] DELETE /identity/v3/projects/081c30783d1b4db5a60d83ace30eff4e => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:22.621535 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef9e7b-9a49-4a06-9a05-dade0f1628e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:22.621535 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef9e7b-9a49-4a06-9a05-dade0f1628e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:22.621726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a913589-094e-402b-9b82-d74a3ef280ad None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:22.622085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef9e7b-9a49-4a06-9a05-dade0f1628e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:22.622331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a913589-094e-402b-9b82-d74a3ef280ad None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:22.622444 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef9e7b-9a49-4a06-9a05-dade0f1628e4 admin admin] PATH_INFO: `/v3/users/427e96c7b7344fd4b0f071e0faacf834` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:22.623913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a913589-094e-402b-9b82-d74a3ef280ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:22.624635 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef9e7b-9a49-4a06-9a05-dade0f1628e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=427e96c7b7344fd4b0f071e0faacf834)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:22.628434 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef9e7b-9a49-4a06-9a05-dade0f1628e4 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:22.712334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-7a913589-094e-402b-9b82-d74a3ef280ad None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:22.721382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7a913589-094e-402b-9b82-d74a3ef280ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:22.734948 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-97ef9e7b-9a49-4a06-9a05-dade0f1628e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427e96c7b7344fd4b0f071e0faacf834'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:22.737947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:22.742128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 892/1795] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:22.752063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2b399-90c6-47bb-8f7e-be5738bff97f None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:22.752453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2b399-90c6-47bb-8f7e-be5738bff97f None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:22.752805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2b399-90c6-47bb-8f7e-be5738bff97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:22.759895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-97ef9e7b-9a49-4a06-9a05-dade0f1628e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427e96c7b7344fd4b0f071e0faacf834'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:22.760893 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-97ef9e7b-9a49-4a06-9a05-dade0f1628e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427e96c7b7344fd4b0f071e0faacf834'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:22.775678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-97ef9e7b-9a49-4a06-9a05-dade0f1628e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427e96c7b7344fd4b0f071e0faacf834'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:22.828798 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-5ae2b399-90c6-47bb-8f7e-be5738bff97f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:22.833959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5ae2b399-90c6-47bb-8f7e-be5738bff97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:22.834398 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-97ef9e7b-9a49-4a06-9a05-dade0f1628e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427e96c7b7344fd4b0f071e0faacf834'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:22.854121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 893/1796] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:22.854121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2b399-90c6-47bb-8f7e-be5738bff97f None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:22.854121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5ae2b399-90c6-47bb-8f7e-be5738bff97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:22.871456 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 904/1797] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:22 2022] DELETE /identity/v3/users/427e96c7b7344fd4b0f071e0faacf834 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:22.875049 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fbb27-cfb2-4b42-aa2a-ab35fb8eed54 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:22.879157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fbb27-cfb2-4b42-aa2a-ab35fb8eed54 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:22.880609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fbb27-cfb2-4b42-aa2a-ab35fb8eed54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:22.891139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2b399-90c6-47bb-8f7e-be5738bff97f None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:22.965302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-515fbb27-cfb2-4b42-aa2a-ab35fb8eed54 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:22.966853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-515fbb27-cfb2-4b42-aa2a-ab35fb8eed54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:23.139203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84fff8-6d4e-45a4-9904-0dcfbd119e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:23.145422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84fff8-6d4e-45a4-9904-0dcfbd119e15 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:23.145804 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84fff8-6d4e-45a4-9904-0dcfbd119e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:23.148485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84fff8-6d4e-45a4-9904-0dcfbd119e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:23.152312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84fff8-6d4e-45a4-9904-0dcfbd119e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:52:23.152660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84fff8-6d4e-45a4-9904-0dcfbd119e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:23.168345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84fff8-6d4e-45a4-9904-0dcfbd119e15 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:23.188129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 905/1798] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:23.190100 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8d37b-9721-4855-8939-c154ce563116 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:23.190395 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8d37b-9721-4855-8939-c154ce563116 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:23.193383 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8d37b-9721-4855-8939-c154ce563116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:23.210040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 894/1799] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:52:23.210924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84fff8-6d4e-45a4-9904-0dcfbd119e15 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:23.266984 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84fff8-6d4e-45a4-9904-0dcfbd119e15 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:23.271149 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-beb8d37b-9721-4855-8939-c154ce563116 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:23.274167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-beb8d37b-9721-4855-8939-c154ce563116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:23.285972 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64cfb0-5ac4-4d0e-9cf4-68024823dd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:23.291262 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64cfb0-5ac4-4d0e-9cf4-68024823dd0e admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:23.291519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64cfb0-5ac4-4d0e-9cf4-68024823dd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:23.291804 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64cfb0-5ac4-4d0e-9cf4-68024823dd0e admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:23.295978 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64cfb0-5ac4-4d0e-9cf4-68024823dd0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:52:23.296886 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64cfb0-5ac4-4d0e-9cf4-68024823dd0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:23.303441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64cfb0-5ac4-4d0e-9cf4-68024823dd0e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:23.307675 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 906/1800] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:23.309390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8d37b-9721-4855-8939-c154ce563116 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:23.331113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8d37b-9721-4855-8939-c154ce563116 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:23.331661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 895/1801] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:52:23.335783 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64cfb0-5ac4-4d0e-9cf4-68024823dd0e admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:23.344227 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5f369-dc93-4670-a384-ae2c404fcc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:23.345019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f369-dc93-4670-a384-ae2c404fcc1d admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:23.345946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f369-dc93-4670-a384-ae2c404fcc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:23.346327 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f369-dc93-4670-a384-ae2c404fcc1d admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:23.347545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5f369-dc93-4670-a384-ae2c404fcc1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:23.352123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5f369-dc93-4670-a384-ae2c404fcc1d admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:23.354658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64cfb0-5ac4-4d0e-9cf4-68024823dd0e admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:23.376818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97191b-5d49-44b2-a3d7-695c1b3ebc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:23.379615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97191b-5d49-44b2-a3d7-695c1b3ebc8f admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:23.379914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97191b-5d49-44b2-a3d7-695c1b3ebc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:23.380196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97191b-5d49-44b2-a3d7-695c1b3ebc8f admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:23.382956 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97191b-5d49-44b2-a3d7-695c1b3ebc8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:23.387943 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97191b-5d49-44b2-a3d7-695c1b3ebc8f admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:23.457175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 896/1802] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:23 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:23.457175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97191b-5d49-44b2-a3d7-695c1b3ebc8f admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:23.458635 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-4d97191b-5d49-44b2-a3d7-695c1b3ebc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:23.473424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 907/1803] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:23 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:23.477078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5f369-dc93-4670-a384-ae2c404fcc1d admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:23.599352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:23.717793 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97191b-5d49-44b2-a3d7-695c1b3ebc8f admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:23.804058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5f369-dc93-4670-a384-ae2c404fcc1d admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:23.828299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb70ab3-4b9b-4f31-b5ff-10eb58a55000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:23.832566 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7c3e2-4c59-4726-9e4d-93ccb0d04452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:23.832949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb70ab3-4b9b-4f31-b5ff-10eb58a55000 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:23.833251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7c3e2-4c59-4726-9e4d-93ccb0d04452 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:23.833393 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb70ab3-4b9b-4f31-b5ff-10eb58a55000 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:23.833607 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb70ab3-4b9b-4f31-b5ff-10eb58a55000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:23.841719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7c3e2-4c59-4726-9e4d-93ccb0d04452 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:23.842691 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7c3e2-4c59-4726-9e4d-93ccb0d04452 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:23.843384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7c3e2-4c59-4726-9e4d-93ccb0d04452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:23.845439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb70ab3-4b9b-4f31-b5ff-10eb58a55000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:23.845584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7c3e2-4c59-4726-9e4d-93ccb0d04452 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:23.847275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb70ab3-4b9b-4f31-b5ff-10eb58a55000 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:23.863999 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 897/1804] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:23.864854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb70ab3-4b9b-4f31-b5ff-10eb58a55000 service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:23.875501 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb70ab3-4b9b-4f31-b5ff-10eb58a55000 service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:23.886768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b469932-8c73-4e41-a6ce-fe87ef05bf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:23.887561 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b469932-8c73-4e41-a6ce-fe87ef05bf51 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:23.887851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b469932-8c73-4e41-a6ce-fe87ef05bf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:23.888131 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b469932-8c73-4e41-a6ce-fe87ef05bf51 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:23.888774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b469932-8c73-4e41-a6ce-fe87ef05bf51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:23.890940 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b469932-8c73-4e41-a6ce-fe87ef05bf51 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:23.929410 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 898/1805] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:23 2022] POST /identity/v3/users => generated 291 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:23.931720 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b469932-8c73-4e41-a6ce-fe87ef05bf51 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:23.933030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 908/1806] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:23 2022] POST /identity/v3/users => generated 288 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:23.937093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7c3e2-4c59-4726-9e4d-93ccb0d04452 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:23.956417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b469932-8c73-4e41-a6ce-fe87ef05bf51 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:23.968483 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7c3e2-4c59-4726-9e4d-93ccb0d04452 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:23.985029 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087ed89-457c-4804-8802-9783a43d3162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:23.986483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087ed89-457c-4804-8802-9783a43d3162 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:23.987098 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087ed89-457c-4804-8802-9783a43d3162 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:23.987598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087ed89-457c-4804-8802-9783a43d3162 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:23.988860 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087ed89-457c-4804-8802-9783a43d3162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:23.991090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087ed89-457c-4804-8802-9783a43d3162 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:24.002591 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e385ee-9a0e-4262-9ccb-f8948075c536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:24.006092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e385ee-9a0e-4262-9ccb-f8948075c536 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:24.007162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e385ee-9a0e-4262-9ccb-f8948075c536 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:24.008905 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e385ee-9a0e-4262-9ccb-f8948075c536 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:24.009921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e385ee-9a0e-4262-9ccb-f8948075c536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:24.014653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e385ee-9a0e-4262-9ccb-f8948075c536 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:24.018197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 899/1807] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:24.033897 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087ed89-457c-4804-8802-9783a43d3162 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:24.067276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 909/1808] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:24.068617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e385ee-9a0e-4262-9ccb-f8948075c536 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:24.091751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087ed89-457c-4804-8802-9783a43d3162 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:24.108515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58aabf-fdc8-433b-9a5a-eacada1166cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:24.109942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e385ee-9a0e-4262-9ccb-f8948075c536 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:24.110463 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58aabf-fdc8-433b-9a5a-eacada1166cd admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:24.111321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58aabf-fdc8-433b-9a5a-eacada1166cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:24.112636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58aabf-fdc8-433b-9a5a-eacada1166cd admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:24.114663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58aabf-fdc8-433b-9a5a-eacada1166cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:24.115864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58aabf-fdc8-433b-9a5a-eacada1166cd admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:24.126237 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259e606-c7bd-4cb6-aee3-75479aaf1850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:24.127039 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259e606-c7bd-4cb6-aee3-75479aaf1850 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:24.127455 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259e606-c7bd-4cb6-aee3-75479aaf1850 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:24.127830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259e606-c7bd-4cb6-aee3-75479aaf1850 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:24.128928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259e606-c7bd-4cb6-aee3-75479aaf1850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:24.138685 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259e606-c7bd-4cb6-aee3-75479aaf1850 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:24.155394 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 900/1809] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:24.156484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58aabf-fdc8-433b-9a5a-eacada1166cd admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:24.182482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 910/1810] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:24.186931 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259e606-c7bd-4cb6-aee3-75479aaf1850 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:24.202529 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58aabf-fdc8-433b-9a5a-eacada1166cd admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:24.216928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:24.226462 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259e606-c7bd-4cb6-aee3-75479aaf1850 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:24.228654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcd6e2-c1a1-4ad7-bfb5-116680bed117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:24.229477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcd6e2-c1a1-4ad7-bfb5-116680bed117 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:24.231209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcd6e2-c1a1-4ad7-bfb5-116680bed117 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:24.233371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcd6e2-c1a1-4ad7-bfb5-116680bed117 admin admin] PATH_INFO: `/v3/projects/c256b098bee549cdad277be32eeb2c34/users/2f69c6dc79fb40f9a27aacec35a1895e/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:24.255856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5e377-ac35-42ac-a1e7-8d628f0a4704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:24.256651 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5e377-ac35-42ac-a1e7-8d628f0a4704 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:24.257072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5e377-ac35-42ac-a1e7-8d628f0a4704 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:24.257458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5e377-ac35-42ac-a1e7-8d628f0a4704 admin admin] PATH_INFO: `/v3/projects/efc743fa93bd4970944e2c08e339704c/users/9b72b301523141e89664b481272be8ac/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:24.294865 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcd6e2-c1a1-4ad7-bfb5-116680bed117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c256b098bee549cdad277be32eeb2c34, user_id=2f69c6dc79fb40f9a27aacec35a1895e, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:24.305207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcd6e2-c1a1-4ad7-bfb5-116680bed117 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:24.334005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5e377-ac35-42ac-a1e7-8d628f0a4704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc743fa93bd4970944e2c08e339704c, user_id=9b72b301523141e89664b481272be8ac, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:24.344078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5e377-ac35-42ac-a1e7-8d628f0a4704 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:24.368801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 901/1811] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:24 2022] PUT /identity/v3/projects/c256b098bee549cdad277be32eeb2c34/users/2f69c6dc79fb40f9a27aacec35a1895e/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:24.385328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077bca5-2d81-4137-a4d3-136ebe194f1e None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:24.385832 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077bca5-2d81-4137-a4d3-136ebe194f1e None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:24.386178 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077bca5-2d81-4137-a4d3-136ebe194f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:24.403933 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 911/1812] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:24 2022] PUT /identity/v3/projects/efc743fa93bd4970944e2c08e339704c/users/9b72b301523141e89664b481272be8ac/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:24.430725 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee71b23-7cde-4cc9-951b-0e1a572d0a5a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:24.432393 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee71b23-7cde-4cc9-951b-0e1a572d0a5a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:24.432702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee71b23-7cde-4cc9-951b-0e1a572d0a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:24.518461 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-3077bca5-2d81-4137-a4d3-136ebe194f1e None None] MFA Rules not processed for user `2f69c6dc79fb40f9a27aacec35a1895e`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:24.519686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3077bca5-2d81-4137-a4d3-136ebe194f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:24.587864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-9ee71b23-7cde-4cc9-951b-0e1a572d0a5a None None] MFA Rules not processed for user `9b72b301523141e89664b481272be8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:24.590294 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9ee71b23-7cde-4cc9-951b-0e1a572d0a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:24.774205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 902/1813] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:24.775574 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077bca5-2d81-4137-a4d3-136ebe194f1e None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:24.793132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 912/1814] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:24.795387 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee71b23-7cde-4cc9-951b-0e1a572d0a5a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:24.838042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:24.985100 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077bca5-2d81-4137-a4d3-136ebe194f1e None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:25.000976 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6f86e-1af4-485a-b9b3-b493bce5edef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:25.002501 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f86e-1af4-485a-b9b3-b493bce5edef admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:25.002959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f86e-1af4-485a-b9b3-b493bce5edef admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:25.004074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f86e-1af4-485a-b9b3-b493bce5edef admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:25.004199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6f86e-1af4-485a-b9b3-b493bce5edef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:25.009436 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6f86e-1af4-485a-b9b3-b493bce5edef admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:25.075710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee71b23-7cde-4cc9-951b-0e1a572d0a5a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:25.099565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b2b76-a022-4bce-9416-d6e0a65eb49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:25.103637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b2b76-a022-4bce-9416-d6e0a65eb49d admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:25.103923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b2b76-a022-4bce-9416-d6e0a65eb49d admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:25.104207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b2b76-a022-4bce-9416-d6e0a65eb49d admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:25.109029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b2b76-a022-4bce-9416-d6e0a65eb49d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:25.114876 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 903/1815] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:24 2022] POST /identity/v3/projects => generated 381 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:25.115880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b2b76-a022-4bce-9416-d6e0a65eb49d admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:25.116798 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6f86e-1af4-485a-b9b3-b493bce5edef admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:25.199147 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 913/1816] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:24 2022] POST /identity/v3/projects => generated 375 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:25.203237 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b2b76-a022-4bce-9416-d6e0a65eb49d admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:25.353249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:25.364092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b2b76-a022-4bce-9416-d6e0a65eb49d admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:25.379319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e761f1-442f-454c-a765-918bdc7fd40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:25.379959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e761f1-442f-454c-a765-918bdc7fd40e admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:25.380244 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e761f1-442f-454c-a765-918bdc7fd40e admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:25.380596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e761f1-442f-454c-a765-918bdc7fd40e admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:25.381494 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e761f1-442f-454c-a765-918bdc7fd40e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:25.387066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e761f1-442f-454c-a765-918bdc7fd40e admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:25.390636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6f86e-1af4-485a-b9b3-b493bce5edef admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:25.419440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b522700-11da-4454-921b-f95abab83fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:25.422678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b522700-11da-4454-921b-f95abab83fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:25.425813 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b522700-11da-4454-921b-f95abab83fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:25.427914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b522700-11da-4454-921b-f95abab83fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:25.430574 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b522700-11da-4454-921b-f95abab83fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:25.440674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b522700-11da-4454-921b-f95abab83fd6 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:25.459953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 914/1817] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:25 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:52:25.465384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63872d01-664e-41c0-8d54-9752e292a38e None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:25.468549 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63872d01-664e-41c0-8d54-9752e292a38e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:25.468856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63872d01-664e-41c0-8d54-9752e292a38e None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:25.473356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 915/1818] 10.222.0.76 () {54 vars in 921 bytes} [Fri Aug 26 08:52:25 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:52:25.474250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63872d01-664e-41c0-8d54-9752e292a38e None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:25.510297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 904/1819] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:25 2022] POST /identity/v3/users => generated 297 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:25.521906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b522700-11da-4454-921b-f95abab83fd6 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:25.533968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63872d01-664e-41c0-8d54-9752e292a38e None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:25.548204 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829fb8a-f121-4e39-ac73-20c9d8e99b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:25.549369 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829fb8a-f121-4e39-ac73-20c9d8e99b85 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:25.549653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829fb8a-f121-4e39-ac73-20c9d8e99b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:25.552416 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829fb8a-f121-4e39-ac73-20c9d8e99b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:25.553162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829fb8a-f121-4e39-ac73-20c9d8e99b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:25.559853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b522700-11da-4454-921b-f95abab83fd6 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:25.572465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829fb8a-f121-4e39-ac73-20c9d8e99b85 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:25.587749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 916/1820] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:25.588976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829fb8a-f121-4e39-ac73-20c9d8e99b85 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:25.601601 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078a98a-c41b-4961-a8f8-b4d7cca6b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:25.601820 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829fb8a-f121-4e39-ac73-20c9d8e99b85 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:25.603051 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078a98a-c41b-4961-a8f8-b4d7cca6b366 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:25.604094 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078a98a-c41b-4961-a8f8-b4d7cca6b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:25.605052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078a98a-c41b-4961-a8f8-b4d7cca6b366 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:25.606171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078a98a-c41b-4961-a8f8-b4d7cca6b366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:25.607000 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995f29b-c54c-49cc-8993-7b151805a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:25.607789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995f29b-c54c-49cc-8993-7b151805a422 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:25.608116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995f29b-c54c-49cc-8993-7b151805a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:25.608475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995f29b-c54c-49cc-8993-7b151805a422 admin admin] PATH_INFO: `/v3/projects/0ef3d42411c64acdb2332fa4925baa61/users/df2b5432a5d1414d877f414bccc6e3f5/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:25.612033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078a98a-c41b-4961-a8f8-b4d7cca6b366 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:25.636934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995f29b-c54c-49cc-8993-7b151805a422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ef3d42411c64acdb2332fa4925baa61, user_id=df2b5432a5d1414d877f414bccc6e3f5, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:25.649159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995f29b-c54c-49cc-8993-7b151805a422 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:25.652947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 905/1821] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:25.655056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078a98a-c41b-4961-a8f8-b4d7cca6b366 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:25.691676 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078a98a-c41b-4961-a8f8-b4d7cca6b366 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:25.693259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 917/1822] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:25 2022] PUT /identity/v3/projects/0ef3d42411c64acdb2332fa4925baa61/users/df2b5432a5d1414d877f414bccc6e3f5/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:25.694546 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995f29b-c54c-49cc-8993-7b151805a422 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:25.812788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995f29b-c54c-49cc-8993-7b151805a422 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:25.822177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e902c2-f64b-4c44-80a3-f87af782a18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:25.824943 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e902c2-f64b-4c44-80a3-f87af782a18c admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:25.825592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e902c2-f64b-4c44-80a3-f87af782a18c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:25.828551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e902c2-f64b-4c44-80a3-f87af782a18c admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:25.833038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e902c2-f64b-4c44-80a3-f87af782a18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:25.837081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e902c2-f64b-4c44-80a3-f87af782a18c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:25.873044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 918/1823] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:25.882730 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e902c2-f64b-4c44-80a3-f87af782a18c admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:25.934745 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e902c2-f64b-4c44-80a3-f87af782a18c admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:25.955035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998f783-bb2a-45c1-bdc5-3e7a60c69fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:25.956247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98767d1-2a0d-4d45-8cd2-21bdf6ac7384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:25.956947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98767d1-2a0d-4d45-8cd2-21bdf6ac7384 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:25.957310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98767d1-2a0d-4d45-8cd2-21bdf6ac7384 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:25.957677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98767d1-2a0d-4d45-8cd2-21bdf6ac7384 admin admin] PATH_INFO: `/v3/projects/219db94fe88a428c994bc515b6676200/users/e0889164c54e4c499f24c3756680874e/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:25.958238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998f783-bb2a-45c1-bdc5-3e7a60c69fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:25.960507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998f783-bb2a-45c1-bdc5-3e7a60c69fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:25.961889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998f783-bb2a-45c1-bdc5-3e7a60c69fa0 admin admin] PATH_INFO: `/v3/projects/0ef3d42411c64acdb2332fa4925baa61/users/df2b5432a5d1414d877f414bccc6e3f5/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:25.969802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998f783-bb2a-45c1-bdc5-3e7a60c69fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ef3d42411c64acdb2332fa4925baa61, user_id=df2b5432a5d1414d877f414bccc6e3f5, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:25.978224 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998f783-bb2a-45c1-bdc5-3e7a60c69fa0 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:25.997913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98767d1-2a0d-4d45-8cd2-21bdf6ac7384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219db94fe88a428c994bc515b6676200, user_id=e0889164c54e4c499f24c3756680874e, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:26.002305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98767d1-2a0d-4d45-8cd2-21bdf6ac7384 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:26.028719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 919/1824] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:25 2022] PUT /identity/v3/projects/0ef3d42411c64acdb2332fa4925baa61/users/df2b5432a5d1414d877f414bccc6e3f5/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:26.028719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89306450-2e99-45aa-a19d-2b861e3d8957 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:26.028719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89306450-2e99-45aa-a19d-2b861e3d8957 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:26.028719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89306450-2e99-45aa-a19d-2b861e3d8957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:26.043721 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 906/1825] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:25 2022] PUT /identity/v3/projects/219db94fe88a428c994bc515b6676200/users/e0889164c54e4c499f24c3756680874e/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:26.049870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d945a-0a7f-45b2-8c7a-b3c017ebfd25 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:26.050155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d945a-0a7f-45b2-8c7a-b3c017ebfd25 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:26.050427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d945a-0a7f-45b2-8c7a-b3c017ebfd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:26.084912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-89306450-2e99-45aa-a19d-2b861e3d8957 None None] MFA Rules not processed for user `b63d6e588f6e4b598b75a2ec13bea25d`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:26.086617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-89306450-2e99-45aa-a19d-2b861e3d8957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:26.132227 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:26.161162 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-c95d945a-0a7f-45b2-8c7a-b3c017ebfd25 None None] MFA Rules not processed for user `df2b5432a5d1414d877f414bccc6e3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:26.166525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c95d945a-0a7f-45b2-8c7a-b3c017ebfd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:26.342785 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 920/1826] 10.222.0.76 () {58 vars in 1018 bytes} [Fri Aug 26 08:52:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:26.343941 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89306450-2e99-45aa-a19d-2b861e3d8957 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:26.409462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 907/1827] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:26.426635 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d945a-0a7f-45b2-8c7a-b3c017ebfd25 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:26.429828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:26.432198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c95d945a-0a7f-45b2-8c7a-b3c017ebfd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:26.562899 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89306450-2e99-45aa-a19d-2b861e3d8957 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:26.583458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c0b97-d323-4129-9405-6ff6b66da769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:26.584889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c0b97-d323-4129-9405-6ff6b66da769 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:26.584889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c0b97-d323-4129-9405-6ff6b66da769 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:26.587483 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c0b97-d323-4129-9405-6ff6b66da769 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:26.591081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c0b97-d323-4129-9405-6ff6b66da769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:26.599522 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c0b97-d323-4129-9405-6ff6b66da769 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:26.650739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 921/1828] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:26.651640 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c0b97-d323-4129-9405-6ff6b66da769 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:26.659057 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d945a-0a7f-45b2-8c7a-b3c017ebfd25 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:26.670380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec0bfc-9da3-4d39-b810-ecab6da2fd0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:26.671258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec0bfc-9da3-4d39-b810-ecab6da2fd0b service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:26.671858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec0bfc-9da3-4d39-b810-ecab6da2fd0b service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:26.673932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec0bfc-9da3-4d39-b810-ecab6da2fd0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:26.675438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c0b97-d323-4129-9405-6ff6b66da769 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:26.693324 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dd06a-826e-4f1d-8841-fa9f9a7b88cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:26.694449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dd06a-826e-4f1d-8841-fa9f9a7b88cd admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:26.697212 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dd06a-826e-4f1d-8841-fa9f9a7b88cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:26.697698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dd06a-826e-4f1d-8841-fa9f9a7b88cd admin admin] PATH_INFO: `/v3/projects/219db94fe88a428c994bc515b6676200/users/e0889164c54e4c499f24c3756680874e/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:26.703360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3dd06a-826e-4f1d-8841-fa9f9a7b88cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=219db94fe88a428c994bc515b6676200, user_id=e0889164c54e4c499f24c3756680874e, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:26.706603 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3dd06a-826e-4f1d-8841-fa9f9a7b88cd admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:26.750461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 922/1829] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:26 2022] PUT /identity/v3/projects/219db94fe88a428c994bc515b6676200/users/e0889164c54e4c499f24c3756680874e/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:26.752412 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12254378-5693-4105-ae9f-ce2c13b82803 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:26.754515 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12254378-5693-4105-ae9f-ce2c13b82803 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:26.755144 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12254378-5693-4105-ae9f-ce2c13b82803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:26.811995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-12254378-5693-4105-ae9f-ce2c13b82803 None None] MFA Rules not processed for user `e0889164c54e4c499f24c3756680874e`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:26.813712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-12254378-5693-4105-ae9f-ce2c13b82803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:26.825721 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec0bfc-9da3-4d39-b810-ecab6da2fd0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:26.829265 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec0bfc-9da3-4d39-b810-ecab6da2fd0b service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:26.860321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 908/1830] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:27.135086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 923/1831] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:27.162606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec0bfc-9da3-4d39-b810-ecab6da2fd0b service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:27.164878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ebec0bfc-9da3-4d39-b810-ecab6da2fd0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:27.181128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec0bfc-9da3-4d39-b810-ecab6da2fd0b service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:27.292964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:27.312329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac01ba3-3396-4e24-8d22-059b55485256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:27.313433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac01ba3-3396-4e24-8d22-059b55485256 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:27.314045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac01ba3-3396-4e24-8d22-059b55485256 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:27.314685 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac01ba3-3396-4e24-8d22-059b55485256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:27.336160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac01ba3-3396-4e24-8d22-059b55485256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:27.338220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac01ba3-3396-4e24-8d22-059b55485256 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:27.359151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 909/1832] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:27.765223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12254378-5693-4105-ae9f-ce2c13b82803 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:27.791650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12254378-5693-4105-ae9f-ce2c13b82803 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:27.796079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba698e-46d7-4240-a2b8-fc9ad1dc6d0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:27.797090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba698e-46d7-4240-a2b8-fc9ad1dc6d0a service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:27.797653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba698e-46d7-4240-a2b8-fc9ad1dc6d0a service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:27.798149 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba698e-46d7-4240-a2b8-fc9ad1dc6d0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:27.867056 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba698e-46d7-4240-a2b8-fc9ad1dc6d0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:27.868926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba698e-46d7-4240-a2b8-fc9ad1dc6d0a service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:27.913173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 924/1833] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:28.711899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac01ba3-3396-4e24-8d22-059b55485256 service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:28.807697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba698e-46d7-4240-a2b8-fc9ad1dc6d0a service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:28.826495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ddba698e-46d7-4240-a2b8-fc9ad1dc6d0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:28.911004 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:28.919955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac01ba3-3396-4e24-8d22-059b55485256 service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:28.954801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c13f37-b87c-42df-86a3-0c6e39cb1941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:28.955534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c13f37-b87c-42df-86a3-0c6e39cb1941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:28.955854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c13f37-b87c-42df-86a3-0c6e39cb1941 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:28.956122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c13f37-b87c-42df-86a3-0c6e39cb1941 admin admin] PATH_INFO: `/v3/users/2f69c6dc79fb40f9a27aacec35a1895e` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:28.957338 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c13f37-b87c-42df-86a3-0c6e39cb1941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f69c6dc79fb40f9a27aacec35a1895e)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:28.962162 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c13f37-b87c-42df-86a3-0c6e39cb1941 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:29.007047 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba698e-46d7-4240-a2b8-fc9ad1dc6d0a service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:29.027863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0461b-9568-4c34-8df6-b8a2a1a5896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:29.028968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0461b-9568-4c34-8df6-b8a2a1a5896c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:29.029315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0461b-9568-4c34-8df6-b8a2a1a5896c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:29.029599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0461b-9568-4c34-8df6-b8a2a1a5896c admin admin] PATH_INFO: `/v3/projects/cc2998d867514b59812eb2a6904882bc` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:29.032842 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0461b-9568-4c34-8df6-b8a2a1a5896c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2998d867514b59812eb2a6904882bc)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:29.034970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0461b-9568-4c34-8df6-b8a2a1a5896c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:29.091093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f2c13f37-b87c-42df-86a3-0c6e39cb1941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f69c6dc79fb40f9a27aacec35a1895e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:29.113630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f2c13f37-b87c-42df-86a3-0c6e39cb1941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f69c6dc79fb40f9a27aacec35a1895e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:29.117522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f2c13f37-b87c-42df-86a3-0c6e39cb1941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f69c6dc79fb40f9a27aacec35a1895e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:29.119024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f2c13f37-b87c-42df-86a3-0c6e39cb1941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f69c6dc79fb40f9a27aacec35a1895e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:29.141683 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f2c13f37-b87c-42df-86a3-0c6e39cb1941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f69c6dc79fb40f9a27aacec35a1895e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:29.197683 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 910/1834] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:28 2022] DELETE /identity/v3/users/2f69c6dc79fb40f9a27aacec35a1895e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:29.204685 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c13f37-b87c-42df-86a3-0c6e39cb1941 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:29.209229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-f2c13f37-b87c-42df-86a3-0c6e39cb1941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:29.244664 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a5a0461b-9568-4c34-8df6-b8a2a1a5896c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2998d867514b59812eb2a6904882bc', 'request_id': 'req-a5a0461b-9568-4c34-8df6-b8a2a1a5896c'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:29.265189 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a5a0461b-9568-4c34-8df6-b8a2a1a5896c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2998d867514b59812eb2a6904882bc', 'request_id': 'req-a5a0461b-9568-4c34-8df6-b8a2a1a5896c'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:29.297866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a5a0461b-9568-4c34-8df6-b8a2a1a5896c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2998d867514b59812eb2a6904882bc', 'request_id': 'req-a5a0461b-9568-4c34-8df6-b8a2a1a5896c'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:29.326890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a5a0461b-9568-4c34-8df6-b8a2a1a5896c admin admin] The token cache is being invalidate because project cc2998d867514b59812eb2a6904882bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:29.328926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a5a0461b-9568-4c34-8df6-b8a2a1a5896c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:29.330409 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a5a0461b-9568-4c34-8df6-b8a2a1a5896c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:29.337607 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 925/1835] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:28 2022] DELETE /identity/v3/projects/cc2998d867514b59812eb2a6904882bc => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:52:29.338543 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4eab1-6c89-49c2-9282-39be7f28198d None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:29.339971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4eab1-6c89-49c2-9282-39be7f28198d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:29.341353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4eab1-6c89-49c2-9282-39be7f28198d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:29.380238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-fae4eab1-6c89-49c2-9282-39be7f28198d None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:29.381783 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-fae4eab1-6c89-49c2-9282-39be7f28198d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:29.474366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c13f37-b87c-42df-86a3-0c6e39cb1941 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:29.487852 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229afd7-75e8-4d90-be6c-5d91ad8f15a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:29.491186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229afd7-75e8-4d90-be6c-5d91ad8f15a1 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:29.492103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229afd7-75e8-4d90-be6c-5d91ad8f15a1 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:29.493274 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229afd7-75e8-4d90-be6c-5d91ad8f15a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:29.499701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d229afd7-75e8-4d90-be6c-5d91ad8f15a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:29.510523 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 926/1836] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:29.511678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4eab1-6c89-49c2-9282-39be7f28198d None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:29.514937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-fae4eab1-6c89-49c2-9282-39be7f28198d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:29.530630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:29.536453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229afd7-75e8-4d90-be6c-5d91ad8f15a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:29.541242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229afd7-75e8-4d90-be6c-5d91ad8f15a1 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:29.548364 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4eab1-6c89-49c2-9282-39be7f28198d None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:29.560128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ee6d8-dd30-4ff7-8771-dae8e9fbe969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:29.560923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ee6d8-dd30-4ff7-8771-dae8e9fbe969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:29.561274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ee6d8-dd30-4ff7-8771-dae8e9fbe969 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:29.561549 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ee6d8-dd30-4ff7-8771-dae8e9fbe969 admin admin] PATH_INFO: `/v3/users/58d85ac2a70f43638a14cda603e982c9` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:29.563480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ee6d8-dd30-4ff7-8771-dae8e9fbe969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d85ac2a70f43638a14cda603e982c9)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:29.566065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ee6d8-dd30-4ff7-8771-dae8e9fbe969 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:29.573053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 911/1837] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:29.574615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229afd7-75e8-4d90-be6c-5d91ad8f15a1 service nova] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:29.590542 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d229afd7-75e8-4d90-be6c-5d91ad8f15a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:29.726861 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229afd7-75e8-4d90-be6c-5d91ad8f15a1 service nova] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:29.735823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-875ee6d8-dd30-4ff7-8771-dae8e9fbe969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d85ac2a70f43638a14cda603e982c9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:29.744000 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a01cb8-3272-4d64-b46f-947917e6d380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:29.746626 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a01cb8-3272-4d64-b46f-947917e6d380 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:29.747178 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a01cb8-3272-4d64-b46f-947917e6d380 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:29.748164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a01cb8-3272-4d64-b46f-947917e6d380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:29.751498 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-875ee6d8-dd30-4ff7-8771-dae8e9fbe969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d85ac2a70f43638a14cda603e982c9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:29.752696 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-875ee6d8-dd30-4ff7-8771-dae8e9fbe969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d85ac2a70f43638a14cda603e982c9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:29.759045 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:29.773646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-875ee6d8-dd30-4ff7-8771-dae8e9fbe969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d85ac2a70f43638a14cda603e982c9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:29.779382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a01cb8-3272-4d64-b46f-947917e6d380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:29.785111 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a01cb8-3272-4d64-b46f-947917e6d380 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:29.801501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-875ee6d8-dd30-4ff7-8771-dae8e9fbe969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d85ac2a70f43638a14cda603e982c9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:29.821047 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 927/1838] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:29 2022] DELETE /identity/v3/users/58d85ac2a70f43638a14cda603e982c9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:29.832364 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 912/1839] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:30.478777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ee6d8-dd30-4ff7-8771-dae8e9fbe969 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:30.480487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-875ee6d8-dd30-4ff7-8771-dae8e9fbe969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:30.696737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ee6d8-dd30-4ff7-8771-dae8e9fbe969 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:30.713991 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f12d3-7016-48f9-9882-c2c26c17ccb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:30.714632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f12d3-7016-48f9-9882-c2c26c17ccb2 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:30.715000 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f12d3-7016-48f9-9882-c2c26c17ccb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:30.715180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f12d3-7016-48f9-9882-c2c26c17ccb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:30.726229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ed1f12d3-7016-48f9-9882-c2c26c17ccb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:30.867958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f12d3-7016-48f9-9882-c2c26c17ccb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:30.871093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f12d3-7016-48f9-9882-c2c26c17ccb2 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:30.886057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 928/1840] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:31.308105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a01cb8-3272-4d64-b46f-947917e6d380 service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:31.310218 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-30a01cb8-3272-4d64-b46f-947917e6d380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:31.344727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a01cb8-3272-4d64-b46f-947917e6d380 service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:31.514752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:31.515961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:31.516537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:31.517730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4 admin admin] PATH_INFO: `/v3/projects/c256b098bee549cdad277be32eeb2c34` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:31.520375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c256b098bee549cdad277be32eeb2c34)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:31.523457 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:31.596494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c256b098bee549cdad277be32eeb2c34', 'request_id': 'req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:31.610971 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c256b098bee549cdad277be32eeb2c34', 'request_id': 'req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:31.622505 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c256b098bee549cdad277be32eeb2c34', 'request_id': 'req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:31.654155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4 admin admin] The token cache is being invalidate because project c256b098bee549cdad277be32eeb2c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:31.654980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:31.657405 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:31.669979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 913/1841] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:31 2022] DELETE /identity/v3/projects/c256b098bee549cdad277be32eeb2c34 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:31.673927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f12d3-7016-48f9-9882-c2c26c17ccb2 service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:31.675568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ed1f12d3-7016-48f9-9882-c2c26c17ccb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:31.701480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f12d3-7016-48f9-9882-c2c26c17ccb2 service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:31.873375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9ff45-123b-48fb-84de-170fc4bb4a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:31.875367 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9ff45-123b-48fb-84de-170fc4bb4a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:31.875832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9ff45-123b-48fb-84de-170fc4bb4a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:31.876884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9ff45-123b-48fb-84de-170fc4bb4a58 admin admin] PATH_INFO: `/v3/users/e0889164c54e4c499f24c3756680874e` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:31.882102 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9ff45-123b-48fb-84de-170fc4bb4a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0889164c54e4c499f24c3756680874e)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:31.887979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9ff45-123b-48fb-84de-170fc4bb4a58 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:31.952898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:32.006865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-16a9ff45-123b-48fb-84de-170fc4bb4a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0889164c54e4c499f24c3756680874e'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:32.025449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-16a9ff45-123b-48fb-84de-170fc4bb4a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0889164c54e4c499f24c3756680874e'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:32.026161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-16a9ff45-123b-48fb-84de-170fc4bb4a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0889164c54e4c499f24c3756680874e'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:32.041180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-16a9ff45-123b-48fb-84de-170fc4bb4a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0889164c54e4c499f24c3756680874e'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:32.087751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-16a9ff45-123b-48fb-84de-170fc4bb4a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0889164c54e4c499f24c3756680874e'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:32.101274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 929/1842] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:31 2022] DELETE /identity/v3/users/e0889164c54e4c499f24c3756680874e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:32.790604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:32.792547 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:32.816347 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60cdde-61fa-4b70-bab5-32e654ce9bd4 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:32.851680 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:32.934862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558b98f-00bb-465c-ad90-1953b0fa514f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:32.935747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558b98f-00bb-465c-ad90-1953b0fa514f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:32.936228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558b98f-00bb-465c-ad90-1953b0fa514f admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:32.936716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558b98f-00bb-465c-ad90-1953b0fa514f admin admin] PATH_INFO: `/v3/projects/ac33b6c49ed94b2fba034f8982243b98` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:32.939228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558b98f-00bb-465c-ad90-1953b0fa514f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac33b6c49ed94b2fba034f8982243b98)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:32.941900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558b98f-00bb-465c-ad90-1953b0fa514f admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:33.055756 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e558b98f-00bb-465c-ad90-1953b0fa514f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac33b6c49ed94b2fba034f8982243b98', 'request_id': 'req-e558b98f-00bb-465c-ad90-1953b0fa514f'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:33.078479 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e558b98f-00bb-465c-ad90-1953b0fa514f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac33b6c49ed94b2fba034f8982243b98', 'request_id': 'req-e558b98f-00bb-465c-ad90-1953b0fa514f'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:33.080242 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3240-ea89-48be-9a74-98a7c60aa091 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:33.080734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3240-ea89-48be-9a74-98a7c60aa091 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:33.080810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3240-ea89-48be-9a74-98a7c60aa091 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:33.084503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 930/1843] 10.222.0.76 () {54 vars in 921 bytes} [Fri Aug 26 08:52:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 08:52:33.101711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e558b98f-00bb-465c-ad90-1953b0fa514f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac33b6c49ed94b2fba034f8982243b98', 'request_id': 'req-e558b98f-00bb-465c-ad90-1953b0fa514f'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:33.114443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e558b98f-00bb-465c-ad90-1953b0fa514f admin admin] The token cache is being invalidate because project ac33b6c49ed94b2fba034f8982243b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:33.114831 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e558b98f-00bb-465c-ad90-1953b0fa514f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:33.115588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e558b98f-00bb-465c-ad90-1953b0fa514f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:33.135171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 914/1844] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:32 2022] DELETE /identity/v3/projects/ac33b6c49ed94b2fba034f8982243b98 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:33.136797 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc8ac1-07a1-46bb-9e14-9b5b2fff059a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:33.137923 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc284c2-f8be-4d46-a171-6253ad3477e9 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:33.138223 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc284c2-f8be-4d46-a171-6253ad3477e9 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:33.138442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc8ac1-07a1-46bb-9e14-9b5b2fff059a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:33.138546 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc284c2-f8be-4d46-a171-6253ad3477e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:33.138909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc8ac1-07a1-46bb-9e14-9b5b2fff059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:33.169470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-4dc284c2-f8be-4d46-a171-6253ad3477e9 None None] MFA Rules not processed for user `b63d6e588f6e4b598b75a2ec13bea25d`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:33.177099 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-4dc284c2-f8be-4d46-a171-6253ad3477e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:33.202097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-cefc8ac1-07a1-46bb-9e14-9b5b2fff059a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:33.203378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-cefc8ac1-07a1-46bb-9e14-9b5b2fff059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:33.385419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 931/1845] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:33.399761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81419b7-9b64-4707-8004-c6fee780295f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:33.401017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81419b7-9b64-4707-8004-c6fee780295f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:33.401367 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81419b7-9b64-4707-8004-c6fee780295f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:33.444345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-d81419b7-9b64-4707-8004-c6fee780295f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:33.449300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 915/1846] 10.222.0.76 () {58 vars in 1018 bytes} [Fri Aug 26 08:52:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:33.453043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d81419b7-9b64-4707-8004-c6fee780295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:33.474113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 932/1847] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:33.478982 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc284c2-f8be-4d46-a171-6253ad3477e9 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:33.506531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc284c2-f8be-4d46-a171-6253ad3477e9 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:33.518924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb4676-757c-4ef7-b393-39a58a3cfaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:33.519744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb4676-757c-4ef7-b393-39a58a3cfaf7 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:33.520126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb4676-757c-4ef7-b393-39a58a3cfaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:33.520550 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb4676-757c-4ef7-b393-39a58a3cfaf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:33.521420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb4676-757c-4ef7-b393-39a58a3cfaf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:52:33.521875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb4676-757c-4ef7-b393-39a58a3cfaf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:33.523991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb4676-757c-4ef7-b393-39a58a3cfaf7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:33.549396 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 916/1848] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:52:33.549530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81419b7-9b64-4707-8004-c6fee780295f None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:33.560317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81419b7-9b64-4707-8004-c6fee780295f None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:33.568588 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25e956-90d6-4b41-84b4-b16ca12ca841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:33.570403 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25e956-90d6-4b41-84b4-b16ca12ca841 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:33.570779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25e956-90d6-4b41-84b4-b16ca12ca841 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:33.571192 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25e956-90d6-4b41-84b4-b16ca12ca841 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:33.571832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25e956-90d6-4b41-84b4-b16ca12ca841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:33.574224 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25e956-90d6-4b41-84b4-b16ca12ca841 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:33.610034 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 933/1849] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:33 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:52:33.611579 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb4676-757c-4ef7-b393-39a58a3cfaf7 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:33.622354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb4676-757c-4ef7-b393-39a58a3cfaf7 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:33.667475 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:33.682582 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25e956-90d6-4b41-84b4-b16ca12ca841 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:33.688534 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-5b25e956-90d6-4b41-84b4-b16ca12ca841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:33.701110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9335c71-43f9-49dd-b21c-14e354de0ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:33.701110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9335c71-43f9-49dd-b21c-14e354de0ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:33.701110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9335c71-43f9-49dd-b21c-14e354de0ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:33.701110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9335c71-43f9-49dd-b21c-14e354de0ab8 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:33.701524 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9335c71-43f9-49dd-b21c-14e354de0ab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:33.703321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9335c71-43f9-49dd-b21c-14e354de0ab8 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:33.733456 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 917/1850] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:33 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:52:33.734344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9335c71-43f9-49dd-b21c-14e354de0ab8 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:33.737293 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b9335c71-43f9-49dd-b21c-14e354de0ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:33.750032 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9335c71-43f9-49dd-b21c-14e354de0ab8 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:33.755703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1722d-36c8-4fd6-b58d-5ccb518d1ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:33.756820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1722d-36c8-4fd6-b58d-5ccb518d1ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:33.757320 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1722d-36c8-4fd6-b58d-5ccb518d1ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:33.757847 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1722d-36c8-4fd6-b58d-5ccb518d1ea0 admin admin] PATH_INFO: `/v3/projects/219db94fe88a428c994bc515b6676200` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:33.759608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1722d-36c8-4fd6-b58d-5ccb518d1ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=219db94fe88a428c994bc515b6676200)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:33.761275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1722d-36c8-4fd6-b58d-5ccb518d1ea0 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:33.809467 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25e956-90d6-4b41-84b4-b16ca12ca841 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:33.817556 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d0b84-5b3d-44e7-b87a-5e45209a3c55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:33.818389 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d0b84-5b3d-44e7-b87a-5e45209a3c55 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:33.818786 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d0b84-5b3d-44e7-b87a-5e45209a3c55 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:33.819204 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d0b84-5b3d-44e7-b87a-5e45209a3c55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:33.826689 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5ae1722d-36c8-4fd6-b58d-5ccb518d1ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219db94fe88a428c994bc515b6676200', 'request_id': 'req-5ae1722d-36c8-4fd6-b58d-5ccb518d1ea0'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:33.829578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d0b84-5b3d-44e7-b87a-5e45209a3c55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:33.831839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d0b84-5b3d-44e7-b87a-5e45209a3c55 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:33.835148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5ae1722d-36c8-4fd6-b58d-5ccb518d1ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219db94fe88a428c994bc515b6676200', 'request_id': 'req-5ae1722d-36c8-4fd6-b58d-5ccb518d1ea0'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:33.838706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:33.845909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 934/1851] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:33.846795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d0b84-5b3d-44e7-b87a-5e45209a3c55 service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:33.856788 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5ae1722d-36c8-4fd6-b58d-5ccb518d1ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219db94fe88a428c994bc515b6676200', 'request_id': 'req-5ae1722d-36c8-4fd6-b58d-5ccb518d1ea0'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:33.859426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d0b84-5b3d-44e7-b87a-5e45209a3c55 service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:33.871945 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5ae1722d-36c8-4fd6-b58d-5ccb518d1ea0 admin admin] The token cache is being invalidate because project 219db94fe88a428c994bc515b6676200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:33.872230 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5ae1722d-36c8-4fd6-b58d-5ccb518d1ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:33.873096 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5ae1722d-36c8-4fd6-b58d-5ccb518d1ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:33.880371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 918/1852] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:33 2022] DELETE /identity/v3/projects/219db94fe88a428c994bc515b6676200 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:33.881826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d657262-e98d-47ad-9377-98754b091fa7 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:33.882550 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d657262-e98d-47ad-9377-98754b091fa7 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:33.882550 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d657262-e98d-47ad-9377-98754b091fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:33.912218 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-6d657262-e98d-47ad-9377-98754b091fa7 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:33.913475 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-6d657262-e98d-47ad-9377-98754b091fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:33.959337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd077a-4b56-4d6d-bd0a-50be76391518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:33.960268 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd077a-4b56-4d6d-bd0a-50be76391518 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:33.960765 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd077a-4b56-4d6d-bd0a-50be76391518 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:33.961255 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd077a-4b56-4d6d-bd0a-50be76391518 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:33.962133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd077a-4b56-4d6d-bd0a-50be76391518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:33.964093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd077a-4b56-4d6d-bd0a-50be76391518 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:33.976265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 935/1853] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:33.980462 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd077a-4b56-4d6d-bd0a-50be76391518 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:33.986501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-aefd077a-4b56-4d6d-bd0a-50be76391518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:34.002764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd077a-4b56-4d6d-bd0a-50be76391518 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:34.008407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67099e4-b8e4-49eb-a263-8ee2e15b340a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:34.009123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67099e4-b8e4-49eb-a263-8ee2e15b340a admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:34.009328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67099e4-b8e4-49eb-a263-8ee2e15b340a admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:34.009605 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67099e4-b8e4-49eb-a263-8ee2e15b340a admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:34.010248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67099e4-b8e4-49eb-a263-8ee2e15b340a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:34.011830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67099e4-b8e4-49eb-a263-8ee2e15b340a admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:34.020381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 919/1854] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:34.028015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9071b2-ca09-4011-bed6-bdadf70081d8 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:34.028308 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9071b2-ca09-4011-bed6-bdadf70081d8 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:34.028584 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9071b2-ca09-4011-bed6-bdadf70081d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:34.035076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 936/1855] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:34.036339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67099e4-b8e4-49eb-a263-8ee2e15b340a admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:34.047343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67099e4-b8e4-49eb-a263-8ee2e15b340a admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:34.052474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc29a7f-926a-46f2-80cd-badba40c914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:34.053183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc29a7f-926a-46f2-80cd-badba40c914c admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:34.053466 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc29a7f-926a-46f2-80cd-badba40c914c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:34.053759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc29a7f-926a-46f2-80cd-badba40c914c admin admin] PATH_INFO: `/v3/projects/cbccbb5fa4804e1391a824465502658b/users/fcf93d5872d64024af4a71aeed720a0d/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:34.060341 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-0e9071b2-ca09-4011-bed6-bdadf70081d8 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:34.071190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0e9071b2-ca09-4011-bed6-bdadf70081d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:34.078830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc29a7f-926a-46f2-80cd-badba40c914c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbccbb5fa4804e1391a824465502658b, user_id=fcf93d5872d64024af4a71aeed720a0d, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:34.082104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc29a7f-926a-46f2-80cd-badba40c914c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:34.090985 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 920/1856] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:52:34.095795 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9071b2-ca09-4011-bed6-bdadf70081d8 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:34.100726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 937/1857] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:34 2022] PUT /identity/v3/projects/cbccbb5fa4804e1391a824465502658b/users/fcf93d5872d64024af4a71aeed720a0d/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:52:34.112062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae231bfe-9f7f-42ad-a8a1-e1ccdc62790d None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:34.112361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae231bfe-9f7f-42ad-a8a1-e1ccdc62790d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:34.112709 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae231bfe-9f7f-42ad-a8a1-e1ccdc62790d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:34.115135 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9071b2-ca09-4011-bed6-bdadf70081d8 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:34.141303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-ae231bfe-9f7f-42ad-a8a1-e1ccdc62790d None None] MFA Rules not processed for user `fcf93d5872d64024af4a71aeed720a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:34.143106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ae231bfe-9f7f-42ad-a8a1-e1ccdc62790d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:34.163587 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:34.182648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d28eb8-9c30-4ef7-8239-c943e1175eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:34.184171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d28eb8-9c30-4ef7-8239-c943e1175eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:34.184171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d28eb8-9c30-4ef7-8239-c943e1175eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:34.184377 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d28eb8-9c30-4ef7-8239-c943e1175eb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:34.184954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d28eb8-9c30-4ef7-8239-c943e1175eb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:52:34.185292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d28eb8-9c30-4ef7-8239-c943e1175eb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:34.186904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d28eb8-9c30-4ef7-8239-c943e1175eb0 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:34.203087 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 921/1858] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:52:34.204667 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d28eb8-9c30-4ef7-8239-c943e1175eb0 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:34.213343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 938/1859] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:34.218569 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d28eb8-9c30-4ef7-8239-c943e1175eb0 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:34.225659 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84fa39-0375-4072-a1f7-e46273375f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:34.226477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84fa39-0375-4072-a1f7-e46273375f07 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:34.226772 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84fa39-0375-4072-a1f7-e46273375f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:34.227049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84fa39-0375-4072-a1f7-e46273375f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:34.227689 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84fa39-0375-4072-a1f7-e46273375f07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:34.228285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae231bfe-9f7f-42ad-a8a1-e1ccdc62790d None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:34.229630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84fa39-0375-4072-a1f7-e46273375f07 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:34.230280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ae231bfe-9f7f-42ad-a8a1-e1ccdc62790d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:34.261611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 922/1860] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:34 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:34.265718 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84fa39-0375-4072-a1f7-e46273375f07 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:34.299122 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:34.338657 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae231bfe-9f7f-42ad-a8a1-e1ccdc62790d None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:34.347951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84fa39-0375-4072-a1f7-e46273375f07 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:34.354385 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7b8ae-5f60-4187-abfc-e63648bb1211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:34.355351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7b8ae-5f60-4187-abfc-e63648bb1211 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:34.355493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7b8ae-5f60-4187-abfc-e63648bb1211 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:34.355872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7b8ae-5f60-4187-abfc-e63648bb1211 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:34.356597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7b8ae-5f60-4187-abfc-e63648bb1211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:34.359481 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7b8ae-5f60-4187-abfc-e63648bb1211 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:34.393022 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 923/1861] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:34 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:52:34.395483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7b8ae-5f60-4187-abfc-e63648bb1211 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:34.405268 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36c009-0c0e-4bbf-931c-152dd0e9266f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fde38c1a2a844368acd3e1b9aa10151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:34.405945 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36c009-0c0e-4bbf-931c-152dd0e9266f service glance] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:34.406231 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36c009-0c0e-4bbf-931c-152dd0e9266f service glance] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:34.406508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36c009-0c0e-4bbf-931c-152dd0e9266f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:34.406730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7b8ae-5f60-4187-abfc-e63648bb1211 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:34.412193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea270d-662c-408c-a670-bfcdf9e93500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:34.412799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea270d-662c-408c-a670-bfcdf9e93500 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:34.413112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea270d-662c-408c-a670-bfcdf9e93500 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:34.413389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea270d-662c-408c-a670-bfcdf9e93500 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:34.414034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea270d-662c-408c-a670-bfcdf9e93500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:34.415615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea270d-662c-408c-a670-bfcdf9e93500 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:34.426491 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 924/1862] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:52:34.433986 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea270d-662c-408c-a670-bfcdf9e93500 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:34.447643 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea270d-662c-408c-a670-bfcdf9e93500 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:34.455696 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f362413-97a4-470c-b456-14da87f0c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:34.457315 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f362413-97a4-470c-b456-14da87f0c55e admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:34.457699 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f362413-97a4-470c-b456-14da87f0c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:34.457924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f362413-97a4-470c-b456-14da87f0c55e admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:34.458628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f362413-97a4-470c-b456-14da87f0c55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:34.460537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f362413-97a4-470c-b456-14da87f0c55e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:34.473606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 925/1863] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:34.477887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f362413-97a4-470c-b456-14da87f0c55e admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:34.486781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36c009-0c0e-4bbf-931c-152dd0e9266f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:34.488226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36c009-0c0e-4bbf-931c-152dd0e9266f service glance] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:34.489036 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f362413-97a4-470c-b456-14da87f0c55e admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:34.494553 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccb70d-880b-4a9b-b294-cb4741882247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:34.495284 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccb70d-880b-4a9b-b294-cb4741882247 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:34.495634 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccb70d-880b-4a9b-b294-cb4741882247 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:34.496057 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccb70d-880b-4a9b-b294-cb4741882247 admin admin] PATH_INFO: `/v3/projects/0507c18e029e4e4a98e3342f2ad712d6/users/3c43d287740d438dbe5199df73e77ee8/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:34.509422 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 939/1864] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:52:34.512910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccb70d-880b-4a9b-b294-cb4741882247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0507c18e029e4e4a98e3342f2ad712d6, user_id=3c43d287740d438dbe5199df73e77ee8, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:34.516245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccb70d-880b-4a9b-b294-cb4741882247 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:34.536650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 926/1865] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:34 2022] PUT /identity/v3/projects/0507c18e029e4e4a98e3342f2ad712d6/users/3c43d287740d438dbe5199df73e77ee8/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:52:34.546173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cdbe9-f992-43d1-b3b4-26085ed2459a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:34.546544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cdbe9-f992-43d1-b3b4-26085ed2459a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:34.546890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cdbe9-f992-43d1-b3b4-26085ed2459a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:34.583933 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-da8cdbe9-f992-43d1-b3b4-26085ed2459a None None] MFA Rules not processed for user `3c43d287740d438dbe5199df73e77ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:34.585659 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-da8cdbe9-f992-43d1-b3b4-26085ed2459a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:34.705049 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 940/1866] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:34.808198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccb70d-880b-4a9b-b294-cb4741882247 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:34.810061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a5ccb70d-880b-4a9b-b294-cb4741882247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:34.886084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccb70d-880b-4a9b-b294-cb4741882247 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:34.892344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d60f6d-8bc2-4b3b-9a40-96791369e7c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:34.892969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d60f6d-8bc2-4b3b-9a40-96791369e7c8 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:34.893309 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d60f6d-8bc2-4b3b-9a40-96791369e7c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:34.893859 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d60f6d-8bc2-4b3b-9a40-96791369e7c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:34.907232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d60f6d-8bc2-4b3b-9a40-96791369e7c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:34.909637 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d60f6d-8bc2-4b3b-9a40-96791369e7c8 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:34.919692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 927/1867] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:40.616187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cdbe9-f992-43d1-b3b4-26085ed2459a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:40.653134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:40.692097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cdbe9-f992-43d1-b3b4-26085ed2459a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:40.697496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b587967-e996-41cc-b2f7-b22a30e816e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:40.698206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b587967-e996-41cc-b2f7-b22a30e816e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:40.698494 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b587967-e996-41cc-b2f7-b22a30e816e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:40.698770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b587967-e996-41cc-b2f7-b22a30e816e8 admin admin] PATH_INFO: `/v3/users/3c43d287740d438dbe5199df73e77ee8` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:40.699929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b587967-e996-41cc-b2f7-b22a30e816e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c43d287740d438dbe5199df73e77ee8)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:40.703682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b587967-e996-41cc-b2f7-b22a30e816e8 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:40.755193 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0b587967-e996-41cc-b2f7-b22a30e816e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c43d287740d438dbe5199df73e77ee8'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:40.767734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0b587967-e996-41cc-b2f7-b22a30e816e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c43d287740d438dbe5199df73e77ee8'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:40.768398 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0b587967-e996-41cc-b2f7-b22a30e816e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c43d287740d438dbe5199df73e77ee8'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:40.775883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0b587967-e996-41cc-b2f7-b22a30e816e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c43d287740d438dbe5199df73e77ee8'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:40.788306 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0b587967-e996-41cc-b2f7-b22a30e816e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c43d287740d438dbe5199df73e77ee8'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:40.794342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 941/1868] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:40 2022] DELETE /identity/v3/users/3c43d287740d438dbe5199df73e77ee8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:40.799287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9611f3d-a89b-4222-9797-9d4f4f391d88 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:40.799864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9611f3d-a89b-4222-9797-9d4f4f391d88 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:40.799959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9611f3d-a89b-4222-9797-9d4f4f391d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:40.807321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:40.823731 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-b9611f3d-a89b-4222-9797-9d4f4f391d88 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:40.825823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b9611f3d-a89b-4222-9797-9d4f4f391d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:40.922053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 928/1869] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:52:40.933204 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b587967-e996-41cc-b2f7-b22a30e816e8 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:40.934776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0b587967-e996-41cc-b2f7-b22a30e816e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:40.997089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b587967-e996-41cc-b2f7-b22a30e816e8 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:40.999317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab0cc5-b4e1-4fe1-9c99-edceda825710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:41.000013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab0cc5-b4e1-4fe1-9c99-edceda825710 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:41.000374 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab0cc5-b4e1-4fe1-9c99-edceda825710 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:41.000792 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab0cc5-b4e1-4fe1-9c99-edceda825710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:41.012072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab0cc5-b4e1-4fe1-9c99-edceda825710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:41.013572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab0cc5-b4e1-4fe1-9c99-edceda825710 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:41.023892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 942/1870] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:41.325317 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9611f3d-a89b-4222-9797-9d4f4f391d88 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:41.327408 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b9611f3d-a89b-4222-9797-9d4f4f391d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:41.345989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9611f3d-a89b-4222-9797-9d4f4f391d88 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:41.362889 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb22b7-3988-4d18-b691-5f111b1522ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:41.363544 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb22b7-3988-4d18-b691-5f111b1522ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:41.363830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb22b7-3988-4d18-b691-5f111b1522ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:41.364105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb22b7-3988-4d18-b691-5f111b1522ce admin admin] PATH_INFO: `/v3/projects/0507c18e029e4e4a98e3342f2ad712d6` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:41.365275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb22b7-3988-4d18-b691-5f111b1522ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0507c18e029e4e4a98e3342f2ad712d6)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:41.367189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb22b7-3988-4d18-b691-5f111b1522ce admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:41.426391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-60cb22b7-3988-4d18-b691-5f111b1522ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0507c18e029e4e4a98e3342f2ad712d6', 'request_id': 'req-60cb22b7-3988-4d18-b691-5f111b1522ce'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:41.432836 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-60cb22b7-3988-4d18-b691-5f111b1522ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0507c18e029e4e4a98e3342f2ad712d6', 'request_id': 'req-60cb22b7-3988-4d18-b691-5f111b1522ce'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:41.441199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-60cb22b7-3988-4d18-b691-5f111b1522ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0507c18e029e4e4a98e3342f2ad712d6', 'request_id': 'req-60cb22b7-3988-4d18-b691-5f111b1522ce'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:41.458365 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-60cb22b7-3988-4d18-b691-5f111b1522ce admin admin] The token cache is being invalidate because project 0507c18e029e4e4a98e3342f2ad712d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:41.458665 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-60cb22b7-3988-4d18-b691-5f111b1522ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:41.459464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-60cb22b7-3988-4d18-b691-5f111b1522ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:41.461092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 929/1871] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:41 2022] DELETE /identity/v3/projects/0507c18e029e4e4a98e3342f2ad712d6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:41.466896 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183538e8-9ab1-4080-a679-9cc7b2ca91fd None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:41.467190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183538e8-9ab1-4080-a679-9cc7b2ca91fd None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:41.467737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183538e8-9ab1-4080-a679-9cc7b2ca91fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:41.492703 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-183538e8-9ab1-4080-a679-9cc7b2ca91fd None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:41.494247 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-183538e8-9ab1-4080-a679-9cc7b2ca91fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:41.563748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:41.607570 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 943/1872] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:41.615359 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831151b-5826-4ef4-9481-f8cc86931a41 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:41.615752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831151b-5826-4ef4-9481-f8cc86931a41 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:41.616384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831151b-5826-4ef4-9481-f8cc86931a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:41.643875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-4831151b-5826-4ef4-9481-f8cc86931a41 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:41.645373 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-4831151b-5826-4ef4-9481-f8cc86931a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:41.654080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 930/1873] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:41.658976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183538e8-9ab1-4080-a679-9cc7b2ca91fd None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:41.671366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183538e8-9ab1-4080-a679-9cc7b2ca91fd None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:41.677150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63fcaa-c72f-4c25-857f-abb87f62de97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:41.677784 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63fcaa-c72f-4c25-857f-abb87f62de97 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:41.678067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63fcaa-c72f-4c25-857f-abb87f62de97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:41.678350 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63fcaa-c72f-4c25-857f-abb87f62de97 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:41.679059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63fcaa-c72f-4c25-857f-abb87f62de97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:52:41.679379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63fcaa-c72f-4c25-857f-abb87f62de97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:41.680973 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63fcaa-c72f-4c25-857f-abb87f62de97 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:41.697172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 944/1874] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:52:41.698726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831151b-5826-4ef4-9481-f8cc86931a41 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:41.708954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831151b-5826-4ef4-9481-f8cc86931a41 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:41.713812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d73e3-c344-4524-95ce-7a9593bc9374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:41.714423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d73e3-c344-4524-95ce-7a9593bc9374 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:41.714706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d73e3-c344-4524-95ce-7a9593bc9374 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:41.714983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d73e3-c344-4524-95ce-7a9593bc9374 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:41.715619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d73e3-c344-4524-95ce-7a9593bc9374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:41.717822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d73e3-c344-4524-95ce-7a9593bc9374 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:41.748680 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 931/1875] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:41 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:52:41.752568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63fcaa-c72f-4c25-857f-abb87f62de97 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:41.763601 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63fcaa-c72f-4c25-857f-abb87f62de97 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:41.836617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806459e-5caa-4518-b7ff-5a3a2ea18bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:41.837297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806459e-5caa-4518-b7ff-5a3a2ea18bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:41.837580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806459e-5caa-4518-b7ff-5a3a2ea18bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:41.837894 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806459e-5caa-4518-b7ff-5a3a2ea18bd7 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:41.838515 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806459e-5caa-4518-b7ff-5a3a2ea18bd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:41.840432 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806459e-5caa-4518-b7ff-5a3a2ea18bd7 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:41.862710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 945/1876] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:41 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:52:41.866910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d73e3-c344-4524-95ce-7a9593bc9374 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:41.878120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d73e3-c344-4524-95ce-7a9593bc9374 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:41.882720 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe646cf-d277-4d2e-87d6-941883f0a3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:41.883320 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe646cf-d277-4d2e-87d6-941883f0a3dc admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:41.883609 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe646cf-d277-4d2e-87d6-941883f0a3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:41.883880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe646cf-d277-4d2e-87d6-941883f0a3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:41.884542 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe646cf-d277-4d2e-87d6-941883f0a3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:41.886208 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe646cf-d277-4d2e-87d6-941883f0a3dc admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:41.900796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 932/1877] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:41.902047 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806459e-5caa-4518-b7ff-5a3a2ea18bd7 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:41.913069 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806459e-5caa-4518-b7ff-5a3a2ea18bd7 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:41.917874 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095bf2b-199c-4018-a402-92dcce7a6474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:41.918465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095bf2b-199c-4018-a402-92dcce7a6474 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:41.918753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095bf2b-199c-4018-a402-92dcce7a6474 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:41.919032 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095bf2b-199c-4018-a402-92dcce7a6474 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:41.919693 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095bf2b-199c-4018-a402-92dcce7a6474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:41.921345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095bf2b-199c-4018-a402-92dcce7a6474 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:41.936270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 946/1878] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:41.937506 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe646cf-d277-4d2e-87d6-941883f0a3dc admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:41.948096 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe646cf-d277-4d2e-87d6-941883f0a3dc admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:41.953086 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be5544-af8c-41a8-99e5-9ac9b94f8ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:41.953911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be5544-af8c-41a8-99e5-9ac9b94f8ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:41.955425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be5544-af8c-41a8-99e5-9ac9b94f8ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:41.955726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be5544-af8c-41a8-99e5-9ac9b94f8ef8 admin admin] PATH_INFO: `/v3/projects/87a6cce633da417bbf489f493312e034/users/2486d2561fbe4c39be2fe9fbda117977/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:41.971122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be5544-af8c-41a8-99e5-9ac9b94f8ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a6cce633da417bbf489f493312e034, user_id=2486d2561fbe4c39be2fe9fbda117977, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:41.974114 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be5544-af8c-41a8-99e5-9ac9b94f8ef8 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:41.989855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 933/1879] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:41 2022] PUT /identity/v3/projects/87a6cce633da417bbf489f493312e034/users/2486d2561fbe4c39be2fe9fbda117977/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:52:42.001579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e5e50-3857-4292-a815-5edc25c4f49a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:42.002062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e5e50-3857-4292-a815-5edc25c4f49a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:42.002440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e5e50-3857-4292-a815-5edc25c4f49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:42.032733 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0a1e5e50-3857-4292-a815-5edc25c4f49a None None] MFA Rules not processed for user `2486d2561fbe4c39be2fe9fbda117977`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:42.033928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0a1e5e50-3857-4292-a815-5edc25c4f49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:42.109272 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 947/1880] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:52:42.121243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be5544-af8c-41a8-99e5-9ac9b94f8ef8 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:42.123924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d7be5544-af8c-41a8-99e5-9ac9b94f8ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:42.157225 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:42.192645 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be5544-af8c-41a8-99e5-9ac9b94f8ef8 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:42.196277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1045646-7d53-4981-88cc-c0ecefa400eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:42.196892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1045646-7d53-4981-88cc-c0ecefa400eb service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:42.197209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1045646-7d53-4981-88cc-c0ecefa400eb service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:42.197490 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1045646-7d53-4981-88cc-c0ecefa400eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:42.206954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1045646-7d53-4981-88cc-c0ecefa400eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:42.208709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1045646-7d53-4981-88cc-c0ecefa400eb service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:42.218468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 934/1881] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:44.770638 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb69aaa-b09a-4934-84d0-49571d3d20c3 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:44.771597 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb69aaa-b09a-4934-84d0-49571d3d20c3 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:44.772002 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb69aaa-b09a-4934-84d0-49571d3d20c3 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:44.773784 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 948/1882] 10.222.0.76 () {54 vars in 921 bytes} [Fri Aug 26 08:52:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:52:44.789089 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35479793-6194-4881-8cd4-18ca75c5d780 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:44.790388 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35479793-6194-4881-8cd4-18ca75c5d780 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:44.790810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35479793-6194-4881-8cd4-18ca75c5d780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:44.834922 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-35479793-6194-4881-8cd4-18ca75c5d780 None None] MFA Rules not processed for user `b63d6e588f6e4b598b75a2ec13bea25d`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:44.839159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-35479793-6194-4881-8cd4-18ca75c5d780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:44.855213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb69aaa-b09a-4934-84d0-49571d3d20c3 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:44.947176 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:44.954095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 935/1883] 10.222.0.76 () {58 vars in 1018 bytes} [Fri Aug 26 08:52:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:44.968917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb69aaa-b09a-4934-84d0-49571d3d20c3 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:44.970178 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35479793-6194-4881-8cd4-18ca75c5d780 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:44.971631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-35479793-6194-4881-8cd4-18ca75c5d780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:44.975099 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1636bd-5be4-41cb-816a-a9549fb14248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:44.975875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1636bd-5be4-41cb-816a-a9549fb14248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:44.976147 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1636bd-5be4-41cb-816a-a9549fb14248 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:44.976423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1636bd-5be4-41cb-816a-a9549fb14248 admin admin] PATH_INFO: `/v3/users/2486d2561fbe4c39be2fe9fbda117977` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:44.977598 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1636bd-5be4-41cb-816a-a9549fb14248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2486d2561fbe4c39be2fe9fbda117977)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:44.979602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1636bd-5be4-41cb-816a-a9549fb14248 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:44.985690 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35479793-6194-4881-8cd4-18ca75c5d780 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:44.993284 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97db2f0-6c9b-41ce-8172-82cc8eaa79d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:44.993980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97db2f0-6c9b-41ce-8172-82cc8eaa79d9 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:44.994268 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97db2f0-6c9b-41ce-8172-82cc8eaa79d9 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:44.994710 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97db2f0-6c9b-41ce-8172-82cc8eaa79d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:45.004258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97db2f0-6c9b-41ce-8172-82cc8eaa79d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:45.006031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97db2f0-6c9b-41ce-8172-82cc8eaa79d9 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:45.018674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 936/1884] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:45.037185 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-3a1636bd-5be4-41cb-816a-a9549fb14248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2486d2561fbe4c39be2fe9fbda117977'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:45.046972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-3a1636bd-5be4-41cb-816a-a9549fb14248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2486d2561fbe4c39be2fe9fbda117977'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:45.047735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-3a1636bd-5be4-41cb-816a-a9549fb14248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2486d2561fbe4c39be2fe9fbda117977'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:45.056092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-3a1636bd-5be4-41cb-816a-a9549fb14248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2486d2561fbe4c39be2fe9fbda117977'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:45.071889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-3a1636bd-5be4-41cb-816a-a9549fb14248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2486d2561fbe4c39be2fe9fbda117977'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:45.078349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 949/1885] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:44 2022] DELETE /identity/v3/users/2486d2561fbe4c39be2fe9fbda117977 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:52:45.083591 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5dde4-bb6f-46b7-a2cb-3f6be66227a8 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:45.083880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5dde4-bb6f-46b7-a2cb-3f6be66227a8 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:45.084158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5dde4-bb6f-46b7-a2cb-3f6be66227a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:45.104134 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-87f5dde4-bb6f-46b7-a2cb-3f6be66227a8 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:45.105391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-87f5dde4-bb6f-46b7-a2cb-3f6be66227a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:45.167507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 937/1886] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:45.177824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1636bd-5be4-41cb-816a-a9549fb14248 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:45.179243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-3a1636bd-5be4-41cb-816a-a9549fb14248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:45.239311 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1636bd-5be4-41cb-816a-a9549fb14248 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:45.243209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20a25b-35f8-4d1e-b919-a70df212b0af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:45.243823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20a25b-35f8-4d1e-b919-a70df212b0af service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:45.244107 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20a25b-35f8-4d1e-b919-a70df212b0af service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:45.244387 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20a25b-35f8-4d1e-b919-a70df212b0af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:45.253881 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20a25b-35f8-4d1e-b919-a70df212b0af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:45.255305 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20a25b-35f8-4d1e-b919-a70df212b0af service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:45.267002 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 950/1887] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:45.608599 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5dde4-bb6f-46b7-a2cb-3f6be66227a8 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:45.610465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-87f5dde4-bb6f-46b7-a2cb-3f6be66227a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:45.633776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5dde4-bb6f-46b7-a2cb-3f6be66227a8 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:45.639658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a2202-be00-4368-92a0-bb2c19ad01f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:45.640468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a2202-be00-4368-92a0-bb2c19ad01f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:45.640754 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a2202-be00-4368-92a0-bb2c19ad01f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:45.641203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a2202-be00-4368-92a0-bb2c19ad01f5 admin admin] PATH_INFO: `/v3/projects/87a6cce633da417bbf489f493312e034` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:45.643403 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a2202-be00-4368-92a0-bb2c19ad01f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a6cce633da417bbf489f493312e034)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:45.644538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a2202-be00-4368-92a0-bb2c19ad01f5 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:45.702317 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:45.715576 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ef2a2202-be00-4368-92a0-bb2c19ad01f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a6cce633da417bbf489f493312e034', 'request_id': 'req-ef2a2202-be00-4368-92a0-bb2c19ad01f5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:45.734725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ef2a2202-be00-4368-92a0-bb2c19ad01f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a6cce633da417bbf489f493312e034', 'request_id': 'req-ef2a2202-be00-4368-92a0-bb2c19ad01f5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:45.745282 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ef2a2202-be00-4368-92a0-bb2c19ad01f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a6cce633da417bbf489f493312e034', 'request_id': 'req-ef2a2202-be00-4368-92a0-bb2c19ad01f5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:45.759481 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ef2a2202-be00-4368-92a0-bb2c19ad01f5 admin admin] The token cache is being invalidate because project 87a6cce633da417bbf489f493312e034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:45.759855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ef2a2202-be00-4368-92a0-bb2c19ad01f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:45.761225 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ef2a2202-be00-4368-92a0-bb2c19ad01f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:45.763868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 938/1888] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:45 2022] DELETE /identity/v3/projects/87a6cce633da417bbf489f493312e034 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:45.769516 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12e1d8-e9d1-4190-992b-257e9118eccc None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:45.770129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12e1d8-e9d1-4190-992b-257e9118eccc None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:45.770431 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12e1d8-e9d1-4190-992b-257e9118eccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:45.798128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-ba12e1d8-e9d1-4190-992b-257e9118eccc None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:45.800009 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ba12e1d8-e9d1-4190-992b-257e9118eccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:45.878566 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 951/1889] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:45.886704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a2e14-0638-4c19-a84c-8c7c5581f897 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:45.887325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a2e14-0638-4c19-a84c-8c7c5581f897 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:45.887325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a2e14-0638-4c19-a84c-8c7c5581f897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:45.910005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-7c3a2e14-0638-4c19-a84c-8c7c5581f897 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:45.911384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7c3a2e14-0638-4c19-a84c-8c7c5581f897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:45.920015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 939/1890] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:45.925124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12e1d8-e9d1-4190-992b-257e9118eccc None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:45.937085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12e1d8-e9d1-4190-992b-257e9118eccc None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:45.945686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a2e14-0638-4c19-a84c-8c7c5581f897 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:45.946671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4d61a-6d80-4151-b936-035e14ad3e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:45.947464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4d61a-6d80-4151-b936-035e14ad3e23 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:45.947603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7c3a2e14-0638-4c19-a84c-8c7c5581f897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:45.947857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4d61a-6d80-4151-b936-035e14ad3e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:45.948209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4d61a-6d80-4151-b936-035e14ad3e23 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:45.948958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4d61a-6d80-4151-b936-035e14ad3e23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:52:45.949421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4d61a-6d80-4151-b936-035e14ad3e23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:45.951148 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4d61a-6d80-4151-b936-035e14ad3e23 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:45.960005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:45.964230 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a2e14-0638-4c19-a84c-8c7c5581f897 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:45.967522 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 952/1891] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:52:45.972449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4d61a-6d80-4151-b936-035e14ad3e23 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:45.978766 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dce997-46ce-48af-96a9-98d24cc3c395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:45.979713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dce997-46ce-48af-96a9-98d24cc3c395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:45.980056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dce997-46ce-48af-96a9-98d24cc3c395 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:45.980340 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dce997-46ce-48af-96a9-98d24cc3c395 admin admin] PATH_INFO: `/v3/users/9b72b301523141e89664b481272be8ac` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:45.982155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dce997-46ce-48af-96a9-98d24cc3c395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b72b301523141e89664b481272be8ac)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:45.984582 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dce997-46ce-48af-96a9-98d24cc3c395 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:45.985373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4d61a-6d80-4151-b936-035e14ad3e23 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:45.991101 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e75c05-bf24-44c6-8458-207232a71dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:45.991684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e75c05-bf24-44c6-8458-207232a71dcc admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:45.992170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e75c05-bf24-44c6-8458-207232a71dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:45.992404 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e75c05-bf24-44c6-8458-207232a71dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:45.993182 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e75c05-bf24-44c6-8458-207232a71dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:45.995307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e75c05-bf24-44c6-8458-207232a71dcc admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:46.027702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 953/1892] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:45 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:46.031691 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e75c05-bf24-44c6-8458-207232a71dcc admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:46.050572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-66dce997-46ce-48af-96a9-98d24cc3c395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b72b301523141e89664b481272be8ac'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:46.060985 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-66dce997-46ce-48af-96a9-98d24cc3c395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b72b301523141e89664b481272be8ac'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:46.061969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-66dce997-46ce-48af-96a9-98d24cc3c395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b72b301523141e89664b481272be8ac'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:46.062629 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-66dce997-46ce-48af-96a9-98d24cc3c395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b72b301523141e89664b481272be8ac'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:46.071065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-66dce997-46ce-48af-96a9-98d24cc3c395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b72b301523141e89664b481272be8ac'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:46.091253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 940/1893] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:45 2022] DELETE /identity/v3/users/9b72b301523141e89664b481272be8ac => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:46.096321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe51a05-c2c6-4803-889c-917ed73be5c1 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:46.099748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe51a05-c2c6-4803-889c-917ed73be5c1 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:46.099748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe51a05-c2c6-4803-889c-917ed73be5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:46.117637 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-afe51a05-c2c6-4803-889c-917ed73be5c1 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:46.119045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-afe51a05-c2c6-4803-889c-917ed73be5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:46.126482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e75c05-bf24-44c6-8458-207232a71dcc admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:46.200046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 941/1894] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:46.200630 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038b164-340e-447a-b89b-10313245faac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:46.201400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038b164-340e-447a-b89b-10313245faac admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:46.201749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038b164-340e-447a-b89b-10313245faac admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:46.202094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038b164-340e-447a-b89b-10313245faac admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:46.202790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038b164-340e-447a-b89b-10313245faac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:46.209090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038b164-340e-447a-b89b-10313245faac admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:46.211312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe51a05-c2c6-4803-889c-917ed73be5c1 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:46.213464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-afe51a05-c2c6-4803-889c-917ed73be5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:46.247248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 954/1895] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:46 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:52:46.251126 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038b164-340e-447a-b89b-10313245faac admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:46.252930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e038b164-340e-447a-b89b-10313245faac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:46.260357 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:46.271218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038b164-340e-447a-b89b-10313245faac admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:46.276315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cecd2-cd29-4499-a8b4-835d58a5f8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:46.276939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cecd2-cd29-4499-a8b4-835d58a5f8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:46.277254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cecd2-cd29-4499-a8b4-835d58a5f8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:46.277527 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cecd2-cd29-4499-a8b4-835d58a5f8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:46.278176 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cecd2-cd29-4499-a8b4-835d58a5f8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:46.279766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cecd2-cd29-4499-a8b4-835d58a5f8a7 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:46.285133 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe51a05-c2c6-4803-889c-917ed73be5c1 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:46.288969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b7604-ecbe-413e-bcf9-b0e4b5dbae29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:46.289633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b7604-ecbe-413e-bcf9-b0e4b5dbae29 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:46.289916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b7604-ecbe-413e-bcf9-b0e4b5dbae29 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:46.290192 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b7604-ecbe-413e-bcf9-b0e4b5dbae29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:46.290723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 955/1896] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:52:46.294670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cecd2-cd29-4499-a8b4-835d58a5f8a7 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:46.299810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b7604-ecbe-413e-bcf9-b0e4b5dbae29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:46.301267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b7604-ecbe-413e-bcf9-b0e4b5dbae29 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:46.304809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cecd2-cd29-4499-a8b4-835d58a5f8a7 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:46.312560 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44a5a7-6603-4441-80c5-4a24fc49fc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:46.313485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44a5a7-6603-4441-80c5-4a24fc49fc64 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:46.316437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44a5a7-6603-4441-80c5-4a24fc49fc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:46.316929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44a5a7-6603-4441-80c5-4a24fc49fc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:46.318956 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44a5a7-6603-4441-80c5-4a24fc49fc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:46.319696 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 942/1897] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:52:46.320826 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44a5a7-6603-4441-80c5-4a24fc49fc64 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:46.336080 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 956/1898] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:52:46.337493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b7604-ecbe-413e-bcf9-b0e4b5dbae29 service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:46.348029 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b7604-ecbe-413e-bcf9-b0e4b5dbae29 service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:46.353406 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624eac2-6d50-4099-8445-11349dcbe163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:46.354158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624eac2-6d50-4099-8445-11349dcbe163 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:46.354443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624eac2-6d50-4099-8445-11349dcbe163 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:46.354895 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624eac2-6d50-4099-8445-11349dcbe163 admin admin] PATH_INFO: `/v3/projects/675f043ad5aa4c60a8d6831975eea4df/users/227b557cd48c4fe8810e9b4c25ea202a/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:46.375209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624eac2-6d50-4099-8445-11349dcbe163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=675f043ad5aa4c60a8d6831975eea4df, user_id=227b557cd48c4fe8810e9b4c25ea202a, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:46.378707 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624eac2-6d50-4099-8445-11349dcbe163 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:46.391500 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 943/1899] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:46 2022] PUT /identity/v3/projects/675f043ad5aa4c60a8d6831975eea4df/users/227b557cd48c4fe8810e9b4c25ea202a/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:46.397202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aecd4-4798-49be-8e5d-bd8b028d51ad None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:46.397570 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aecd4-4798-49be-8e5d-bd8b028d51ad None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:46.397914 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aecd4-4798-49be-8e5d-bd8b028d51ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:46.418097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-cd7aecd4-4798-49be-8e5d-bd8b028d51ad None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:46.419457 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-cd7aecd4-4798-49be-8e5d-bd8b028d51ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:46.512831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:46.533318 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 957/1900] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:52:46.549596 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624eac2-6d50-4099-8445-11349dcbe163 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:46.551479 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-6624eac2-6d50-4099-8445-11349dcbe163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:46.620921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624eac2-6d50-4099-8445-11349dcbe163 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:46.633415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11dcd4-1ebf-4af3-a7f9-16ffe05d8e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:46.634159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11dcd4-1ebf-4af3-a7f9-16ffe05d8e21 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:46.634531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11dcd4-1ebf-4af3-a7f9-16ffe05d8e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:46.634906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11dcd4-1ebf-4af3-a7f9-16ffe05d8e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:46.647202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11dcd4-1ebf-4af3-a7f9-16ffe05d8e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:46.649026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11dcd4-1ebf-4af3-a7f9-16ffe05d8e21 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:46.659696 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7aecd4-4798-49be-8e5d-bd8b028d51ad None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:46.661222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-cd7aecd4-4798-49be-8e5d-bd8b028d51ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:46.662220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 944/1901] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:46.673725 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7aecd4-4798-49be-8e5d-bd8b028d51ad None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:46.678456 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bd816-a24d-4eb5-9a5f-624be9174e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:46.679089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bd816-a24d-4eb5-9a5f-624be9174e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:46.679365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bd816-a24d-4eb5-9a5f-624be9174e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:46.679635 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bd816-a24d-4eb5-9a5f-624be9174e42 admin admin] PATH_INFO: `/v3/projects/efc743fa93bd4970944e2c08e339704c` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:46.681089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bd816-a24d-4eb5-9a5f-624be9174e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc743fa93bd4970944e2c08e339704c)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:46.683091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bd816-a24d-4eb5-9a5f-624be9174e42 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:46.779798 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f19bd816-a24d-4eb5-9a5f-624be9174e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc743fa93bd4970944e2c08e339704c', 'request_id': 'req-f19bd816-a24d-4eb5-9a5f-624be9174e42'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:46.787883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f19bd816-a24d-4eb5-9a5f-624be9174e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc743fa93bd4970944e2c08e339704c', 'request_id': 'req-f19bd816-a24d-4eb5-9a5f-624be9174e42'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:46.797116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f19bd816-a24d-4eb5-9a5f-624be9174e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc743fa93bd4970944e2c08e339704c', 'request_id': 'req-f19bd816-a24d-4eb5-9a5f-624be9174e42'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:46.812787 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f19bd816-a24d-4eb5-9a5f-624be9174e42 admin admin] The token cache is being invalidate because project efc743fa93bd4970944e2c08e339704c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:46.813501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f19bd816-a24d-4eb5-9a5f-624be9174e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:46.814796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f19bd816-a24d-4eb5-9a5f-624be9174e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:46.816568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 958/1902] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:46 2022] DELETE /identity/v3/projects/efc743fa93bd4970944e2c08e339704c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:46.821122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11dcd4-1ebf-4af3-a7f9-16ffe05d8e21 service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:46.831081 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11dcd4-1ebf-4af3-a7f9-16ffe05d8e21 service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:46.927176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48a4b2-9976-40f1-a515-ba8570d8c528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:46.927891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48a4b2-9976-40f1-a515-ba8570d8c528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:46.928446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48a4b2-9976-40f1-a515-ba8570d8c528 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:46.928665 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48a4b2-9976-40f1-a515-ba8570d8c528 admin admin] PATH_INFO: `/v3/users/df2b5432a5d1414d877f414bccc6e3f5` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:46.929891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48a4b2-9976-40f1-a515-ba8570d8c528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2b5432a5d1414d877f414bccc6e3f5)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:46.931845 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48a4b2-9976-40f1-a515-ba8570d8c528 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:46.997923 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8e48a4b2-9976-40f1-a515-ba8570d8c528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2b5432a5d1414d877f414bccc6e3f5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:47.014611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8e48a4b2-9976-40f1-a515-ba8570d8c528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2b5432a5d1414d877f414bccc6e3f5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:47.015623 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8e48a4b2-9976-40f1-a515-ba8570d8c528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2b5432a5d1414d877f414bccc6e3f5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:47.017384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8e48a4b2-9976-40f1-a515-ba8570d8c528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2b5432a5d1414d877f414bccc6e3f5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:47.020395 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:47.042224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8e48a4b2-9976-40f1-a515-ba8570d8c528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2b5432a5d1414d877f414bccc6e3f5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:47.082784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 945/1903] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:46 2022] DELETE /identity/v3/users/df2b5432a5d1414d877f414bccc6e3f5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:52:47.639607 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bd816-a24d-4eb5-9a5f-624be9174e42 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:47.641134 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f19bd816-a24d-4eb5-9a5f-624be9174e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:47.664554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bd816-a24d-4eb5-9a5f-624be9174e42 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:47.713136 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d732f-56b7-48a4-ad3a-724b5e81e283 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:47.713431 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d732f-56b7-48a4-ad3a-724b5e81e283 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:47.713713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d732f-56b7-48a4-ad3a-724b5e81e283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:47.743002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-de3d732f-56b7-48a4-ad3a-724b5e81e283 None None] MFA Rules not processed for user `227b557cd48c4fe8810e9b4c25ea202a`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:47.744305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-de3d732f-56b7-48a4-ad3a-724b5e81e283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:47.751886 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f6488-ea02-4ed8-a882-38eb765789e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:47.752539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f6488-ea02-4ed8-a882-38eb765789e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:47.752823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f6488-ea02-4ed8-a882-38eb765789e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:47.753138 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f6488-ea02-4ed8-a882-38eb765789e2 admin admin] PATH_INFO: `/v3/projects/0ef3d42411c64acdb2332fa4925baa61` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:47.754296 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f6488-ea02-4ed8-a882-38eb765789e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ef3d42411c64acdb2332fa4925baa61)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:47.756202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f6488-ea02-4ed8-a882-38eb765789e2 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:47.808509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-439f6488-ea02-4ed8-a882-38eb765789e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef3d42411c64acdb2332fa4925baa61', 'request_id': 'req-439f6488-ea02-4ed8-a882-38eb765789e2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:47.817299 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-439f6488-ea02-4ed8-a882-38eb765789e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef3d42411c64acdb2332fa4925baa61', 'request_id': 'req-439f6488-ea02-4ed8-a882-38eb765789e2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:47.822996 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 946/1904] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:52:47.827777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-439f6488-ea02-4ed8-a882-38eb765789e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef3d42411c64acdb2332fa4925baa61', 'request_id': 'req-439f6488-ea02-4ed8-a882-38eb765789e2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:47.835700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d732f-56b7-48a4-ad3a-724b5e81e283 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:47.837302 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-de3d732f-56b7-48a4-ad3a-724b5e81e283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:47.839712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-439f6488-ea02-4ed8-a882-38eb765789e2 admin admin] The token cache is being invalidate because project 0ef3d42411c64acdb2332fa4925baa61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:47.840005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-439f6488-ea02-4ed8-a882-38eb765789e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:47.840632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-439f6488-ea02-4ed8-a882-38eb765789e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:47.846347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 959/1905] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:47 2022] DELETE /identity/v3/projects/0ef3d42411c64acdb2332fa4925baa61 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:47.847824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c497b1-d99f-424c-be4c-1b7dc09835f8 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:47.848259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c497b1-d99f-424c-be4c-1b7dc09835f8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:47.848702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c497b1-d99f-424c-be4c-1b7dc09835f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:47.857218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:47.869895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-66c497b1-d99f-424c-be4c-1b7dc09835f8 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:47.871330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-66c497b1-d99f-424c-be4c-1b7dc09835f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:47.906221 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d732f-56b7-48a4-ad3a-724b5e81e283 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:47.938291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 960/1906] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:47.946648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59dbee-d544-4e08-ae26-956dc6b803bc None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:47.946758 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59dbee-d544-4e08-ae26-956dc6b803bc None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:47.947330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59dbee-d544-4e08-ae26-956dc6b803bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:47.970527 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0c59dbee-d544-4e08-ae26-956dc6b803bc None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:47.971780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0c59dbee-d544-4e08-ae26-956dc6b803bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:47.979196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd6429-c2bb-4892-ad46-a0b7dc20f26b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:47.979820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd6429-c2bb-4892-ad46-a0b7dc20f26b service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:47.980160 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 961/1907] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:52:47.980295 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd6429-c2bb-4892-ad46-a0b7dc20f26b service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:47.980470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd6429-c2bb-4892-ad46-a0b7dc20f26b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:47.982362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-24dd6429-c2bb-4892-ad46-a0b7dc20f26b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:47.984509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59dbee-d544-4e08-ae26-956dc6b803bc None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:47.995215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59dbee-d544-4e08-ae26-956dc6b803bc None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:47.999830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420943f-904d-4467-a57a-5ed8b8dd5c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:48.000433 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420943f-904d-4467-a57a-5ed8b8dd5c67 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:48.000722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420943f-904d-4467-a57a-5ed8b8dd5c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:48.001027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420943f-904d-4467-a57a-5ed8b8dd5c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:48.002201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420943f-904d-4467-a57a-5ed8b8dd5c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:52:48.002511 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420943f-904d-4467-a57a-5ed8b8dd5c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:48.004090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420943f-904d-4467-a57a-5ed8b8dd5c67 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:48.016731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 962/1908] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:52:48.019628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:48.022889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420943f-904d-4467-a57a-5ed8b8dd5c67 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:48.034024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420943f-904d-4467-a57a-5ed8b8dd5c67 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:48.042953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9d522-771e-4aad-98ee-9b87b3103673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:48.043604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9d522-771e-4aad-98ee-9b87b3103673 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:48.043894 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9d522-771e-4aad-98ee-9b87b3103673 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:48.044174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9d522-771e-4aad-98ee-9b87b3103673 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:48.044842 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9d522-771e-4aad-98ee-9b87b3103673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:48.046833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9d522-771e-4aad-98ee-9b87b3103673 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:48.048419 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd6429-c2bb-4892-ad46-a0b7dc20f26b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:48.049896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd6429-c2bb-4892-ad46-a0b7dc20f26b service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:48.059054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 947/1909] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:52:48.097749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 963/1910] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:48 2022] POST /identity/v3/projects => generated 393 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:48.101514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd6429-c2bb-4892-ad46-a0b7dc20f26b service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:48.114098 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd6429-c2bb-4892-ad46-a0b7dc20f26b service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:48.188258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea12527-2c9f-4335-a143-cd3763e51069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:48.189528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea12527-2c9f-4335-a143-cd3763e51069 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:48.190040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea12527-2c9f-4335-a143-cd3763e51069 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:48.190391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea12527-2c9f-4335-a143-cd3763e51069 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:48.191222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea12527-2c9f-4335-a143-cd3763e51069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:48.193183 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea12527-2c9f-4335-a143-cd3763e51069 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:48.225214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 948/1911] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:48 2022] POST /identity/v3/users => generated 297 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:48.227200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9d522-771e-4aad-98ee-9b87b3103673 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:48.240778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9d522-771e-4aad-98ee-9b87b3103673 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:48.246248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7713c-1e29-40d8-b8de-44ecc81587bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:48.247203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7713c-1e29-40d8-b8de-44ecc81587bf admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:48.247930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7713c-1e29-40d8-b8de-44ecc81587bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:48.247930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7713c-1e29-40d8-b8de-44ecc81587bf admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:48.248600 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7713c-1e29-40d8-b8de-44ecc81587bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:48.250317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7713c-1e29-40d8-b8de-44ecc81587bf admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:48.262404 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 964/1912] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:52:48.266663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea12527-2c9f-4335-a143-cd3763e51069 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:48.278628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea12527-2c9f-4335-a143-cd3763e51069 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:48.285688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717de8b-4aea-4195-8c9a-4857a541d534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:48.286533 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717de8b-4aea-4195-8c9a-4857a541d534 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:48.286960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717de8b-4aea-4195-8c9a-4857a541d534 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:48.287348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717de8b-4aea-4195-8c9a-4857a541d534 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:48.288125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717de8b-4aea-4195-8c9a-4857a541d534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:48.290061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717de8b-4aea-4195-8c9a-4857a541d534 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:48.305047 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 949/1913] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:48.308754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7713c-1e29-40d8-b8de-44ecc81587bf admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:48.333144 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7713c-1e29-40d8-b8de-44ecc81587bf admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:48.346071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c244f0f-01ac-47ff-8730-1ba153a45251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:48.347100 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c244f0f-01ac-47ff-8730-1ba153a45251 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:48.347557 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c244f0f-01ac-47ff-8730-1ba153a45251 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:48.347989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c244f0f-01ac-47ff-8730-1ba153a45251 admin admin] PATH_INFO: `/v3/projects/6d5469cbfc8644d4bec3ef343a57f9fb/users/a77900d6985d4ab587cc2466413ff0b6/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:48.364335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c244f0f-01ac-47ff-8730-1ba153a45251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5469cbfc8644d4bec3ef343a57f9fb, user_id=a77900d6985d4ab587cc2466413ff0b6, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:48.367157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c244f0f-01ac-47ff-8730-1ba153a45251 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:48.381524 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 965/1914] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:48 2022] PUT /identity/v3/projects/6d5469cbfc8644d4bec3ef343a57f9fb/users/a77900d6985d4ab587cc2466413ff0b6/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:48.393764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9e516-e552-4aab-bfbe-9ef7a18a4ea2 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:48.394354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9e516-e552-4aab-bfbe-9ef7a18a4ea2 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:48.394894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9e516-e552-4aab-bfbe-9ef7a18a4ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:48.434847 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-5de9e516-e552-4aab-bfbe-9ef7a18a4ea2 None None] MFA Rules not processed for user `a77900d6985d4ab587cc2466413ff0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:48.434847 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5de9e516-e552-4aab-bfbe-9ef7a18a4ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:48.537577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 950/1915] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:48.542666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c244f0f-01ac-47ff-8730-1ba153a45251 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:48.640650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c244f0f-01ac-47ff-8730-1ba153a45251 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:48.646589 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872e10e-4ef3-4af3-ac3e-26d0a8b64e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:48.647344 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872e10e-4ef3-4af3-ac3e-26d0a8b64e09 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:48.647700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872e10e-4ef3-4af3-ac3e-26d0a8b64e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:48.648044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872e10e-4ef3-4af3-ac3e-26d0a8b64e09 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:48.648764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872e10e-4ef3-4af3-ac3e-26d0a8b64e09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:48.651997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872e10e-4ef3-4af3-ac3e-26d0a8b64e09 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:48.685183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 966/1916] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:48 2022] POST /identity/v3/projects => generated 393 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:48.689588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9e516-e552-4aab-bfbe-9ef7a18a4ea2 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:48.704063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9e516-e552-4aab-bfbe-9ef7a18a4ea2 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:48.796747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:48.818489 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba18f3-1229-43d8-918a-2a1fe1dda6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:48.819533 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba18f3-1229-43d8-918a-2a1fe1dda6ec admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:48.819695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba18f3-1229-43d8-918a-2a1fe1dda6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:48.820076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba18f3-1229-43d8-918a-2a1fe1dda6ec admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:48.820819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba18f3-1229-43d8-918a-2a1fe1dda6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:48.822986 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba18f3-1229-43d8-918a-2a1fe1dda6ec admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:48.861791 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 951/1917] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:48 2022] POST /identity/v3/users => generated 303 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:48.865716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872e10e-4ef3-4af3-ac3e-26d0a8b64e09 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:48.885784 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872e10e-4ef3-4af3-ac3e-26d0a8b64e09 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:48.890869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cfd1b-1cc2-464f-ad40-c345312c3f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:48.891502 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cfd1b-1cc2-464f-ad40-c345312c3f2c admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:48.891789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cfd1b-1cc2-464f-ad40-c345312c3f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:48.892629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cfd1b-1cc2-464f-ad40-c345312c3f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:48.893329 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cfd1b-1cc2-464f-ad40-c345312c3f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:48.894939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cfd1b-1cc2-464f-ad40-c345312c3f2c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:48.906017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 967/1918] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:48.910379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba18f3-1229-43d8-918a-2a1fe1dda6ec admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:48.920391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba18f3-1229-43d8-918a-2a1fe1dda6ec admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:48.926425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781519a-f370-42e0-bf2f-1aaf3279cece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:48.927185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781519a-f370-42e0-bf2f-1aaf3279cece admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:48.928210 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781519a-f370-42e0-bf2f-1aaf3279cece admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:48.928210 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781519a-f370-42e0-bf2f-1aaf3279cece admin admin] PATH_INFO: `/v3/projects/59e6cbd736454642b4aeef8e5dd725e5/users/e9b389c7a35e40928995367f49f2f8e5/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:48.943757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781519a-f370-42e0-bf2f-1aaf3279cece admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e6cbd736454642b4aeef8e5dd725e5, user_id=e9b389c7a35e40928995367f49f2f8e5, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:48.946457 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781519a-f370-42e0-bf2f-1aaf3279cece admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:48.960331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 952/1919] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:48 2022] PUT /identity/v3/projects/59e6cbd736454642b4aeef8e5dd725e5/users/e9b389c7a35e40928995367f49f2f8e5/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:48.964110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cfd1b-1cc2-464f-ad40-c345312c3f2c admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:48.969528 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:48.975968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cfd1b-1cc2-464f-ad40-c345312c3f2c admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:49.038259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2c43e-e087-484d-9d79-2f65e91a7043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:49.038945 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2c43e-e087-484d-9d79-2f65e91a7043 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:49.039232 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2c43e-e087-484d-9d79-2f65e91a7043 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:49.039613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2c43e-e087-484d-9d79-2f65e91a7043 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:49.040428 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2c43e-e087-484d-9d79-2f65e91a7043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:49.042154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2c43e-e087-484d-9d79-2f65e91a7043 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:49.056519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 968/1920] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:49.057777 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781519a-f370-42e0-bf2f-1aaf3279cece admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:49.072184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781519a-f370-42e0-bf2f-1aaf3279cece admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:49.079134 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f795e2c-3682-471c-a630-d2154fd320be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:49.079851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f795e2c-3682-471c-a630-d2154fd320be admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:49.080196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f795e2c-3682-471c-a630-d2154fd320be admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:49.080429 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f795e2c-3682-471c-a630-d2154fd320be admin admin] PATH_INFO: `/v3/projects/59e6cbd736454642b4aeef8e5dd725e5/users/e9b389c7a35e40928995367f49f2f8e5/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:49.083094 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f795e2c-3682-471c-a630-d2154fd320be admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e6cbd736454642b4aeef8e5dd725e5, user_id=e9b389c7a35e40928995367f49f2f8e5, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:49.087413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f795e2c-3682-471c-a630-d2154fd320be admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:49.106336 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 953/1921] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:49 2022] PUT /identity/v3/projects/59e6cbd736454642b4aeef8e5dd725e5/users/e9b389c7a35e40928995367f49f2f8e5/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:49.118038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3462e-e13f-4ab2-833d-2f5fd26cda4e None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:49.118388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3462e-e13f-4ab2-833d-2f5fd26cda4e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:49.118708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3462e-e13f-4ab2-833d-2f5fd26cda4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:49.148891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-82c3462e-e13f-4ab2-833d-2f5fd26cda4e None None] MFA Rules not processed for user `e9b389c7a35e40928995367f49f2f8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:49.150810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-82c3462e-e13f-4ab2-833d-2f5fd26cda4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:49.220448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 969/1922] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:49.231392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f795e2c-3682-471c-a630-d2154fd320be admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:49.233277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-6f795e2c-3682-471c-a630-d2154fd320be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:49.293949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f795e2c-3682-471c-a630-d2154fd320be admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:49.297552 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642cdee-77d0-405a-acc7-166c64e413d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:49.298748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642cdee-77d0-405a-acc7-166c64e413d6 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:49.299073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642cdee-77d0-405a-acc7-166c64e413d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:49.299383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642cdee-77d0-405a-acc7-166c64e413d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:49.309597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642cdee-77d0-405a-acc7-166c64e413d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:49.311049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642cdee-77d0-405a-acc7-166c64e413d6 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:49.321616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 954/1923] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:49 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:52:49.381729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3462e-e13f-4ab2-833d-2f5fd26cda4e None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:49.383206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-82c3462e-e13f-4ab2-833d-2f5fd26cda4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:49.396026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3462e-e13f-4ab2-833d-2f5fd26cda4e None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:49.399984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19831c47-63d7-4097-a27d-6934832e305f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:49.400712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19831c47-63d7-4097-a27d-6934832e305f service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:49.401147 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19831c47-63d7-4097-a27d-6934832e305f service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:49.401437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19831c47-63d7-4097-a27d-6934832e305f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:49.472411 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19831c47-63d7-4097-a27d-6934832e305f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:49.474899 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19831c47-63d7-4097-a27d-6934832e305f service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:49.489215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 970/1924] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:49.536165 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e414e-2f6d-4b88-ad38-5334fb9a647c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:49.536454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e414e-2f6d-4b88-ad38-5334fb9a647c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:49.536735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e414e-2f6d-4b88-ad38-5334fb9a647c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:49.555920 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-1f6e414e-2f6d-4b88-ad38-5334fb9a647c None None] MFA Rules not processed for user `227b557cd48c4fe8810e9b4c25ea202a`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:49.557391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1f6e414e-2f6d-4b88-ad38-5334fb9a647c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:49.630829 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 955/1925] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:50.269071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19831c47-63d7-4097-a27d-6934832e305f service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:50.270895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-19831c47-63d7-4097-a27d-6934832e305f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:50.302950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:50.352754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19831c47-63d7-4097-a27d-6934832e305f service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:50.359993 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80374256-e137-45a4-892e-289b1ca30c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:50.360697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80374256-e137-45a4-892e-289b1ca30c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:50.361524 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80374256-e137-45a4-892e-289b1ca30c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:50.361806 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80374256-e137-45a4-892e-289b1ca30c9f admin admin] PATH_INFO: `/v3/users/60875191b8c54d6d827eb36210810154` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:50.363254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80374256-e137-45a4-892e-289b1ca30c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=60875191b8c54d6d827eb36210810154)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:50.365372 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80374256-e137-45a4-892e-289b1ca30c9f admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:50.425610 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-80374256-e137-45a4-892e-289b1ca30c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60875191b8c54d6d827eb36210810154'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:50.434409 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-80374256-e137-45a4-892e-289b1ca30c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60875191b8c54d6d827eb36210810154'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:50.435041 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-80374256-e137-45a4-892e-289b1ca30c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60875191b8c54d6d827eb36210810154'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:50.442354 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-80374256-e137-45a4-892e-289b1ca30c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60875191b8c54d6d827eb36210810154'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:50.455871 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-80374256-e137-45a4-892e-289b1ca30c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60875191b8c54d6d827eb36210810154'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:50.462758 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 971/1926] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:50 2022] DELETE /identity/v3/users/60875191b8c54d6d827eb36210810154 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:52:50.467620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fdb43-d2bf-4219-a3a2-166b1ed0fbd1 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:50.468026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fdb43-d2bf-4219-a3a2-166b1ed0fbd1 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:50.468160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fdb43-d2bf-4219-a3a2-166b1ed0fbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:50.490460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ff4fdb43-d2bf-4219-a3a2-166b1ed0fbd1 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:50.491781 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ff4fdb43-d2bf-4219-a3a2-166b1ed0fbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:50.530884 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:50.553907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 956/1927] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:50.566847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80374256-e137-45a4-892e-289b1ca30c9f admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:50.568581 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-80374256-e137-45a4-892e-289b1ca30c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:50.654211 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80374256-e137-45a4-892e-289b1ca30c9f admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:50.659417 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4adb6c-9509-4fa5-893c-90fcef405026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:50.660003 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4adb6c-9509-4fa5-893c-90fcef405026 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:50.660294 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4adb6c-9509-4fa5-893c-90fcef405026 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:50.660575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4adb6c-9509-4fa5-893c-90fcef405026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:50.673825 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4adb6c-9509-4fa5-893c-90fcef405026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:50.676162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4adb6c-9509-4fa5-893c-90fcef405026 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:50.687238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 972/1928] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:52:51.209128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fdb43-d2bf-4219-a3a2-166b1ed0fbd1 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:51.211371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ff4fdb43-d2bf-4219-a3a2-166b1ed0fbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:51.229797 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fdb43-d2bf-4219-a3a2-166b1ed0fbd1 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:51.248706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:51.250009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:51.250883 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:51.251416 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b admin admin] PATH_INFO: `/v3/projects/0a6c8b7602434aff927ccdb2a1f8ce1f` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:51.258333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6c8b7602434aff927ccdb2a1f8ce1f)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:51.260688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:51.350990 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6c8b7602434aff927ccdb2a1f8ce1f', 'request_id': 'req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:51.358451 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6c8b7602434aff927ccdb2a1f8ce1f', 'request_id': 'req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:51.368631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6c8b7602434aff927ccdb2a1f8ce1f', 'request_id': 'req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:51.384182 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b admin admin] The token cache is being invalidate because project 0a6c8b7602434aff927ccdb2a1f8ce1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:51.384700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:51.385781 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:51.391338 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 957/1929] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:51 2022] DELETE /identity/v3/projects/0a6c8b7602434aff927ccdb2a1f8ce1f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:51.393201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4adb6c-9509-4fa5-893c-90fcef405026 service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:51.404432 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4adb6c-9509-4fa5-893c-90fcef405026 service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:51.463178 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:51.487154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e855fa-a881-4079-9110-39fdfe580e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:51.487806 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e855fa-a881-4079-9110-39fdfe580e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:51.488094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e855fa-a881-4079-9110-39fdfe580e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:51.488374 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e855fa-a881-4079-9110-39fdfe580e87 admin admin] PATH_INFO: `/v3/users/0c56bae7ae8047889bc37505fa259e30` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:51.489788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e855fa-a881-4079-9110-39fdfe580e87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c56bae7ae8047889bc37505fa259e30)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:51.491776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e855fa-a881-4079-9110-39fdfe580e87 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:51.566089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-67e855fa-a881-4079-9110-39fdfe580e87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c56bae7ae8047889bc37505fa259e30'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:51.582413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-67e855fa-a881-4079-9110-39fdfe580e87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c56bae7ae8047889bc37505fa259e30'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:51.583146 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-67e855fa-a881-4079-9110-39fdfe580e87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c56bae7ae8047889bc37505fa259e30'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:51.598871 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-67e855fa-a881-4079-9110-39fdfe580e87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c56bae7ae8047889bc37505fa259e30'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:51.613504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-67e855fa-a881-4079-9110-39fdfe580e87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c56bae7ae8047889bc37505fa259e30'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:51.622435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 973/1930] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:51 2022] DELETE /identity/v3/users/0c56bae7ae8047889bc37505fa259e30 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:51.900482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:51.902664 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:51.919865 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d5f50-48dd-4dda-9c5e-47010b9dd19b admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:51.997203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ca778-baba-4ce5-a079-1e8d08660af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:51.997864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ca778-baba-4ce5-a079-1e8d08660af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:51.998152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ca778-baba-4ce5-a079-1e8d08660af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:51.998430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ca778-baba-4ce5-a079-1e8d08660af5 admin admin] PATH_INFO: `/v3/projects/664b56cbc931481daa50b38a2f19f2cb` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:51.999633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ca778-baba-4ce5-a079-1e8d08660af5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=664b56cbc931481daa50b38a2f19f2cb)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:52.002153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ca778-baba-4ce5-a079-1e8d08660af5 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:52.052775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5b7ca778-baba-4ce5-a079-1e8d08660af5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '664b56cbc931481daa50b38a2f19f2cb', 'request_id': 'req-5b7ca778-baba-4ce5-a079-1e8d08660af5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:52.060609 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5b7ca778-baba-4ce5-a079-1e8d08660af5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '664b56cbc931481daa50b38a2f19f2cb', 'request_id': 'req-5b7ca778-baba-4ce5-a079-1e8d08660af5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:52.071427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5b7ca778-baba-4ce5-a079-1e8d08660af5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '664b56cbc931481daa50b38a2f19f2cb', 'request_id': 'req-5b7ca778-baba-4ce5-a079-1e8d08660af5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:52.076956 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:52.086864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5b7ca778-baba-4ce5-a079-1e8d08660af5 admin admin] The token cache is being invalidate because project 664b56cbc931481daa50b38a2f19f2cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:52.087696 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5b7ca778-baba-4ce5-a079-1e8d08660af5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:52.089103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5b7ca778-baba-4ce5-a079-1e8d08660af5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:52.090961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 958/1931] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:51 2022] DELETE /identity/v3/projects/664b56cbc931481daa50b38a2f19f2cb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:52.096734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c84e5e-f635-4e99-a9dc-47ac90fd67a8 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:52.097050 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c84e5e-f635-4e99-a9dc-47ac90fd67a8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:52.097332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c84e5e-f635-4e99-a9dc-47ac90fd67a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:52.117882 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-47c84e5e-f635-4e99-a9dc-47ac90fd67a8 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:52.119099 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-47c84e5e-f635-4e99-a9dc-47ac90fd67a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:52.188130 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 974/1932] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:52.197930 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a32fc-01c1-42d5-bd58-b9e08c205b12 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:52.197930 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a32fc-01c1-42d5-bd58-b9e08c205b12 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:52.198185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a32fc-01c1-42d5-bd58-b9e08c205b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:52.218622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-045a32fc-01c1-42d5-bd58-b9e08c205b12 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:52.219872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-045a32fc-01c1-42d5-bd58-b9e08c205b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:52.227938 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 959/1933] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:52:52.232511 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c84e5e-f635-4e99-a9dc-47ac90fd67a8 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:52.243667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c84e5e-f635-4e99-a9dc-47ac90fd67a8 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:52.248402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83458690-c418-49a6-8365-85de5b7ed0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:52.249037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83458690-c418-49a6-8365-85de5b7ed0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:52.249325 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83458690-c418-49a6-8365-85de5b7ed0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:52.249603 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83458690-c418-49a6-8365-85de5b7ed0b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:52.250258 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83458690-c418-49a6-8365-85de5b7ed0b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:52:52.250589 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83458690-c418-49a6-8365-85de5b7ed0b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:52.252750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83458690-c418-49a6-8365-85de5b7ed0b2 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:52.264839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 975/1934] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:52:52.269522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a32fc-01c1-42d5-bd58-b9e08c205b12 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:52.279958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a32fc-01c1-42d5-bd58-b9e08c205b12 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:52.285298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16ef75-382f-44c9-9b74-ac193ee566a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:52.286055 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16ef75-382f-44c9-9b74-ac193ee566a5 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:52.286441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16ef75-382f-44c9-9b74-ac193ee566a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:52.286818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16ef75-382f-44c9-9b74-ac193ee566a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:52.287568 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16ef75-382f-44c9-9b74-ac193ee566a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:52.289634 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16ef75-382f-44c9-9b74-ac193ee566a5 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:52.330467 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 960/1935] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:52 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:52:52.331805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83458690-c418-49a6-8365-85de5b7ed0b2 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:52.342031 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83458690-c418-49a6-8365-85de5b7ed0b2 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:52.388826 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:52.401427 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d5862-8c99-4f0c-bf48-ae3489b0bef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:52.402073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d5862-8c99-4f0c-bf48-ae3489b0bef5 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:52.402316 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d5862-8c99-4f0c-bf48-ae3489b0bef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:52.402594 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d5862-8c99-4f0c-bf48-ae3489b0bef5 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:52.403216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d5862-8c99-4f0c-bf48-ae3489b0bef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:52.405228 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d5862-8c99-4f0c-bf48-ae3489b0bef5 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:52.432361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 976/1936] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:52 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:52:52.433608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16ef75-382f-44c9-9b74-ac193ee566a5 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:52.444639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16ef75-382f-44c9-9b74-ac193ee566a5 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:52.450112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb18fd-ae2d-4c28-9b81-d931450214fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:52.459637 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb18fd-ae2d-4c28-9b81-d931450214fe admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:52.459994 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb18fd-ae2d-4c28-9b81-d931450214fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:52.460276 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb18fd-ae2d-4c28-9b81-d931450214fe admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:52.460979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb18fd-ae2d-4c28-9b81-d931450214fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:52.463050 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb18fd-ae2d-4c28-9b81-d931450214fe admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:52.493895 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 961/1937] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:52:52.495752 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d5862-8c99-4f0c-bf48-ae3489b0bef5 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:52.517437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d5862-8c99-4f0c-bf48-ae3489b0bef5 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:52.530622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b73ebe-c60f-4099-9215-6041c99c13e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:52.535058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b73ebe-c60f-4099-9215-6041c99c13e3 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:52.535421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b73ebe-c60f-4099-9215-6041c99c13e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:52.536224 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b73ebe-c60f-4099-9215-6041c99c13e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:52.536443 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b73ebe-c60f-4099-9215-6041c99c13e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:52.538458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b73ebe-c60f-4099-9215-6041c99c13e3 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:52.575601 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb18fd-ae2d-4c28-9b81-d931450214fe admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:52.575854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 977/1938] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:52.590476 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb18fd-ae2d-4c28-9b81-d931450214fe admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:52.601710 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1dff9-678e-4382-b86d-607f5f1eae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:52.602484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1dff9-678e-4382-b86d-607f5f1eae5f admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:52.602773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1dff9-678e-4382-b86d-607f5f1eae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:52.603053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1dff9-678e-4382-b86d-607f5f1eae5f admin admin] PATH_INFO: `/v3/projects/77f1d17f08eb4b699f0bd532685f62d7/users/352320959c2747d58ad7ca00047c1a5f/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:52.633500 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1dff9-678e-4382-b86d-607f5f1eae5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f1d17f08eb4b699f0bd532685f62d7, user_id=352320959c2747d58ad7ca00047c1a5f, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:52.636425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1dff9-678e-4382-b86d-607f5f1eae5f admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:52.655372 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 962/1939] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:52 2022] PUT /identity/v3/projects/77f1d17f08eb4b699f0bd532685f62d7/users/352320959c2747d58ad7ca00047c1a5f/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:52.666273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e95d3f-27d9-438f-8808-6db4d55556bb None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:52.666562 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e95d3f-27d9-438f-8808-6db4d55556bb None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:52.666844 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e95d3f-27d9-438f-8808-6db4d55556bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:52.697764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-f1e95d3f-27d9-438f-8808-6db4d55556bb None None] MFA Rules not processed for user `352320959c2747d58ad7ca00047c1a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:52.698987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f1e95d3f-27d9-438f-8808-6db4d55556bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:52.804364 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 978/1940] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:52.818471 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1dff9-678e-4382-b86d-607f5f1eae5f admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:52.917908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1dff9-678e-4382-b86d-607f5f1eae5f admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:52.939656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9174-48fd-44f3-9791-11059d9fdaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:52.941073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9174-48fd-44f3-9791-11059d9fdaaa admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:52.943076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9174-48fd-44f3-9791-11059d9fdaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:52.943740 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9174-48fd-44f3-9791-11059d9fdaaa admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:52.944839 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c9174-48fd-44f3-9791-11059d9fdaaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:52.948861 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c9174-48fd-44f3-9791-11059d9fdaaa admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:52.997389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 963/1941] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:52 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:52.999718 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e95d3f-27d9-438f-8808-6db4d55556bb None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:53.034353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e95d3f-27d9-438f-8808-6db4d55556bb None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:53.134806 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b38e3f-6132-4d83-a184-e0a63377a7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:53.135622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b38e3f-6132-4d83-a184-e0a63377a7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:53.135914 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b38e3f-6132-4d83-a184-e0a63377a7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:53.136328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b38e3f-6132-4d83-a184-e0a63377a7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:53.137030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b38e3f-6132-4d83-a184-e0a63377a7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:53.139312 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b38e3f-6132-4d83-a184-e0a63377a7b1 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:53.174856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 979/1942] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:52 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:53.175476 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9174-48fd-44f3-9791-11059d9fdaaa admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:53.186772 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9174-48fd-44f3-9791-11059d9fdaaa admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:53.199065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebb1c1-e379-4a42-90be-ef2d135b30d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:53.199716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebb1c1-e379-4a42-90be-ef2d135b30d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:53.199987 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebb1c1-e379-4a42-90be-ef2d135b30d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:53.200264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebb1c1-e379-4a42-90be-ef2d135b30d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:53.200921 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebb1c1-e379-4a42-90be-ef2d135b30d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:53.202563 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebb1c1-e379-4a42-90be-ef2d135b30d0 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:53.230871 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 964/1943] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:52:53.231526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b38e3f-6132-4d83-a184-e0a63377a7b1 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:53.246525 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b38e3f-6132-4d83-a184-e0a63377a7b1 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:53.256844 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361c6d1-9cb0-46a7-b84d-d0343c579cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:53.257509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361c6d1-9cb0-46a7-b84d-d0343c579cca admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:53.257859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361c6d1-9cb0-46a7-b84d-d0343c579cca admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:53.258147 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361c6d1-9cb0-46a7-b84d-d0343c579cca admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:53.258807 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361c6d1-9cb0-46a7-b84d-d0343c579cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:53.260844 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361c6d1-9cb0-46a7-b84d-d0343c579cca admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:53.273005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 980/1944] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:52:53.277277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebb1c1-e379-4a42-90be-ef2d135b30d0 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:53.298853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebb1c1-e379-4a42-90be-ef2d135b30d0 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:53.312930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361c6d1-9cb0-46a7-b84d-d0343c579cca admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:53.314841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6361c6d1-9cb0-46a7-b84d-d0343c579cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:53.321212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6a69e-b732-4617-abc4-7857d9144982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:53.321778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6a69e-b732-4617-abc4-7857d9144982 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:53.322060 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6a69e-b732-4617-abc4-7857d9144982 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:53.322333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6a69e-b732-4617-abc4-7857d9144982 admin admin] PATH_INFO: `/v3/projects/a898aac020dc4545ae0a0bdff1193aa0/users/e321ef25cec7447385179f46905ac684/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:53.335186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361c6d1-9cb0-46a7-b84d-d0343c579cca admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:53.340795 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6a69e-b732-4617-abc4-7857d9144982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a898aac020dc4545ae0a0bdff1193aa0, user_id=e321ef25cec7447385179f46905ac684, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:53.342642 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81784c-b44f-4088-9d95-199689ebd4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:53.343492 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81784c-b44f-4088-9d95-199689ebd4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:53.343675 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81784c-b44f-4088-9d95-199689ebd4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:53.344051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81784c-b44f-4088-9d95-199689ebd4ef admin admin] PATH_INFO: `/v3/users/a77900d6985d4ab587cc2466413ff0b6` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:53.344159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6a69e-b732-4617-abc4-7857d9144982 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:53.345889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81784c-b44f-4088-9d95-199689ebd4ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77900d6985d4ab587cc2466413ff0b6)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:53.348773 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81784c-b44f-4088-9d95-199689ebd4ef admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:53.363677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 965/1945] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:53 2022] PUT /identity/v3/projects/a898aac020dc4545ae0a0bdff1193aa0/users/e321ef25cec7447385179f46905ac684/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:53.373922 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53772a8-195c-4d14-b6a5-5e5fa6748425 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:53.374331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53772a8-195c-4d14-b6a5-5e5fa6748425 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:53.374699 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53772a8-195c-4d14-b6a5-5e5fa6748425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:53.416063 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:53.440610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-b53772a8-195c-4d14-b6a5-5e5fa6748425 None None] MFA Rules not processed for user `e321ef25cec7447385179f46905ac684`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:53.442513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b53772a8-195c-4d14-b6a5-5e5fa6748425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:53.446865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-7f81784c-b44f-4088-9d95-199689ebd4ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77900d6985d4ab587cc2466413ff0b6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:53.463477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-7f81784c-b44f-4088-9d95-199689ebd4ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77900d6985d4ab587cc2466413ff0b6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:53.464374 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-7f81784c-b44f-4088-9d95-199689ebd4ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77900d6985d4ab587cc2466413ff0b6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:53.475984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-7f81784c-b44f-4088-9d95-199689ebd4ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77900d6985d4ab587cc2466413ff0b6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:53.493020 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-7f81784c-b44f-4088-9d95-199689ebd4ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77900d6985d4ab587cc2466413ff0b6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:53.494199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:53.501915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 981/1946] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:53 2022] DELETE /identity/v3/users/a77900d6985d4ab587cc2466413ff0b6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:53.507740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4021d-241c-4892-a016-b5c822e7f052 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:53.508195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4021d-241c-4892-a016-b5c822e7f052 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:53.508765 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4021d-241c-4892-a016-b5c822e7f052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:53.538040 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-95a4021d-241c-4892-a016-b5c822e7f052 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:53.539592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-95a4021d-241c-4892-a016-b5c822e7f052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:53.565633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 966/1947] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:52:53.566566 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53772a8-195c-4d14-b6a5-5e5fa6748425 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:53.572094 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b53772a8-195c-4d14-b6a5-5e5fa6748425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:53.645427 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 982/1948] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:52:53.654374 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4021d-241c-4892-a016-b5c822e7f052 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:53.657278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-95a4021d-241c-4892-a016-b5c822e7f052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:53.698158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53772a8-195c-4d14-b6a5-5e5fa6748425 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:53.702964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a9924-0b73-4bee-8009-0d9b616d5a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:53.703594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a9924-0b73-4bee-8009-0d9b616d5a89 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:53.703882 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a9924-0b73-4bee-8009-0d9b616d5a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:53.704160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a9924-0b73-4bee-8009-0d9b616d5a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:53.705702 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a9924-0b73-4bee-8009-0d9b616d5a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:53.707628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a9924-0b73-4bee-8009-0d9b616d5a89 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:53.738423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4021d-241c-4892-a016-b5c822e7f052 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:53.745200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 967/1949] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:53 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:53.745333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a95b02-693a-4a0c-ad66-50f033333845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:53.745333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a95b02-693a-4a0c-ad66-50f033333845 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:53.745333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a95b02-693a-4a0c-ad66-50f033333845 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:53.745333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a95b02-693a-4a0c-ad66-50f033333845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:53.746341 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a9924-0b73-4bee-8009-0d9b616d5a89 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:53.753589 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a95b02-693a-4a0c-ad66-50f033333845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:53.755018 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a95b02-693a-4a0c-ad66-50f033333845 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:53.766099 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 983/1950] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:52:53.822318 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a9924-0b73-4bee-8009-0d9b616d5a89 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:53.828601 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf8afe-8c1b-4ccf-bda7-33c523407123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:53.830087 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf8afe-8c1b-4ccf-bda7-33c523407123 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:53.830490 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf8afe-8c1b-4ccf-bda7-33c523407123 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:53.831360 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf8afe-8c1b-4ccf-bda7-33c523407123 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:53.832073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf8afe-8c1b-4ccf-bda7-33c523407123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:53.834658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf8afe-8c1b-4ccf-bda7-33c523407123 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:53.859052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 968/1951] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:53 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:52:53.863022 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a95b02-693a-4a0c-ad66-50f033333845 service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:53.873097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a95b02-693a-4a0c-ad66-50f033333845 service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:53.878667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a08d7-6de3-407a-a434-5cb8426ef97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:53.879280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a08d7-6de3-407a-a434-5cb8426ef97d admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:53.879560 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a08d7-6de3-407a-a434-5cb8426ef97d admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:53.879869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a08d7-6de3-407a-a434-5cb8426ef97d admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:53.880511 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a08d7-6de3-407a-a434-5cb8426ef97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:53.882168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a08d7-6de3-407a-a434-5cb8426ef97d admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:53.893385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 984/1952] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:52:53.897436 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf8afe-8c1b-4ccf-bda7-33c523407123 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:53.909071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf8afe-8c1b-4ccf-bda7-33c523407123 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:53.913830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35165157-4a49-4855-b310-378fe7f9a828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:53.914477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35165157-4a49-4855-b310-378fe7f9a828 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:53.914758 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35165157-4a49-4855-b310-378fe7f9a828 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:53.915035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35165157-4a49-4855-b310-378fe7f9a828 admin admin] PATH_INFO: `/v3/projects/67949b51030845d2853fbfb27724fa7d/users/d80f0ab57e434db98251de1154e7eadb/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:53.931932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35165157-4a49-4855-b310-378fe7f9a828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67949b51030845d2853fbfb27724fa7d, user_id=d80f0ab57e434db98251de1154e7eadb, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:53.935176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35165157-4a49-4855-b310-378fe7f9a828 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:53.962681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 969/1953] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:53 2022] PUT /identity/v3/projects/67949b51030845d2853fbfb27724fa7d/users/d80f0ab57e434db98251de1154e7eadb/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:53.966678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a08d7-6de3-407a-a434-5cb8426ef97d admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:53.977038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a08d7-6de3-407a-a434-5cb8426ef97d admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:54.021726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:54.040552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705565a-06ff-4e68-bb4f-058b83cbbda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:54.041139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705565a-06ff-4e68-bb4f-058b83cbbda7 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:54.041424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705565a-06ff-4e68-bb4f-058b83cbbda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:54.041702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705565a-06ff-4e68-bb4f-058b83cbbda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:54.042348 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705565a-06ff-4e68-bb4f-058b83cbbda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:54.044078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705565a-06ff-4e68-bb4f-058b83cbbda7 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:54.054031 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 985/1954] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:52:54.058226 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35165157-4a49-4855-b310-378fe7f9a828 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:54.069405 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35165157-4a49-4855-b310-378fe7f9a828 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:54.073957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6299814-60a9-435a-8d4a-e61592d47ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:54.074637 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6299814-60a9-435a-8d4a-e61592d47ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:54.074916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6299814-60a9-435a-8d4a-e61592d47ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:54.075189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6299814-60a9-435a-8d4a-e61592d47ab8 admin admin] PATH_INFO: `/v3/projects/67949b51030845d2853fbfb27724fa7d/users/d80f0ab57e434db98251de1154e7eadb/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:54.077112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6299814-60a9-435a-8d4a-e61592d47ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67949b51030845d2853fbfb27724fa7d, user_id=d80f0ab57e434db98251de1154e7eadb, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:54.080325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6299814-60a9-435a-8d4a-e61592d47ab8 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:54.090683 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 970/1955] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:54 2022] PUT /identity/v3/projects/67949b51030845d2853fbfb27724fa7d/users/d80f0ab57e434db98251de1154e7eadb/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:54.102266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329d808-fd51-4160-b97c-ba9b96c8dddb None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:54.102564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329d808-fd51-4160-b97c-ba9b96c8dddb None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:54.102843 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329d808-fd51-4160-b97c-ba9b96c8dddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:54.123680 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6299814-60a9-435a-8d4a-e61592d47ab8 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:54.125735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a6299814-60a9-435a-8d4a-e61592d47ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:54.135801 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-5329d808-fd51-4160-b97c-ba9b96c8dddb None None] MFA Rules not processed for user `d80f0ab57e434db98251de1154e7eadb`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:54.137206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-5329d808-fd51-4160-b97c-ba9b96c8dddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:54.138219 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:54.200293 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6299814-60a9-435a-8d4a-e61592d47ab8 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:54.205614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619eaec-d9b5-4136-aa1d-cdd197b6be97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:54.206305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619eaec-d9b5-4136-aa1d-cdd197b6be97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:54.206651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619eaec-d9b5-4136-aa1d-cdd197b6be97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:54.206991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619eaec-d9b5-4136-aa1d-cdd197b6be97 admin admin] PATH_INFO: `/v3/projects/6d5469cbfc8644d4bec3ef343a57f9fb` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:54.208169 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619eaec-d9b5-4136-aa1d-cdd197b6be97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5469cbfc8644d4bec3ef343a57f9fb)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:54.210418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619eaec-d9b5-4136-aa1d-cdd197b6be97 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:54.213614 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 986/1956] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:54.225142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329d808-fd51-4160-b97c-ba9b96c8dddb None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:54.227916 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-5329d808-fd51-4160-b97c-ba9b96c8dddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:54.256976 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8619eaec-d9b5-4136-aa1d-cdd197b6be97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5469cbfc8644d4bec3ef343a57f9fb', 'request_id': 'req-8619eaec-d9b5-4136-aa1d-cdd197b6be97'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:54.263474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8619eaec-d9b5-4136-aa1d-cdd197b6be97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5469cbfc8644d4bec3ef343a57f9fb', 'request_id': 'req-8619eaec-d9b5-4136-aa1d-cdd197b6be97'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:54.271164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8619eaec-d9b5-4136-aa1d-cdd197b6be97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5469cbfc8644d4bec3ef343a57f9fb', 'request_id': 'req-8619eaec-d9b5-4136-aa1d-cdd197b6be97'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:54.281823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8619eaec-d9b5-4136-aa1d-cdd197b6be97 admin admin] The token cache is being invalidate because project 6d5469cbfc8644d4bec3ef343a57f9fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:54.282074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8619eaec-d9b5-4136-aa1d-cdd197b6be97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:54.282732 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8619eaec-d9b5-4136-aa1d-cdd197b6be97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:54.284286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 971/1957] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:54 2022] DELETE /identity/v3/projects/6d5469cbfc8644d4bec3ef343a57f9fb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:54.286942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329d808-fd51-4160-b97c-ba9b96c8dddb None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:54.288217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619eaec-d9b5-4136-aa1d-cdd197b6be97 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:54.289570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-8619eaec-d9b5-4136-aa1d-cdd197b6be97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:54.342906 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cee0eb-5d9b-4020-b243-9ba05ae37132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:54.343638 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cee0eb-5d9b-4020-b243-9ba05ae37132 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:54.343957 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cee0eb-5d9b-4020-b243-9ba05ae37132 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:54.344359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cee0eb-5d9b-4020-b243-9ba05ae37132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:54.346780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-77cee0eb-5d9b-4020-b243-9ba05ae37132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:54.362271 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619eaec-d9b5-4136-aa1d-cdd197b6be97 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:54.368126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c33125-b10b-4852-9daa-98dbf2ff8220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:54.368789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c33125-b10b-4852-9daa-98dbf2ff8220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:54.369102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c33125-b10b-4852-9daa-98dbf2ff8220 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:54.369385 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c33125-b10b-4852-9daa-98dbf2ff8220 admin admin] PATH_INFO: `/v3/users/e9b389c7a35e40928995367f49f2f8e5` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:54.370611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c33125-b10b-4852-9daa-98dbf2ff8220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9b389c7a35e40928995367f49f2f8e5)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:54.373257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c33125-b10b-4852-9daa-98dbf2ff8220 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:54.392791 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:54.425467 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:54.432854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-64c33125-b10b-4852-9daa-98dbf2ff8220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9b389c7a35e40928995367f49f2f8e5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:54.445769 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-64c33125-b10b-4852-9daa-98dbf2ff8220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9b389c7a35e40928995367f49f2f8e5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:54.447124 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-64c33125-b10b-4852-9daa-98dbf2ff8220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9b389c7a35e40928995367f49f2f8e5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:54.448761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-64c33125-b10b-4852-9daa-98dbf2ff8220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9b389c7a35e40928995367f49f2f8e5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:54.448901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cee0eb-5d9b-4020-b243-9ba05ae37132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:54.450459 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cee0eb-5d9b-4020-b243-9ba05ae37132 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:54.460064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-64c33125-b10b-4852-9daa-98dbf2ff8220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9b389c7a35e40928995367f49f2f8e5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:54.462318 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 987/1958] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:52:54.481953 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 972/1959] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:54 2022] DELETE /identity/v3/users/e9b389c7a35e40928995367f49f2f8e5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:52:54.514336 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cee0eb-5d9b-4020-b243-9ba05ae37132 service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:54.519974 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-77cee0eb-5d9b-4020-b243-9ba05ae37132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:54.545400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cee0eb-5d9b-4020-b243-9ba05ae37132 service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:54.614698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12381b-9d8a-4221-a2aa-1a9bd198cb12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:54.615346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12381b-9d8a-4221-a2aa-1a9bd198cb12 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:54.615632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12381b-9d8a-4221-a2aa-1a9bd198cb12 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:54.615907 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12381b-9d8a-4221-a2aa-1a9bd198cb12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:54.617707 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-cd12381b-9d8a-4221-a2aa-1a9bd198cb12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:54.689406 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12381b-9d8a-4221-a2aa-1a9bd198cb12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:54.690840 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12381b-9d8a-4221-a2aa-1a9bd198cb12 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:54.702137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 988/1960] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:55.017340 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c33125-b10b-4852-9daa-98dbf2ff8220 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:55.018786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-64c33125-b10b-4852-9daa-98dbf2ff8220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:55.152602 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c33125-b10b-4852-9daa-98dbf2ff8220 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:55.159331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cebc5d-0b09-43dc-aeb6-f230f6135436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:55.160012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cebc5d-0b09-43dc-aeb6-f230f6135436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:55.160305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cebc5d-0b09-43dc-aeb6-f230f6135436 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:55.160585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cebc5d-0b09-43dc-aeb6-f230f6135436 admin admin] PATH_INFO: `/v3/projects/59e6cbd736454642b4aeef8e5dd725e5` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:55.179693 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cebc5d-0b09-43dc-aeb6-f230f6135436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59e6cbd736454642b4aeef8e5dd725e5)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:55.179693 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cebc5d-0b09-43dc-aeb6-f230f6135436 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:55.255464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c1cebc5d-0b09-43dc-aeb6-f230f6135436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59e6cbd736454642b4aeef8e5dd725e5', 'request_id': 'req-c1cebc5d-0b09-43dc-aeb6-f230f6135436'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:55.262162 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c1cebc5d-0b09-43dc-aeb6-f230f6135436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59e6cbd736454642b4aeef8e5dd725e5', 'request_id': 'req-c1cebc5d-0b09-43dc-aeb6-f230f6135436'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:55.271357 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c1cebc5d-0b09-43dc-aeb6-f230f6135436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59e6cbd736454642b4aeef8e5dd725e5', 'request_id': 'req-c1cebc5d-0b09-43dc-aeb6-f230f6135436'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:55.283626 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c1cebc5d-0b09-43dc-aeb6-f230f6135436 admin admin] The token cache is being invalidate because project 59e6cbd736454642b4aeef8e5dd725e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:55.283906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c1cebc5d-0b09-43dc-aeb6-f230f6135436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:55.284822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c1cebc5d-0b09-43dc-aeb6-f230f6135436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:55.286827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 973/1961] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:55 2022] DELETE /identity/v3/projects/59e6cbd736454642b4aeef8e5dd725e5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:55.291831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f64af7-e463-4065-aa67-6ffd3f993866 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:55.292123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f64af7-e463-4065-aa67-6ffd3f993866 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:55.292401 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f64af7-e463-4065-aa67-6ffd3f993866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:55.312799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-66f64af7-e463-4065-aa67-6ffd3f993866 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:55.314335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-66f64af7-e463-4065-aa67-6ffd3f993866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:55.374333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 989/1962] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:55.382968 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77738a-4728-4857-9506-a4fd8f9b9c12 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:55.383491 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77738a-4728-4857-9506-a4fd8f9b9c12 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:55.383771 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77738a-4728-4857-9506-a4fd8f9b9c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:55.404001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-0f77738a-4728-4857-9506-a4fd8f9b9c12 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:55.405243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0f77738a-4728-4857-9506-a4fd8f9b9c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:55.413474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 974/1963] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:55.417743 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f64af7-e463-4065-aa67-6ffd3f993866 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:55.427588 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f64af7-e463-4065-aa67-6ffd3f993866 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:55.432794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16d4b5-2b98-43fc-964e-553977e91ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:55.433435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16d4b5-2b98-43fc-964e-553977e91ced admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:55.433720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16d4b5-2b98-43fc-964e-553977e91ced admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:55.434004 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16d4b5-2b98-43fc-964e-553977e91ced admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:55.434656 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16d4b5-2b98-43fc-964e-553977e91ced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:52:55.434965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16d4b5-2b98-43fc-964e-553977e91ced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:55.436546 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16d4b5-2b98-43fc-964e-553977e91ced admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:55.449171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 990/1964] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:52:55.452846 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77738a-4728-4857-9506-a4fd8f9b9c12 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:55.462898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77738a-4728-4857-9506-a4fd8f9b9c12 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:55.467842 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecac3d-bcf9-4f13-a21f-af31ae42a654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:55.468384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecac3d-bcf9-4f13-a21f-af31ae42a654 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:55.468668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecac3d-bcf9-4f13-a21f-af31ae42a654 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:55.468964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecac3d-bcf9-4f13-a21f-af31ae42a654 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:55.469647 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecac3d-bcf9-4f13-a21f-af31ae42a654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:55.471535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecac3d-bcf9-4f13-a21f-af31ae42a654 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:55.497748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 975/1965] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:55 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:55.502569 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16d4b5-2b98-43fc-964e-553977e91ced admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:55.512478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16d4b5-2b98-43fc-964e-553977e91ced admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:55.520965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:55.571407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ac727-74fb-4dfd-8c12-7bd2ad87f101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:55.572016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ac727-74fb-4dfd-8c12-7bd2ad87f101 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:55.572307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ac727-74fb-4dfd-8c12-7bd2ad87f101 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:55.572580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ac727-74fb-4dfd-8c12-7bd2ad87f101 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:55.573247 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ac727-74fb-4dfd-8c12-7bd2ad87f101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:55.575173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ac727-74fb-4dfd-8c12-7bd2ad87f101 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:55.602783 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 991/1966] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:55 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:55.606936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecac3d-bcf9-4f13-a21f-af31ae42a654 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:55.617855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecac3d-bcf9-4f13-a21f-af31ae42a654 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:55.623787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74895cc9-0503-4e53-89fd-d2ed0feb9de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:55.624441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74895cc9-0503-4e53-89fd-d2ed0feb9de6 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:55.624660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74895cc9-0503-4e53-89fd-d2ed0feb9de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:55.624937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74895cc9-0503-4e53-89fd-d2ed0feb9de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:55.625841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74895cc9-0503-4e53-89fd-d2ed0feb9de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:55.628183 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74895cc9-0503-4e53-89fd-d2ed0feb9de6 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:55.639291 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 976/1967] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:55.644046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ac727-74fb-4dfd-8c12-7bd2ad87f101 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:55.660466 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ac727-74fb-4dfd-8c12-7bd2ad87f101 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:55.665745 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a177e-c8e5-401c-9409-678a250d7680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:55.666209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a177e-c8e5-401c-9409-678a250d7680 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:55.666504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a177e-c8e5-401c-9409-678a250d7680 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:55.666786 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a177e-c8e5-401c-9409-678a250d7680 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:55.667435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a177e-c8e5-401c-9409-678a250d7680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:55.669078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a177e-c8e5-401c-9409-678a250d7680 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:55.680609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 992/1968] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:55.684414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74895cc9-0503-4e53-89fd-d2ed0feb9de6 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:55.695175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74895cc9-0503-4e53-89fd-d2ed0feb9de6 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:55.699711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e6661-9f93-43db-a06a-d34850c6c721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:55.700355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e6661-9f93-43db-a06a-d34850c6c721 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:55.701124 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e6661-9f93-43db-a06a-d34850c6c721 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:55.701124 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e6661-9f93-43db-a06a-d34850c6c721 admin admin] PATH_INFO: `/v3/projects/d004c76b0edc4b168ad0bc2c53567a62/users/73fb2e7ef61f4390a8d39b3b7cdc79fa/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:55.703911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:55.719672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e6661-9f93-43db-a06a-d34850c6c721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d004c76b0edc4b168ad0bc2c53567a62, user_id=73fb2e7ef61f4390a8d39b3b7cdc79fa, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:55.722293 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e6661-9f93-43db-a06a-d34850c6c721 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:55.739281 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 977/1969] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:55 2022] PUT /identity/v3/projects/d004c76b0edc4b168ad0bc2c53567a62/users/73fb2e7ef61f4390a8d39b3b7cdc79fa/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:55.756371 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce41f19-1027-46c5-94ed-12e95a6b7b3a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:55.756371 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce41f19-1027-46c5-94ed-12e95a6b7b3a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:55.756371 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce41f19-1027-46c5-94ed-12e95a6b7b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:55.786157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-1ce41f19-1027-46c5-94ed-12e95a6b7b3a None None] MFA Rules not processed for user `73fb2e7ef61f4390a8d39b3b7cdc79fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:55.787387 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1ce41f19-1027-46c5-94ed-12e95a6b7b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:55.852295 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 993/1970] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:55.856829 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e6661-9f93-43db-a06a-d34850c6c721 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:55.919295 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e6661-9f93-43db-a06a-d34850c6c721 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:55.924360 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56491-109e-4ca1-898c-81856b0daf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:55.924985 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56491-109e-4ca1-898c-81856b0daf84 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:55.925289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56491-109e-4ca1-898c-81856b0daf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:55.925564 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56491-109e-4ca1-898c-81856b0daf84 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:55.926193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd56491-109e-4ca1-898c-81856b0daf84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:55.928073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd56491-109e-4ca1-898c-81856b0daf84 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:55.958016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 978/1971] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:52:55 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:55.962063 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce41f19-1027-46c5-94ed-12e95a6b7b3a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:55.974659 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce41f19-1027-46c5-94ed-12e95a6b7b3a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:56.036007 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1616b73-e0fd-44ec-ba43-645f18e4676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:56.036618 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1616b73-e0fd-44ec-ba43-645f18e4676d admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:56.036900 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1616b73-e0fd-44ec-ba43-645f18e4676d admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:56.037236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1616b73-e0fd-44ec-ba43-645f18e4676d admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:56.037855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1616b73-e0fd-44ec-ba43-645f18e4676d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:56.039768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1616b73-e0fd-44ec-ba43-645f18e4676d admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:56.065853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 994/1972] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:52:55 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:52:56.067101 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56491-109e-4ca1-898c-81856b0daf84 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:56.078141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56491-109e-4ca1-898c-81856b0daf84 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:56.082833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f08f6c-4fba-46af-a058-32a32954dfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:56.083783 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f08f6c-4fba-46af-a058-32a32954dfff admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:56.084064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f08f6c-4fba-46af-a058-32a32954dfff admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:56.084626 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f08f6c-4fba-46af-a058-32a32954dfff admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:56.085317 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f08f6c-4fba-46af-a058-32a32954dfff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:56.086933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f08f6c-4fba-46af-a058-32a32954dfff admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:56.098123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 979/1973] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:52:56.102199 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1616b73-e0fd-44ec-ba43-645f18e4676d admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:56.113375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1616b73-e0fd-44ec-ba43-645f18e4676d admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:56.117965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb236a2c-5f79-4f3e-b3fc-1c7ca985dc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:56.118630 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb236a2c-5f79-4f3e-b3fc-1c7ca985dc78 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:56.118911 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb236a2c-5f79-4f3e-b3fc-1c7ca985dc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:56.119187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb236a2c-5f79-4f3e-b3fc-1c7ca985dc78 admin admin] PATH_INFO: `/v3/projects/e02b01917ba4411692ca64633f3442a5/users/154cf2858d52469294d2ba47a30c2515/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:56.122480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:56.137760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb236a2c-5f79-4f3e-b3fc-1c7ca985dc78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02b01917ba4411692ca64633f3442a5, user_id=154cf2858d52469294d2ba47a30c2515, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:56.140464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb236a2c-5f79-4f3e-b3fc-1c7ca985dc78 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:56.154881 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 995/1974] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:56 2022] PUT /identity/v3/projects/e02b01917ba4411692ca64633f3442a5/users/154cf2858d52469294d2ba47a30c2515/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:56.159459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f08f6c-4fba-46af-a058-32a32954dfff admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:56.170017 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f08f6c-4fba-46af-a058-32a32954dfff admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:56.254633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9b17b-f1f7-4927-9eb3-d20dc6eb89da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:56.255263 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9b17b-f1f7-4927-9eb3-d20dc6eb89da admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:56.255713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9b17b-f1f7-4927-9eb3-d20dc6eb89da admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:56.256000 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9b17b-f1f7-4927-9eb3-d20dc6eb89da admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:56.256763 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9b17b-f1f7-4927-9eb3-d20dc6eb89da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:56.258927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9b17b-f1f7-4927-9eb3-d20dc6eb89da admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:56.271560 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 980/1975] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:52:56.275612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb236a2c-5f79-4f3e-b3fc-1c7ca985dc78 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:56.297315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb236a2c-5f79-4f3e-b3fc-1c7ca985dc78 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:56.297315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3534b-c125-41b6-9203-1453d63de6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:56.297315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3534b-c125-41b6-9203-1453d63de6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:56.297315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3534b-c125-41b6-9203-1453d63de6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:56.297669 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3534b-c125-41b6-9203-1453d63de6ed admin admin] PATH_INFO: `/v3/projects/e02b01917ba4411692ca64633f3442a5/users/154cf2858d52469294d2ba47a30c2515/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:56.297669 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3534b-c125-41b6-9203-1453d63de6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02b01917ba4411692ca64633f3442a5, user_id=154cf2858d52469294d2ba47a30c2515, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:56.301423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3534b-c125-41b6-9203-1453d63de6ed admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:56.322535 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 996/1976] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:52:56 2022] PUT /identity/v3/projects/e02b01917ba4411692ca64633f3442a5/users/154cf2858d52469294d2ba47a30c2515/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:52:56.332795 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac39ea-a5e3-406b-b4e2-859d6c58875a None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:56.333121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac39ea-a5e3-406b-b4e2-859d6c58875a None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:56.333402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac39ea-a5e3-406b-b4e2-859d6c58875a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:56.366635 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-22ac39ea-a5e3-406b-b4e2-859d6c58875a None None] MFA Rules not processed for user `154cf2858d52469294d2ba47a30c2515`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:56.367864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-22ac39ea-a5e3-406b-b4e2-859d6c58875a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:56.459355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:56.490155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 981/1977] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:52:56.518361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3534b-c125-41b6-9203-1453d63de6ed admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:56.521252 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-fbf3534b-c125-41b6-9203-1453d63de6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:56.603368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3534b-c125-41b6-9203-1453d63de6ed admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:56.606983 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab21d0-ed9f-4e57-b071-efeaacd3faac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:56.607592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab21d0-ed9f-4e57-b071-efeaacd3faac service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:56.608023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab21d0-ed9f-4e57-b071-efeaacd3faac service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:56.608371 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab21d0-ed9f-4e57-b071-efeaacd3faac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:56.619696 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab21d0-ed9f-4e57-b071-efeaacd3faac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:56.621433 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab21d0-ed9f-4e57-b071-efeaacd3faac service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:56.632455 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 997/1978] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:56.730535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac39ea-a5e3-406b-b4e2-859d6c58875a None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:56.741851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac39ea-a5e3-406b-b4e2-859d6c58875a None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:56.745523 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4168f-d751-4238-9877-6664aa4e78b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:56.746168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4168f-d751-4238-9877-6664aa4e78b9 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:56.746448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4168f-d751-4238-9877-6664aa4e78b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:56.746721 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4168f-d751-4238-9877-6664aa4e78b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:56.836094 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4168f-d751-4238-9877-6664aa4e78b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:56.837578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4168f-d751-4238-9877-6664aa4e78b9 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:56.850963 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 982/1979] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:57.952814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab21d0-ed9f-4e57-b071-efeaacd3faac service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:57.957935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-89ab21d0-ed9f-4e57-b071-efeaacd3faac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:58.048830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab21d0-ed9f-4e57-b071-efeaacd3faac service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:58.056298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da8e60-bb14-4f3f-ba6e-8d591c619f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:58.057024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da8e60-bb14-4f3f-ba6e-8d591c619f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:58.057302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da8e60-bb14-4f3f-ba6e-8d591c619f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:58.057625 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da8e60-bb14-4f3f-ba6e-8d591c619f9a admin admin] PATH_INFO: `/v3/users/352320959c2747d58ad7ca00047c1a5f` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:58.058948 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da8e60-bb14-4f3f-ba6e-8d591c619f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=352320959c2747d58ad7ca00047c1a5f)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:58.062592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da8e60-bb14-4f3f-ba6e-8d591c619f9a admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:58.130854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-09da8e60-bb14-4f3f-ba6e-8d591c619f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352320959c2747d58ad7ca00047c1a5f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:58.139668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-09da8e60-bb14-4f3f-ba6e-8d591c619f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352320959c2747d58ad7ca00047c1a5f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:58.140379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-09da8e60-bb14-4f3f-ba6e-8d591c619f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352320959c2747d58ad7ca00047c1a5f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:58.151348 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-09da8e60-bb14-4f3f-ba6e-8d591c619f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352320959c2747d58ad7ca00047c1a5f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:58.165842 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:58.169671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-09da8e60-bb14-4f3f-ba6e-8d591c619f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352320959c2747d58ad7ca00047c1a5f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:58.184637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 998/1980] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:57 2022] DELETE /identity/v3/users/352320959c2747d58ad7ca00047c1a5f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:58.186107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece26676-18bb-40b9-9605-67591c9a13c2 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:58.186572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece26676-18bb-40b9-9605-67591c9a13c2 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:58.186827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece26676-18bb-40b9-9605-67591c9a13c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:58.243849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ece26676-18bb-40b9-9605-67591c9a13c2 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:58.246830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ece26676-18bb-40b9-9605-67591c9a13c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:58.335965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 983/1981] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:58.361190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da8e60-bb14-4f3f-ba6e-8d591c619f9a admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:58.363870 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-09da8e60-bb14-4f3f-ba6e-8d591c619f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:58.455866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da8e60-bb14-4f3f-ba6e-8d591c619f9a admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:58.460106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac6e0c-71c5-4175-916c-b009fb349303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:58.460833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac6e0c-71c5-4175-916c-b009fb349303 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:58.461368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac6e0c-71c5-4175-916c-b009fb349303 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:58.461689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac6e0c-71c5-4175-916c-b009fb349303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:58.475122 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac6e0c-71c5-4175-916c-b009fb349303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:58.476621 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac6e0c-71c5-4175-916c-b009fb349303 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:58.494126 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 999/1982] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:52:59.167717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece26676-18bb-40b9-9605-67591c9a13c2 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:59.169928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ece26676-18bb-40b9-9605-67591c9a13c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:59.191163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece26676-18bb-40b9-9605-67591c9a13c2 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:59.217186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84664c8-6b15-4864-94cb-e3c8f71b391f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:59.218249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84664c8-6b15-4864-94cb-e3c8f71b391f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:59.218651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84664c8-6b15-4864-94cb-e3c8f71b391f admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:59.219036 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84664c8-6b15-4864-94cb-e3c8f71b391f admin admin] PATH_INFO: `/v3/users/fcf93d5872d64024af4a71aeed720a0d` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:59.225814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84664c8-6b15-4864-94cb-e3c8f71b391f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf93d5872d64024af4a71aeed720a0d)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:59.229706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac6e0c-71c5-4175-916c-b009fb349303 service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:59.231938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-faac6e0c-71c5-4175-916c-b009fb349303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:59.241434 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84664c8-6b15-4864-94cb-e3c8f71b391f admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:59.267882 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac6e0c-71c5-4175-916c-b009fb349303 service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:59.299062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf38fd-fdc1-4fa9-8869-afe44204d24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:59.300761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf38fd-fdc1-4fa9-8869-afe44204d24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:59.304814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf38fd-fdc1-4fa9-8869-afe44204d24f admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:59.305206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf38fd-fdc1-4fa9-8869-afe44204d24f admin admin] PATH_INFO: `/v3/projects/77f1d17f08eb4b699f0bd532685f62d7` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:59.307211 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf38fd-fdc1-4fa9-8869-afe44204d24f admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f1d17f08eb4b699f0bd532685f62d7)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:59.309316 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf38fd-fdc1-4fa9-8869-afe44204d24f admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:59.338796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c84664c8-6b15-4864-94cb-e3c8f71b391f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf93d5872d64024af4a71aeed720a0d'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:59.348662 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c84664c8-6b15-4864-94cb-e3c8f71b391f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf93d5872d64024af4a71aeed720a0d'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:59.349674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c84664c8-6b15-4864-94cb-e3c8f71b391f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf93d5872d64024af4a71aeed720a0d'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:59.351290 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c84664c8-6b15-4864-94cb-e3c8f71b391f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf93d5872d64024af4a71aeed720a0d'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:59.362603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c84664c8-6b15-4864-94cb-e3c8f71b391f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf93d5872d64024af4a71aeed720a0d'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:59.389793 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-acaf38fd-fdc1-4fa9-8869-afe44204d24f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f1d17f08eb4b699f0bd532685f62d7', 'request_id': 'req-acaf38fd-fdc1-4fa9-8869-afe44204d24f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:59.393071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:59.410853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-acaf38fd-fdc1-4fa9-8869-afe44204d24f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f1d17f08eb4b699f0bd532685f62d7', 'request_id': 'req-acaf38fd-fdc1-4fa9-8869-afe44204d24f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:59.422218 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 984/1983] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:59 2022] DELETE /identity/v3/users/fcf93d5872d64024af4a71aeed720a0d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:59.426812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26dfb4-aa4c-49a1-a4a1-1341df2ab89c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:59.427534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26dfb4-aa4c-49a1-a4a1-1341df2ab89c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:59.428334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26dfb4-aa4c-49a1-a4a1-1341df2ab89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:59.439672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-acaf38fd-fdc1-4fa9-8869-afe44204d24f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f1d17f08eb4b699f0bd532685f62d7', 'request_id': 'req-acaf38fd-fdc1-4fa9-8869-afe44204d24f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:59.456900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-7b26dfb4-aa4c-49a1-a4a1-1341df2ab89c None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:52:59.457133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-acaf38fd-fdc1-4fa9-8869-afe44204d24f admin admin] The token cache is being invalidate because project 77f1d17f08eb4b699f0bd532685f62d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:52:59.457301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-acaf38fd-fdc1-4fa9-8869-afe44204d24f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:59.457938 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-acaf38fd-fdc1-4fa9-8869-afe44204d24f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:59.459108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7b26dfb4-aa4c-49a1-a4a1-1341df2ab89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:59.460902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1000/1984] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:52:59 2022] DELETE /identity/v3/projects/77f1d17f08eb4b699f0bd532685f62d7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:52:59.465539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf38fd-fdc1-4fa9-8869-afe44204d24f admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:59.468128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-acaf38fd-fdc1-4fa9-8869-afe44204d24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:59.566700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 985/1985] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:52:59.566910 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf38fd-fdc1-4fa9-8869-afe44204d24f admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:59.571931 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3ad12-1648-4c19-8dc1-8efdfef0ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:59.572542 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3ad12-1648-4c19-8dc1-8efdfef0ae10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:59.572833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3ad12-1648-4c19-8dc1-8efdfef0ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:59.573149 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3ad12-1648-4c19-8dc1-8efdfef0ae10 admin admin] PATH_INFO: `/v3/users/e321ef25cec7447385179f46905ac684` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:59.582012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3ad12-1648-4c19-8dc1-8efdfef0ae10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e321ef25cec7447385179f46905ac684)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:59.590818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26dfb4-aa4c-49a1-a4a1-1341df2ab89c None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:52:59.593180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3ad12-1648-4c19-8dc1-8efdfef0ae10 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:59.593810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7b26dfb4-aa4c-49a1-a4a1-1341df2ab89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:59.619901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:59.694601 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-cda3ad12-1648-4c19-8dc1-8efdfef0ae10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e321ef25cec7447385179f46905ac684'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:59.719572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-cda3ad12-1648-4c19-8dc1-8efdfef0ae10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e321ef25cec7447385179f46905ac684'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:59.720344 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-cda3ad12-1648-4c19-8dc1-8efdfef0ae10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e321ef25cec7447385179f46905ac684'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:59.767655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-cda3ad12-1648-4c19-8dc1-8efdfef0ae10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e321ef25cec7447385179f46905ac684'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:59.800311 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26dfb4-aa4c-49a1-a4a1-1341df2ab89c None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:52:59.807244 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-cda3ad12-1648-4c19-8dc1-8efdfef0ae10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e321ef25cec7447385179f46905ac684'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:52:59.822625 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6ceb1-6f26-4daf-b60a-8d865e87138f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:52:59.823533 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6ceb1-6f26-4daf-b60a-8d865e87138f service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:52:59.825781 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6ceb1-6f26-4daf-b60a-8d865e87138f service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:52:59.826253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6ceb1-6f26-4daf-b60a-8d865e87138f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:52:59.830590 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1001/1986] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:52:59 2022] DELETE /identity/v3/users/e321ef25cec7447385179f46905ac684 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:52:59.838308 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3de6ceb1-6f26-4daf-b60a-8d865e87138f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:52:59.867185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6ceb1-6f26-4daf-b60a-8d865e87138f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:52:59.868981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6ceb1-6f26-4daf-b60a-8d865e87138f service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:52:59.882453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 986/1987] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:53:00.753703 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3ad12-1648-4c19-8dc1-8efdfef0ae10 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:00.760924 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-cda3ad12-1648-4c19-8dc1-8efdfef0ae10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:00.911213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3ad12-1648-4c19-8dc1-8efdfef0ae10 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:00.932874 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bff304-d782-438e-a1d8-e0aa4f4276f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:00.933661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bff304-d782-438e-a1d8-e0aa4f4276f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:00.934107 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bff304-d782-438e-a1d8-e0aa4f4276f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:00.934394 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bff304-d782-438e-a1d8-e0aa4f4276f9 admin admin] PATH_INFO: `/v3/projects/cbccbb5fa4804e1391a824465502658b` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:00.939341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bff304-d782-438e-a1d8-e0aa4f4276f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbccbb5fa4804e1391a824465502658b)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:00.944132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bff304-d782-438e-a1d8-e0aa4f4276f9 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:00.973908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6ceb1-6f26-4daf-b60a-8d865e87138f service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:00.976253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3de6ceb1-6f26-4daf-b60a-8d865e87138f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:01.003274 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6ceb1-6f26-4daf-b60a-8d865e87138f service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:01.045113 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884fee4-9f13-41c0-b626-96d1ac0054a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:01.046450 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884fee4-9f13-41c0-b626-96d1ac0054a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:01.046924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884fee4-9f13-41c0-b626-96d1ac0054a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:01.047361 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884fee4-9f13-41c0-b626-96d1ac0054a8 admin admin] PATH_INFO: `/v3/projects/a898aac020dc4545ae0a0bdff1193aa0` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:01.049808 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884fee4-9f13-41c0-b626-96d1ac0054a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a898aac020dc4545ae0a0bdff1193aa0)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:01.057385 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884fee4-9f13-41c0-b626-96d1ac0054a8 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:01.101837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c7bff304-d782-438e-a1d8-e0aa4f4276f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbccbb5fa4804e1391a824465502658b', 'request_id': 'req-c7bff304-d782-438e-a1d8-e0aa4f4276f9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:01.125585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c7bff304-d782-438e-a1d8-e0aa4f4276f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbccbb5fa4804e1391a824465502658b', 'request_id': 'req-c7bff304-d782-438e-a1d8-e0aa4f4276f9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:01.140213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c7bff304-d782-438e-a1d8-e0aa4f4276f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbccbb5fa4804e1391a824465502658b', 'request_id': 'req-c7bff304-d782-438e-a1d8-e0aa4f4276f9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:01.149673 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d884fee4-9f13-41c0-b626-96d1ac0054a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a898aac020dc4545ae0a0bdff1193aa0', 'request_id': 'req-d884fee4-9f13-41c0-b626-96d1ac0054a8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:01.159434 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c7bff304-d782-438e-a1d8-e0aa4f4276f9 admin admin] The token cache is being invalidate because project cbccbb5fa4804e1391a824465502658b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:53:01.159829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c7bff304-d782-438e-a1d8-e0aa4f4276f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:01.160419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c7bff304-d782-438e-a1d8-e0aa4f4276f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:01.160658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d884fee4-9f13-41c0-b626-96d1ac0054a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a898aac020dc4545ae0a0bdff1193aa0', 'request_id': 'req-d884fee4-9f13-41c0-b626-96d1ac0054a8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:01.165557 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1002/1988] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:53:00 2022] DELETE /identity/v3/projects/cbccbb5fa4804e1391a824465502658b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:01.167332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974657b3-502a-4861-bc83-f4b41002ad5d None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:01.168665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974657b3-502a-4861-bc83-f4b41002ad5d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:01.169942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974657b3-502a-4861-bc83-f4b41002ad5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:01.177881 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d884fee4-9f13-41c0-b626-96d1ac0054a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a898aac020dc4545ae0a0bdff1193aa0', 'request_id': 'req-d884fee4-9f13-41c0-b626-96d1ac0054a8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:01.196104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-974657b3-502a-4861-bc83-f4b41002ad5d None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:01.197534 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-974657b3-502a-4861-bc83-f4b41002ad5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:01.208232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d884fee4-9f13-41c0-b626-96d1ac0054a8 admin admin] The token cache is being invalidate because project a898aac020dc4545ae0a0bdff1193aa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:53:01.208538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d884fee4-9f13-41c0-b626-96d1ac0054a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:01.209253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d884fee4-9f13-41c0-b626-96d1ac0054a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:01.211705 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 987/1989] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:53:00 2022] DELETE /identity/v3/projects/a898aac020dc4545ae0a0bdff1193aa0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:01.215677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884fee4-9f13-41c0-b626-96d1ac0054a8 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:01.219435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d884fee4-9f13-41c0-b626-96d1ac0054a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:01.236719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:01.245568 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:01.292106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1003/1990] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:01.299943 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595fe8b-dff8-4c85-9a45-fc82070e2331 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:01.300238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595fe8b-dff8-4c85-9a45-fc82070e2331 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:01.300559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595fe8b-dff8-4c85-9a45-fc82070e2331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:01.317495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884fee4-9f13-41c0-b626-96d1ac0054a8 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:01.331303 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4521c4-10d3-4ca0-8efc-1ce5d1948b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:01.331911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4521c4-10d3-4ca0-8efc-1ce5d1948b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:01.333064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4521c4-10d3-4ca0-8efc-1ce5d1948b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:01.333390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4521c4-10d3-4ca0-8efc-1ce5d1948b94 admin admin] PATH_INFO: `/v3/users/d80f0ab57e434db98251de1154e7eadb` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:01.347690 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0595fe8b-dff8-4c85-9a45-fc82070e2331 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:01.348348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4521c4-10d3-4ca0-8efc-1ce5d1948b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d80f0ab57e434db98251de1154e7eadb)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:01.348578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0595fe8b-dff8-4c85-9a45-fc82070e2331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:01.348655 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4521c4-10d3-4ca0-8efc-1ce5d1948b94 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:01.357803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1004/1991] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:53:01.367200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595fe8b-dff8-4c85-9a45-fc82070e2331 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:01.381569 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595fe8b-dff8-4c85-9a45-fc82070e2331 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:01.386559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce1366-3d1e-468a-92ca-0aca79e3e76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:01.387381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce1366-3d1e-468a-92ca-0aca79e3e76c admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:01.387669 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce1366-3d1e-468a-92ca-0aca79e3e76c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:01.387945 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce1366-3d1e-468a-92ca-0aca79e3e76c admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:01.388642 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce1366-3d1e-468a-92ca-0aca79e3e76c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:53:01.389145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce1366-3d1e-468a-92ca-0aca79e3e76c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:01.391112 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce1366-3d1e-468a-92ca-0aca79e3e76c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:01.408305 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1005/1992] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:53:01.409651 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce1366-3d1e-468a-92ca-0aca79e3e76c admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:01.415072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-cc4521c4-10d3-4ca0-8efc-1ce5d1948b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd80f0ab57e434db98251de1154e7eadb'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:01.422659 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce1366-3d1e-468a-92ca-0aca79e3e76c admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:01.429370 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-cc4521c4-10d3-4ca0-8efc-1ce5d1948b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd80f0ab57e434db98251de1154e7eadb'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:01.429553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188494b0-e306-4529-a20f-73b2cfc595cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:01.430562 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188494b0-e306-4529-a20f-73b2cfc595cc admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:01.430925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188494b0-e306-4529-a20f-73b2cfc595cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:01.431334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-cc4521c4-10d3-4ca0-8efc-1ce5d1948b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd80f0ab57e434db98251de1154e7eadb'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:01.431611 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188494b0-e306-4529-a20f-73b2cfc595cc admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:01.432478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188494b0-e306-4529-a20f-73b2cfc595cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:01.432711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-cc4521c4-10d3-4ca0-8efc-1ce5d1948b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd80f0ab57e434db98251de1154e7eadb'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:01.435449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188494b0-e306-4529-a20f-73b2cfc595cc admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:01.443039 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-cc4521c4-10d3-4ca0-8efc-1ce5d1948b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd80f0ab57e434db98251de1154e7eadb'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:01.470535 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 988/1993] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:53:01 2022] DELETE /identity/v3/users/d80f0ab57e434db98251de1154e7eadb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:01.482036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1006/1994] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:53:01 2022] POST /identity/v3/projects => generated 359 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:53:01.486839 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4521c4-10d3-4ca0-8efc-1ce5d1948b94 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:01.488453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-cc4521c4-10d3-4ca0-8efc-1ce5d1948b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:01.599948 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4521c4-10d3-4ca0-8efc-1ce5d1948b94 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:01.652719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:01.674668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f1191-eb27-4111-90c2-bd12efcd671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:01.675477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f1191-eb27-4111-90c2-bd12efcd671d admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:01.675899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f1191-eb27-4111-90c2-bd12efcd671d admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:01.676284 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f1191-eb27-4111-90c2-bd12efcd671d admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:01.677420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f1191-eb27-4111-90c2-bd12efcd671d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:01.679945 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f1191-eb27-4111-90c2-bd12efcd671d admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:01.723621 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188494b0-e306-4529-a20f-73b2cfc595cc admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:01.723998 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 989/1995] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:53:01 2022] POST /identity/v3/users => generated 280 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:53:01.734105 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188494b0-e306-4529-a20f-73b2cfc595cc admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:01.740872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2d65d-a905-44bb-9236-8e4325afcc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:01.741592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2d65d-a905-44bb-9236-8e4325afcc92 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:01.741875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2d65d-a905-44bb-9236-8e4325afcc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:01.742151 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2d65d-a905-44bb-9236-8e4325afcc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:01.742830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2d65d-a905-44bb-9236-8e4325afcc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:01.744502 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2d65d-a905-44bb-9236-8e4325afcc92 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:01.757696 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1007/1996] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:53:01.761831 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f1191-eb27-4111-90c2-bd12efcd671d admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:01.774927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f1191-eb27-4111-90c2-bd12efcd671d admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:01.779790 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fc931-641d-4d2e-a707-a2ee9e741909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:01.780403 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fc931-641d-4d2e-a707-a2ee9e741909 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:01.780686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fc931-641d-4d2e-a707-a2ee9e741909 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:01.781047 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fc931-641d-4d2e-a707-a2ee9e741909 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:01.781701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fc931-641d-4d2e-a707-a2ee9e741909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:01.783351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fc931-641d-4d2e-a707-a2ee9e741909 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:01.793537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 990/1997] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:53:01.798576 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2d65d-a905-44bb-9236-8e4325afcc92 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:01.808691 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2d65d-a905-44bb-9236-8e4325afcc92 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:01.813285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e6901-9947-4ca6-a56a-f619c6558bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:01.814512 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e6901-9947-4ca6-a56a-f619c6558bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:01.814795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e6901-9947-4ca6-a56a-f619c6558bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:01.815073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e6901-9947-4ca6-a56a-f619c6558bf7 admin admin] PATH_INFO: `/v3/projects/60a18d31a7db4362b8552ef5b5992954/users/1b2219fed1fe4cfeb963c39aa2477af2/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:01.832753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e6901-9947-4ca6-a56a-f619c6558bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a18d31a7db4362b8552ef5b5992954, user_id=1b2219fed1fe4cfeb963c39aa2477af2, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:01.835558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e6901-9947-4ca6-a56a-f619c6558bf7 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:01.857248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1008/1998] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:53:01 2022] PUT /identity/v3/projects/60a18d31a7db4362b8552ef5b5992954/users/1b2219fed1fe4cfeb963c39aa2477af2/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:01.875086 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e34e0-884c-49cb-9cc6-fa3dd35c684c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:01.875473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e34e0-884c-49cb-9cc6-fa3dd35c684c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:01.875885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e34e0-884c-49cb-9cc6-fa3dd35c684c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:01.912924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-853e34e0-884c-49cb-9cc6-fa3dd35c684c None None] MFA Rules not processed for user `1b2219fed1fe4cfeb963c39aa2477af2`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:01.914386 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-853e34e0-884c-49cb-9cc6-fa3dd35c684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:01.992027 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 991/1999] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:02.028036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e6901-9947-4ca6-a56a-f619c6558bf7 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:02.029772 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b73e6901-9947-4ca6-a56a-f619c6558bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:02.036181 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e34e0-884c-49cb-9cc6-fa3dd35c684c None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:02.038263 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-853e34e0-884c-49cb-9cc6-fa3dd35c684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:02.106277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e6901-9947-4ca6-a56a-f619c6558bf7 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:02.111501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47563a65-fa2d-40dc-805a-261fd4efcfa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:02.112436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47563a65-fa2d-40dc-805a-261fd4efcfa3 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:02.112722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47563a65-fa2d-40dc-805a-261fd4efcfa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:02.113039 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47563a65-fa2d-40dc-805a-261fd4efcfa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:02.121964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47563a65-fa2d-40dc-805a-261fd4efcfa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:02.123384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47563a65-fa2d-40dc-805a-261fd4efcfa3 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:02.135267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1009/2000] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:53:02.139854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e34e0-884c-49cb-9cc6-fa3dd35c684c None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:02.147654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2c2ef-06f7-45cf-9fe4-c0bd42adb66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:02.148726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2c2ef-06f7-45cf-9fe4-c0bd42adb66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:02.149887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2c2ef-06f7-45cf-9fe4-c0bd42adb66a admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:02.149887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2c2ef-06f7-45cf-9fe4-c0bd42adb66a admin admin] PATH_INFO: `/v3/projects/67949b51030845d2853fbfb27724fa7d` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:02.150866 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2c2ef-06f7-45cf-9fe4-c0bd42adb66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=67949b51030845d2853fbfb27724fa7d)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:02.151430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47563a65-fa2d-40dc-805a-261fd4efcfa3 service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:02.152947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2c2ef-06f7-45cf-9fe4-c0bd42adb66a admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:02.163428 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47563a65-fa2d-40dc-805a-261fd4efcfa3 service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:02.168678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6af3e-a6aa-4c05-a90a-542692ad58bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:02.169698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6af3e-a6aa-4c05-a90a-542692ad58bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:02.170055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6af3e-a6aa-4c05-a90a-542692ad58bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:02.170400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6af3e-a6aa-4c05-a90a-542692ad58bd admin admin] PATH_INFO: `/v3/users/1b2219fed1fe4cfeb963c39aa2477af2` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:02.171672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6af3e-a6aa-4c05-a90a-542692ad58bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2219fed1fe4cfeb963c39aa2477af2)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:02.174465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6af3e-a6aa-4c05-a90a-542692ad58bd admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:02.211765 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-10d2c2ef-06f7-45cf-9fe4-c0bd42adb66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67949b51030845d2853fbfb27724fa7d', 'request_id': 'req-10d2c2ef-06f7-45cf-9fe4-c0bd42adb66a'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:02.219353 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-10d2c2ef-06f7-45cf-9fe4-c0bd42adb66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67949b51030845d2853fbfb27724fa7d', 'request_id': 'req-10d2c2ef-06f7-45cf-9fe4-c0bd42adb66a'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:02.221925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:02.231406 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-10d2c2ef-06f7-45cf-9fe4-c0bd42adb66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67949b51030845d2853fbfb27724fa7d', 'request_id': 'req-10d2c2ef-06f7-45cf-9fe4-c0bd42adb66a'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:02.232128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8ad6af3e-a6aa-4c05-a90a-542692ad58bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2219fed1fe4cfeb963c39aa2477af2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:02.239864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:02.243189 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8ad6af3e-a6aa-4c05-a90a-542692ad58bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2219fed1fe4cfeb963c39aa2477af2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:02.244281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8ad6af3e-a6aa-4c05-a90a-542692ad58bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2219fed1fe4cfeb963c39aa2477af2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:02.245924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-10d2c2ef-06f7-45cf-9fe4-c0bd42adb66a admin admin] The token cache is being invalidate because project 67949b51030845d2853fbfb27724fa7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:53:02.246229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-10d2c2ef-06f7-45cf-9fe4-c0bd42adb66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:02.246907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-10d2c2ef-06f7-45cf-9fe4-c0bd42adb66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:02.248622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 992/2001] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:53:02 2022] DELETE /identity/v3/projects/67949b51030845d2853fbfb27724fa7d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:53:02.255658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b061f88-9c77-4965-bbe0-361b9e678697 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:02.256086 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b061f88-9c77-4965-bbe0-361b9e678697 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:02.256439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b061f88-9c77-4965-bbe0-361b9e678697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:02.256897 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8ad6af3e-a6aa-4c05-a90a-542692ad58bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2219fed1fe4cfeb963c39aa2477af2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:02.278602 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-2b061f88-9c77-4965-bbe0-361b9e678697 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:02.280102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-2b061f88-9c77-4965-bbe0-361b9e678697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:02.286067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8ad6af3e-a6aa-4c05-a90a-542692ad58bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2219fed1fe4cfeb963c39aa2477af2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:02.294057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1010/2002] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:53:02 2022] DELETE /identity/v3/users/1b2219fed1fe4cfeb963c39aa2477af2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:02.299175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfef9c-45ab-412c-8212-25f3fb80d883 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:02.299469 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfef9c-45ab-412c-8212-25f3fb80d883 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:02.299757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfef9c-45ab-412c-8212-25f3fb80d883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:02.320467 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-6fdfef9c-45ab-412c-8212-25f3fb80d883 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:02.321764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6fdfef9c-45ab-412c-8212-25f3fb80d883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:02.348763 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 993/2003] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:53:02.359328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406f8de-208d-42a0-b0e7-cda48e3b94cd None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:02.359641 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406f8de-208d-42a0-b0e7-cda48e3b94cd None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:02.359919 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406f8de-208d-42a0-b0e7-cda48e3b94cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:02.385300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-2406f8de-208d-42a0-b0e7-cda48e3b94cd None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:02.386541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-2406f8de-208d-42a0-b0e7-cda48e3b94cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:02.406068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1011/2004] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:53:02.416020 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfef9c-45ab-412c-8212-25f3fb80d883 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:02.417486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6fdfef9c-45ab-412c-8212-25f3fb80d883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:02.519136 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 994/2005] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:53:02.520115 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406f8de-208d-42a0-b0e7-cda48e3b94cd None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:02.522829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfef9c-45ab-412c-8212-25f3fb80d883 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:02.529412 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569acf8-4ff7-4510-8f99-5bc37247c5ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:02.530379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569acf8-4ff7-4510-8f99-5bc37247c5ef service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:02.530995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569acf8-4ff7-4510-8f99-5bc37247c5ef service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:02.531462 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569acf8-4ff7-4510-8f99-5bc37247c5ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:02.537303 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406f8de-208d-42a0-b0e7-cda48e3b94cd None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:02.550909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569acf8-4ff7-4510-8f99-5bc37247c5ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:02.553645 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569acf8-4ff7-4510-8f99-5bc37247c5ef service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:02.557472 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b998c3-4af2-4fe8-82da-b3abf1f71b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:02.558105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b998c3-4af2-4fe8-82da-b3abf1f71b34 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:02.558387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b998c3-4af2-4fe8-82da-b3abf1f71b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:02.558663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b998c3-4af2-4fe8-82da-b3abf1f71b34 admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:02.559322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b998c3-4af2-4fe8-82da-b3abf1f71b34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:53:02.559624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b998c3-4af2-4fe8-82da-b3abf1f71b34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:02.562731 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b998c3-4af2-4fe8-82da-b3abf1f71b34 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:02.595481 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1012/2006] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:53:02.604629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569acf8-4ff7-4510-8f99-5bc37247c5ef service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:02.606630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 995/2007] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:53:02.608196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b998c3-4af2-4fe8-82da-b3abf1f71b34 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:02.608689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-3569acf8-4ff7-4510-8f99-5bc37247c5ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:02.633166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b998c3-4af2-4fe8-82da-b3abf1f71b34 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:02.633967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569acf8-4ff7-4510-8f99-5bc37247c5ef service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:02.640294 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bc72f-6c66-4745-ae08-2c719b89d4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:02.641099 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bc72f-6c66-4745-ae08-2c719b89d4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:02.641383 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bc72f-6c66-4745-ae08-2c719b89d4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:02.641691 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bc72f-6c66-4745-ae08-2c719b89d4f9 admin admin] PATH_INFO: `/v3/users/73fb2e7ef61f4390a8d39b3b7cdc79fa` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:02.642090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff991bc1-41a3-4272-8173-37c6c369785c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:02.643138 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bc72f-6c66-4745-ae08-2c719b89d4f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73fb2e7ef61f4390a8d39b3b7cdc79fa)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:02.643721 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff991bc1-41a3-4272-8173-37c6c369785c admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:02.644313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff991bc1-41a3-4272-8173-37c6c369785c admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:02.644770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff991bc1-41a3-4272-8173-37c6c369785c admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:02.645413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bc72f-6c66-4745-ae08-2c719b89d4f9 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:02.645814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff991bc1-41a3-4272-8173-37c6c369785c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:02.648282 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff991bc1-41a3-4272-8173-37c6c369785c admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:02.692059 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 996/2008] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:53:02 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:53:02.697415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff991bc1-41a3-4272-8173-37c6c369785c admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:02.739757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-365bc72f-6c66-4745-ae08-2c719b89d4f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73fb2e7ef61f4390a8d39b3b7cdc79fa'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:02.752651 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-365bc72f-6c66-4745-ae08-2c719b89d4f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73fb2e7ef61f4390a8d39b3b7cdc79fa'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:02.755180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-365bc72f-6c66-4745-ae08-2c719b89d4f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73fb2e7ef61f4390a8d39b3b7cdc79fa'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:02.766308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-365bc72f-6c66-4745-ae08-2c719b89d4f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73fb2e7ef61f4390a8d39b3b7cdc79fa'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:02.770458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:02.774078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:02.795589 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff991bc1-41a3-4272-8173-37c6c369785c admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:02.799629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-365bc72f-6c66-4745-ae08-2c719b89d4f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73fb2e7ef61f4390a8d39b3b7cdc79fa'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:02.802549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98d1a2-d674-4711-9625-b014deb0f0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:02.803303 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98d1a2-d674-4711-9625-b014deb0f0cd admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:02.803594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98d1a2-d674-4711-9625-b014deb0f0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:02.803912 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98d1a2-d674-4711-9625-b014deb0f0cd admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:02.804598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98d1a2-d674-4711-9625-b014deb0f0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:02.807377 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98d1a2-d674-4711-9625-b014deb0f0cd admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:02.808511 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1013/2009] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:53:02 2022] DELETE /identity/v3/users/73fb2e7ef61f4390a8d39b3b7cdc79fa => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:02.816636 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea25de-c2fb-4e6f-8c85-068154a9c7c7 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:02.817094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea25de-c2fb-4e6f-8c85-068154a9c7c7 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:02.817724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea25de-c2fb-4e6f-8c85-068154a9c7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:02.847326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 997/2010] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:53:02 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:53:02.848392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98d1a2-d674-4711-9625-b014deb0f0cd admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:02.849979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-53ea25de-c2fb-4e6f-8c85-068154a9c7c7 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:02.850368 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3e98d1a2-d674-4711-9625-b014deb0f0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:02.851196 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-53ea25de-c2fb-4e6f-8c85-068154a9c7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:02.867404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98d1a2-d674-4711-9625-b014deb0f0cd admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:02.924511 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1014/2011] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:02.931392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea25de-c2fb-4e6f-8c85-068154a9c7c7 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:02.932841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-53ea25de-c2fb-4e6f-8c85-068154a9c7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:02.940802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c6e58-fc0f-4c36-af0c-002357f1331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:02.941444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c6e58-fc0f-4c36-af0c-002357f1331e admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:02.941720 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c6e58-fc0f-4c36-af0c-002357f1331e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:02.941990 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c6e58-fc0f-4c36-af0c-002357f1331e admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:02.942792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c6e58-fc0f-4c36-af0c-002357f1331e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:02.944368 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c6e58-fc0f-4c36-af0c-002357f1331e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:02.957582 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 998/2012] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:53:02.961537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c6e58-fc0f-4c36-af0c-002357f1331e admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:02.977180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c6e58-fc0f-4c36-af0c-002357f1331e admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:02.988913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33113ed-53a7-415f-89c6-62c84979920a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:02.989095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33113ed-53a7-415f-89c6-62c84979920a admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:02.989465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33113ed-53a7-415f-89c6-62c84979920a admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:02.989817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33113ed-53a7-415f-89c6-62c84979920a admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:02.990597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33113ed-53a7-415f-89c6-62c84979920a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:02.992979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33113ed-53a7-415f-89c6-62c84979920a admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:02.997152 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea25de-c2fb-4e6f-8c85-068154a9c7c7 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:03.000895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c731c42-7692-4a0b-9d87-7d2f1dbcda0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:03.001664 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c731c42-7692-4a0b-9d87-7d2f1dbcda0c service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:03.001943 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c731c42-7692-4a0b-9d87-7d2f1dbcda0c service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:03.002216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c731c42-7692-4a0b-9d87-7d2f1dbcda0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:03.008488 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 999/2013] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:53:03.012642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33113ed-53a7-415f-89c6-62c84979920a admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:03.014065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c731c42-7692-4a0b-9d87-7d2f1dbcda0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:03.015866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c731c42-7692-4a0b-9d87-7d2f1dbcda0c service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:03.025708 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33113ed-53a7-415f-89c6-62c84979920a admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:03.030355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1015/2014] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:53:03.030953 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3a25f-907a-4123-a8a0-73582a71575d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:03.031878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3a25f-907a-4123-a8a0-73582a71575d admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:03.032791 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3a25f-907a-4123-a8a0-73582a71575d admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:03.033173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3a25f-907a-4123-a8a0-73582a71575d admin admin] PATH_INFO: `/v3/projects/e8453efd8b2d4be0b255d91d0ffd9e81/users/624d56714534457d8df7c3a5b6ecf483/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:03.050405 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3a25f-907a-4123-a8a0-73582a71575d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8453efd8b2d4be0b255d91d0ffd9e81, user_id=624d56714534457d8df7c3a5b6ecf483, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:03.053459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3a25f-907a-4123-a8a0-73582a71575d admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:03.089257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1000/2015] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:53:03 2022] PUT /identity/v3/projects/e8453efd8b2d4be0b255d91d0ffd9e81/users/624d56714534457d8df7c3a5b6ecf483/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:53:03.104555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40ce56-90fe-4c73-9224-e5cbedc16fa1 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:03.104933 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40ce56-90fe-4c73-9224-e5cbedc16fa1 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:03.105218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40ce56-90fe-4c73-9224-e5cbedc16fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:03.171257 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-4e40ce56-90fe-4c73-9224-e5cbedc16fa1 None None] MFA Rules not processed for user `624d56714534457d8df7c3a5b6ecf483`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:03.173408 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4e40ce56-90fe-4c73-9224-e5cbedc16fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:03.274713 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1016/2016] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:03.278994 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3a25f-907a-4123-a8a0-73582a71575d admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:03.377682 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3a25f-907a-4123-a8a0-73582a71575d admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:03.386256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34d00b-a315-47d4-9b92-910229292138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:03.387830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34d00b-a315-47d4-9b92-910229292138 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:03.388123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34d00b-a315-47d4-9b92-910229292138 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:03.388403 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34d00b-a315-47d4-9b92-910229292138 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:03.389992 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34d00b-a315-47d4-9b92-910229292138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:03.393573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34d00b-a315-47d4-9b92-910229292138 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:03.454707 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40ce56-90fe-4c73-9224-e5cbedc16fa1 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:03.454861 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1001/2017] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:53:03 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:53:03.472111 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40ce56-90fe-4c73-9224-e5cbedc16fa1 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:03.488191 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:03.525730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34d00b-a315-47d4-9b92-910229292138 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:03.528583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7d34d00b-a315-47d4-9b92-910229292138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:03.561418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e7408-2660-4fa8-a1ae-12ea5ebb2e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:03.562527 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e7408-2660-4fa8-a1ae-12ea5ebb2e24 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:03.563017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e7408-2660-4fa8-a1ae-12ea5ebb2e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:03.563915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e7408-2660-4fa8-a1ae-12ea5ebb2e24 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:03.564570 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e7408-2660-4fa8-a1ae-12ea5ebb2e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:03.567389 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e7408-2660-4fa8-a1ae-12ea5ebb2e24 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:03.582284 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:03.605292 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1017/2018] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:53:03 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:53:03.609588 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e7408-2660-4fa8-a1ae-12ea5ebb2e24 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:03.623586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e7408-2660-4fa8-a1ae-12ea5ebb2e24 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:03.629987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915be36-0b63-4caf-a2c0-6c298fb4f451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:03.630604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915be36-0b63-4caf-a2c0-6c298fb4f451 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:03.630893 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915be36-0b63-4caf-a2c0-6c298fb4f451 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:03.631175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915be36-0b63-4caf-a2c0-6c298fb4f451 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:03.632021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915be36-0b63-4caf-a2c0-6c298fb4f451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:03.633863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915be36-0b63-4caf-a2c0-6c298fb4f451 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:03.647423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1018/2019] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:53:03.652191 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915be36-0b63-4caf-a2c0-6c298fb4f451 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:03.653458 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34d00b-a315-47d4-9b92-910229292138 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:03.658957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b3210-d83a-4faa-9e29-87cda9fe49a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:03.660368 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b3210-d83a-4faa-9e29-87cda9fe49a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:03.660737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b3210-d83a-4faa-9e29-87cda9fe49a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:03.661064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b3210-d83a-4faa-9e29-87cda9fe49a1 admin admin] PATH_INFO: `/v3/projects/60a18d31a7db4362b8552ef5b5992954` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:03.662360 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b3210-d83a-4faa-9e29-87cda9fe49a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a18d31a7db4362b8552ef5b5992954)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:03.665675 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b3210-d83a-4faa-9e29-87cda9fe49a1 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:03.665871 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915be36-0b63-4caf-a2c0-6c298fb4f451 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:03.674909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ee8a8-2819-44bf-944d-16f5068d28b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:03.676323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ee8a8-2819-44bf-944d-16f5068d28b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:03.676611 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ee8a8-2819-44bf-944d-16f5068d28b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:03.676892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ee8a8-2819-44bf-944d-16f5068d28b7 admin admin] PATH_INFO: `/v3/projects/0a6bd726101c43b6911e48025cc69c04/users/a764eebcb73143b5981cc7255f57d028/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:03.704539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ee8a8-2819-44bf-944d-16f5068d28b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6bd726101c43b6911e48025cc69c04, user_id=a764eebcb73143b5981cc7255f57d028, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:03.707259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ee8a8-2819-44bf-944d-16f5068d28b7 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:03.725633 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1019/2020] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:53:03 2022] PUT /identity/v3/projects/0a6bd726101c43b6911e48025cc69c04/users/a764eebcb73143b5981cc7255f57d028/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:03.729425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ee8a8-2819-44bf-944d-16f5068d28b7 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:03.736092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-205b3210-d83a-4faa-9e29-87cda9fe49a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a18d31a7db4362b8552ef5b5992954', 'request_id': 'req-205b3210-d83a-4faa-9e29-87cda9fe49a1'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:03.746059 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-205b3210-d83a-4faa-9e29-87cda9fe49a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a18d31a7db4362b8552ef5b5992954', 'request_id': 'req-205b3210-d83a-4faa-9e29-87cda9fe49a1'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:03.756950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-205b3210-d83a-4faa-9e29-87cda9fe49a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a18d31a7db4362b8552ef5b5992954', 'request_id': 'req-205b3210-d83a-4faa-9e29-87cda9fe49a1'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:03.789763 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-205b3210-d83a-4faa-9e29-87cda9fe49a1 admin admin] The token cache is being invalidate because project 60a18d31a7db4362b8552ef5b5992954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:53:03.790657 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-205b3210-d83a-4faa-9e29-87cda9fe49a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:03.791516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-205b3210-d83a-4faa-9e29-87cda9fe49a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:03.793415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1002/2021] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:53:03 2022] DELETE /identity/v3/projects/60a18d31a7db4362b8552ef5b5992954 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:53:03.798158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b3210-d83a-4faa-9e29-87cda9fe49a1 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:03.799904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-205b3210-d83a-4faa-9e29-87cda9fe49a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:03.824117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ee8a8-2819-44bf-944d-16f5068d28b7 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:03.848490 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70ec8b-9c98-403a-bc08-02358dad03eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:03.849304 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70ec8b-9c98-403a-bc08-02358dad03eb admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:03.849428 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70ec8b-9c98-403a-bc08-02358dad03eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:03.849694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70ec8b-9c98-403a-bc08-02358dad03eb admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:03.852896 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70ec8b-9c98-403a-bc08-02358dad03eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:03.855602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70ec8b-9c98-403a-bc08-02358dad03eb admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:03.881203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1020/2022] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:53:03.881203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae88d0-bae5-4a83-a782-6fd34dbbf560 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:03.881203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae88d0-bae5-4a83-a782-6fd34dbbf560 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:03.881203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae88d0-bae5-4a83-a782-6fd34dbbf560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:03.885179 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b3210-d83a-4faa-9e29-87cda9fe49a1 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:03.892345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d1c29-a6fe-494e-8c89-42079160fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:03.893023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d1c29-a6fe-494e-8c89-42079160fff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:03.893307 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d1c29-a6fe-494e-8c89-42079160fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:03.893589 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d1c29-a6fe-494e-8c89-42079160fff7 admin admin] PATH_INFO: `/v3/projects/d004c76b0edc4b168ad0bc2c53567a62` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:03.894742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d1c29-a6fe-494e-8c89-42079160fff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d004c76b0edc4b168ad0bc2c53567a62)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:03.898196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d1c29-a6fe-494e-8c89-42079160fff7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:03.903094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-70ae88d0-bae5-4a83-a782-6fd34dbbf560 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:03.904346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-70ae88d0-bae5-4a83-a782-6fd34dbbf560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:03.914833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1021/2023] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:03.915742 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae88d0-bae5-4a83-a782-6fd34dbbf560 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:03.917052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-70ae88d0-bae5-4a83-a782-6fd34dbbf560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:03.931666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae88d0-bae5-4a83-a782-6fd34dbbf560 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:03.937830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909d0b9-d1cf-468a-bbd8-86d89261683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:03.939071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909d0b9-d1cf-468a-bbd8-86d89261683c admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:03.939397 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909d0b9-d1cf-468a-bbd8-86d89261683c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:03.939709 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909d0b9-d1cf-468a-bbd8-86d89261683c admin admin] PATH_INFO: `/v3/projects/0a6bd726101c43b6911e48025cc69c04/users/a764eebcb73143b5981cc7255f57d028/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:03.942247 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909d0b9-d1cf-468a-bbd8-86d89261683c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6bd726101c43b6911e48025cc69c04, user_id=a764eebcb73143b5981cc7255f57d028, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:03.946541 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909d0b9-d1cf-468a-bbd8-86d89261683c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:03.970831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1022/2024] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:53:03 2022] PUT /identity/v3/projects/0a6bd726101c43b6911e48025cc69c04/users/a764eebcb73143b5981cc7255f57d028/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:03.970831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b230f6-7a69-499f-8005-aa7e9ed07c01 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:03.970831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b230f6-7a69-499f-8005-aa7e9ed07c01 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:03.970831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b230f6-7a69-499f-8005-aa7e9ed07c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:03.971259 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f00d1c29-a6fe-494e-8c89-42079160fff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd004c76b0edc4b168ad0bc2c53567a62', 'request_id': 'req-f00d1c29-a6fe-494e-8c89-42079160fff7'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:03.973494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f00d1c29-a6fe-494e-8c89-42079160fff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd004c76b0edc4b168ad0bc2c53567a62', 'request_id': 'req-f00d1c29-a6fe-494e-8c89-42079160fff7'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:03.976521 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:03.989345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f00d1c29-a6fe-494e-8c89-42079160fff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd004c76b0edc4b168ad0bc2c53567a62', 'request_id': 'req-f00d1c29-a6fe-494e-8c89-42079160fff7'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:03.990531 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-91b230f6-7a69-499f-8005-aa7e9ed07c01 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:03.992905 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-91b230f6-7a69-499f-8005-aa7e9ed07c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:04.008193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f00d1c29-a6fe-494e-8c89-42079160fff7 admin admin] The token cache is being invalidate because project d004c76b0edc4b168ad0bc2c53567a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:53:04.008725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f00d1c29-a6fe-494e-8c89-42079160fff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:04.009362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f00d1c29-a6fe-494e-8c89-42079160fff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:04.011734 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1003/2025] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:53:03 2022] DELETE /identity/v3/projects/d004c76b0edc4b168ad0bc2c53567a62 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:04.013403 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a5c2e-98b6-49d4-86b6-5efa59ce8e5c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:04.013895 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a5c2e-98b6-49d4-86b6-5efa59ce8e5c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:04.014232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a5c2e-98b6-49d4-86b6-5efa59ce8e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:04.061315 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-798a5c2e-98b6-49d4-86b6-5efa59ce8e5c None None] MFA Rules not processed for user `a764eebcb73143b5981cc7255f57d028`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:04.066880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-798a5c2e-98b6-49d4-86b6-5efa59ce8e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:04.100577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:04.127923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1023/2026] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:04.129200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b230f6-7a69-499f-8005-aa7e9ed07c01 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:04.130832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-91b230f6-7a69-499f-8005-aa7e9ed07c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:04.144753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b230f6-7a69-499f-8005-aa7e9ed07c01 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:04.150547 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62df320-8cdf-4a14-a5f5-d5cdd73da80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:04.151204 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62df320-8cdf-4a14-a5f5-d5cdd73da80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:04.151488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62df320-8cdf-4a14-a5f5-d5cdd73da80e admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:04.151766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62df320-8cdf-4a14-a5f5-d5cdd73da80e admin admin] PATH_INFO: `/v3/users/154cf2858d52469294d2ba47a30c2515` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:04.153144 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62df320-8cdf-4a14-a5f5-d5cdd73da80e admin admin] RBAC: Authorizing `identity:delete_user(user_id=154cf2858d52469294d2ba47a30c2515)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:04.155091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62df320-8cdf-4a14-a5f5-d5cdd73da80e admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:04.192222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1004/2027] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:04.195324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a5c2e-98b6-49d4-86b6-5efa59ce8e5c None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:04.224380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a5c2e-98b6-49d4-86b6-5efa59ce8e5c None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:04.238104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f6eba-650c-4daa-8ecd-ae5d17382d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:04.238104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f6eba-650c-4daa-8ecd-ae5d17382d59 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:04.238413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f6eba-650c-4daa-8ecd-ae5d17382d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:04.238885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f6eba-650c-4daa-8ecd-ae5d17382d59 admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:04.239557 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f6eba-650c-4daa-8ecd-ae5d17382d59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:53:04.239866 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f6eba-650c-4daa-8ecd-ae5d17382d59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:04.245973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f6eba-650c-4daa-8ecd-ae5d17382d59 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:04.276813 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1005/2028] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:53:04.277799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f6eba-650c-4daa-8ecd-ae5d17382d59 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:04.282927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e62df320-8cdf-4a14-a5f5-d5cdd73da80e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154cf2858d52469294d2ba47a30c2515'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:04.283705 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b28f6eba-650c-4daa-8ecd-ae5d17382d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:04.301964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e62df320-8cdf-4a14-a5f5-d5cdd73da80e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154cf2858d52469294d2ba47a30c2515'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:04.302929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e62df320-8cdf-4a14-a5f5-d5cdd73da80e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154cf2858d52469294d2ba47a30c2515'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:04.319527 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e62df320-8cdf-4a14-a5f5-d5cdd73da80e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154cf2858d52469294d2ba47a30c2515'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:04.365051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e62df320-8cdf-4a14-a5f5-d5cdd73da80e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154cf2858d52469294d2ba47a30c2515'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:04.374564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1024/2029] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:53:04 2022] DELETE /identity/v3/users/154cf2858d52469294d2ba47a30c2515 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:04.375582 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62df320-8cdf-4a14-a5f5-d5cdd73da80e admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:04.377702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e62df320-8cdf-4a14-a5f5-d5cdd73da80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:04.397485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f6eba-650c-4daa-8ecd-ae5d17382d59 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:04.466822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fb4f5-9b49-48b6-b8e8-03471cfac6fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:04.468016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fb4f5-9b49-48b6-b8e8-03471cfac6fa service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:04.468376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fb4f5-9b49-48b6-b8e8-03471cfac6fa service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:04.468833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fb4f5-9b49-48b6-b8e8-03471cfac6fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:04.472010 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d36fb4f5-9b49-48b6-b8e8-03471cfac6fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:04.504751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62df320-8cdf-4a14-a5f5-d5cdd73da80e admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:04.512104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239521a-7bdc-4239-98ab-8251221f2be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:04.514378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239521a-7bdc-4239-98ab-8251221f2be1 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:04.514713 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239521a-7bdc-4239-98ab-8251221f2be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:04.515758 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239521a-7bdc-4239-98ab-8251221f2be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:04.516663 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239521a-7bdc-4239-98ab-8251221f2be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:04.520084 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239521a-7bdc-4239-98ab-8251221f2be1 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:04.526468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:04.595337 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fb4f5-9b49-48b6-b8e8-03471cfac6fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:04.599519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fb4f5-9b49-48b6-b8e8-03471cfac6fa service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:04.612828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1025/2030] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:53:04 2022] POST /identity/v3/projects => generated 369 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:53:04.617046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239521a-7bdc-4239-98ab-8251221f2be1 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:04.625238 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1006/2031] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:53:04.739758 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:04.774204 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239521a-7bdc-4239-98ab-8251221f2be1 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:04.785720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c8b92-6f6f-461b-b113-211a052f460f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:04.786658 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c8b92-6f6f-461b-b113-211a052f460f admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:04.787098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c8b92-6f6f-461b-b113-211a052f460f admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:04.787538 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c8b92-6f6f-461b-b113-211a052f460f admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:04.788667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c8b92-6f6f-461b-b113-211a052f460f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:04.790967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c8b92-6f6f-461b-b113-211a052f460f admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:04.828603 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1026/2032] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:53:04 2022] POST /identity/v3/users => generated 285 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:53:04.833015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fb4f5-9b49-48b6-b8e8-03471cfac6fa service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:04.854946 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fb4f5-9b49-48b6-b8e8-03471cfac6fa service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:04.859940 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2f8c9-ec19-46f5-9bd0-1e534b77c2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:04.860786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2f8c9-ec19-46f5-9bd0-1e534b77c2fc admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:04.861101 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2f8c9-ec19-46f5-9bd0-1e534b77c2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:04.861377 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2f8c9-ec19-46f5-9bd0-1e534b77c2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:04.862171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2f8c9-ec19-46f5-9bd0-1e534b77c2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:04.863809 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2f8c9-ec19-46f5-9bd0-1e534b77c2fc admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:04.875556 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1007/2033] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:53:04.879646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c8b92-6f6f-461b-b113-211a052f460f admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:04.891949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2f8c9-ec19-46f5-9bd0-1e534b77c2fc admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:04.894079 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-cbe2f8c9-ec19-46f5-9bd0-1e534b77c2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:04.898397 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c8b92-6f6f-461b-b113-211a052f460f admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:04.905321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9baf3f-a6e3-4b17-acd0-34e13aedf97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:04.910028 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9baf3f-a6e3-4b17-acd0-34e13aedf97b admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:04.910332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9baf3f-a6e3-4b17-acd0-34e13aedf97b admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:04.910612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9baf3f-a6e3-4b17-acd0-34e13aedf97b admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:04.914270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9baf3f-a6e3-4b17-acd0-34e13aedf97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:04.920135 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9baf3f-a6e3-4b17-acd0-34e13aedf97b admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:04.926916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2f8c9-ec19-46f5-9bd0-1e534b77c2fc admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:04.934253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3d6e4-bc93-441b-8466-d30768532147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:04.937924 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1027/2034] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:53:04.939132 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3d6e4-bc93-441b-8466-d30768532147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:04.939590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3d6e4-bc93-441b-8466-d30768532147 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:04.939875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3d6e4-bc93-441b-8466-d30768532147 admin admin] PATH_INFO: `/v3/projects/e02b01917ba4411692ca64633f3442a5` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:04.939993 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9baf3f-a6e3-4b17-acd0-34e13aedf97b admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:04.941175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3d6e4-bc93-441b-8466-d30768532147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e02b01917ba4411692ca64633f3442a5)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:04.943237 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3d6e4-bc93-441b-8466-d30768532147 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:04.952823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9baf3f-a6e3-4b17-acd0-34e13aedf97b admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:04.960276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b777e-830f-418b-9147-d38a6b263947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:04.961002 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b777e-830f-418b-9147-d38a6b263947 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:04.961320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b777e-830f-418b-9147-d38a6b263947 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:04.962158 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b777e-830f-418b-9147-d38a6b263947 admin admin] PATH_INFO: `/v3/projects/87b3126b021d42d6bbd2e913755bd8ee/users/e446942f69f1467f81a57a295bb00cbf/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:04.984490 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b777e-830f-418b-9147-d38a6b263947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b3126b021d42d6bbd2e913755bd8ee, user_id=e446942f69f1467f81a57a295bb00cbf, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:04.987768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b777e-830f-418b-9147-d38a6b263947 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:05.006340 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1028/2035] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:53:04 2022] PUT /identity/v3/projects/87b3126b021d42d6bbd2e913755bd8ee/users/e446942f69f1467f81a57a295bb00cbf/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:53:05.013644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f4b3d6e4-bc93-441b-8466-d30768532147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e02b01917ba4411692ca64633f3442a5', 'request_id': 'req-f4b3d6e4-bc93-441b-8466-d30768532147'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:05.017400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b793d6-e941-4c6d-bcd0-df7e883623bd None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:05.017681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b793d6-e941-4c6d-bcd0-df7e883623bd None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:05.018608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b793d6-e941-4c6d-bcd0-df7e883623bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:05.050866 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f4b3d6e4-bc93-441b-8466-d30768532147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e02b01917ba4411692ca64633f3442a5', 'request_id': 'req-f4b3d6e4-bc93-441b-8466-d30768532147'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:05.072719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f4b3d6e4-bc93-441b-8466-d30768532147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e02b01917ba4411692ca64633f3442a5', 'request_id': 'req-f4b3d6e4-bc93-441b-8466-d30768532147'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:05.092152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f4b3d6e4-bc93-441b-8466-d30768532147 admin admin] The token cache is being invalidate because project e02b01917ba4411692ca64633f3442a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:53:05.092619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f4b3d6e4-bc93-441b-8466-d30768532147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:05.093338 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f4b3d6e4-bc93-441b-8466-d30768532147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:05.095894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1008/2036] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:53:04 2022] DELETE /identity/v3/projects/e02b01917ba4411692ca64633f3442a5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:05.101192 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49401d05-74c5-4345-af85-5a5a0e03f9f3 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:05.102362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49401d05-74c5-4345-af85-5a5a0e03f9f3 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:05.102939 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49401d05-74c5-4345-af85-5a5a0e03f9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:05.107811 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-05b793d6-e941-4c6d-bcd0-df7e883623bd None None] MFA Rules not processed for user `e446942f69f1467f81a57a295bb00cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:05.109097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-05b793d6-e941-4c6d-bcd0-df7e883623bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:05.134011 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-49401d05-74c5-4345-af85-5a5a0e03f9f3 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:05.135590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-49401d05-74c5-4345-af85-5a5a0e03f9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:05.215163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1009/2037] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:53:05.220519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1029/2038] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:53:05.225286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628a35f-5e9c-4dbd-8245-ab493a4a3761 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:05.225731 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628a35f-5e9c-4dbd-8245-ab493a4a3761 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:05.226243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628a35f-5e9c-4dbd-8245-ab493a4a3761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:05.232403 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b793d6-e941-4c6d-bcd0-df7e883623bd None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:05.234572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-05b793d6-e941-4c6d-bcd0-df7e883623bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:05.255187 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-e628a35f-5e9c-4dbd-8245-ab493a4a3761 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:05.257340 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-e628a35f-5e9c-4dbd-8245-ab493a4a3761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:05.267002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1010/2039] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:05.271030 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628a35f-5e9c-4dbd-8245-ab493a4a3761 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:05.282821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628a35f-5e9c-4dbd-8245-ab493a4a3761 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:05.287963 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c548a-9fe1-4d71-8d74-a6a6b511392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:05.288579 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c548a-9fe1-4d71-8d74-a6a6b511392a admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:05.289664 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c548a-9fe1-4d71-8d74-a6a6b511392a admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:05.289951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c548a-9fe1-4d71-8d74-a6a6b511392a admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:05.290610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c548a-9fe1-4d71-8d74-a6a6b511392a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:53:05.290915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c548a-9fe1-4d71-8d74-a6a6b511392a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:05.293139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c548a-9fe1-4d71-8d74-a6a6b511392a admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:05.306794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1011/2040] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:53:05.310835 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b793d6-e941-4c6d-bcd0-df7e883623bd None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:05.311138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c548a-9fe1-4d71-8d74-a6a6b511392a admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:05.314774 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17c1a0-538a-4838-a7bb-22bccb744f60 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fde38c1a2a844368acd3e1b9aa10151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:05.315507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17c1a0-538a-4838-a7bb-22bccb744f60 service glance] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:05.316110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17c1a0-538a-4838-a7bb-22bccb744f60 service glance] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:05.316485 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17c1a0-538a-4838-a7bb-22bccb744f60 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:05.320967 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c548a-9fe1-4d71-8d74-a6a6b511392a admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:05.326429 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc70e5-775e-4e68-8482-1ad84c6a1182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:05.327035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc70e5-775e-4e68-8482-1ad84c6a1182 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:05.327318 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc70e5-775e-4e68-8482-1ad84c6a1182 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:05.327593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc70e5-775e-4e68-8482-1ad84c6a1182 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:05.328295 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17c1a0-538a-4838-a7bb-22bccb744f60 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:05.328427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc70e5-775e-4e68-8482-1ad84c6a1182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:05.330174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc70e5-775e-4e68-8482-1ad84c6a1182 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:05.330690 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17c1a0-538a-4838-a7bb-22bccb744f60 service glance] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:05.344391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1030/2041] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:53:05.355054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:05.368562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1012/2042] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:53:05 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:53:05.373253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17c1a0-538a-4838-a7bb-22bccb744f60 service glance] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:05.386956 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17c1a0-538a-4838-a7bb-22bccb744f60 service glance] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:05.435257 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:05.473365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98baed0-2d79-4762-891c-f769fc5f61d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:05.474195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98baed0-2d79-4762-891c-f769fc5f61d5 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:05.474547 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98baed0-2d79-4762-891c-f769fc5f61d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:05.474890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98baed0-2d79-4762-891c-f769fc5f61d5 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:05.475584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98baed0-2d79-4762-891c-f769fc5f61d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:05.478185 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98baed0-2d79-4762-891c-f769fc5f61d5 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:05.517608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1031/2043] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:53:05 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:53:05.521711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc70e5-775e-4e68-8482-1ad84c6a1182 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:05.535026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc70e5-775e-4e68-8482-1ad84c6a1182 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:05.541164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d7235-194a-4960-b349-89b65f1ae10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:05.541778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d7235-194a-4960-b349-89b65f1ae10c admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:05.542056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d7235-194a-4960-b349-89b65f1ae10c admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:05.542327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d7235-194a-4960-b349-89b65f1ae10c admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:05.542999 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d7235-194a-4960-b349-89b65f1ae10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:05.545313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d7235-194a-4960-b349-89b65f1ae10c admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:05.561042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1013/2044] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:53:05.562423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98baed0-2d79-4762-891c-f769fc5f61d5 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:05.575047 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98baed0-2d79-4762-891c-f769fc5f61d5 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:05.582090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24aa0b-fe95-4c55-9488-3ac372027f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:05.582743 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24aa0b-fe95-4c55-9488-3ac372027f9e admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:05.583930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24aa0b-fe95-4c55-9488-3ac372027f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:05.583930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24aa0b-fe95-4c55-9488-3ac372027f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:05.584383 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24aa0b-fe95-4c55-9488-3ac372027f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:05.586155 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24aa0b-fe95-4c55-9488-3ac372027f9e admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:05.605524 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1032/2045] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:53:05.609782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d7235-194a-4960-b349-89b65f1ae10c admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:05.621987 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d7235-194a-4960-b349-89b65f1ae10c admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:05.627468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6e9bb-a36e-43fc-a63b-8518474d1ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:05.628175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6e9bb-a36e-43fc-a63b-8518474d1ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:05.628510 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6e9bb-a36e-43fc-a63b-8518474d1ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:05.628798 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6e9bb-a36e-43fc-a63b-8518474d1ab2 admin admin] PATH_INFO: `/v3/projects/2d78ca7540bf41a68f78757675eaf4a5/users/26608cd0888f40f88b33e76912271d84/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:05.650387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6e9bb-a36e-43fc-a63b-8518474d1ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d78ca7540bf41a68f78757675eaf4a5, user_id=26608cd0888f40f88b33e76912271d84, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:05.654549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6e9bb-a36e-43fc-a63b-8518474d1ab2 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:05.670382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1014/2046] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:53:05 2022] PUT /identity/v3/projects/2d78ca7540bf41a68f78757675eaf4a5/users/26608cd0888f40f88b33e76912271d84/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:05.682659 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a586-4012-4cfc-a2b3-24b4eec4c5bb None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:05.682949 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a586-4012-4cfc-a2b3-24b4eec4c5bb None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:05.683258 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a586-4012-4cfc-a2b3-24b4eec4c5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:05.711616 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-5e63a586-4012-4cfc-a2b3-24b4eec4c5bb None None] MFA Rules not processed for user `26608cd0888f40f88b33e76912271d84`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:05.712850 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-5e63a586-4012-4cfc-a2b3-24b4eec4c5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:05.792942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1033/2047] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:05.797287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6e9bb-a36e-43fc-a63b-8518474d1ab2 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:05.889416 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6e9bb-a36e-43fc-a63b-8518474d1ab2 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:05.898636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0e611-7225-4415-ab37-b69c7d7934b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:05.900644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0e611-7225-4415-ab37-b69c7d7934b0 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:05.900644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0e611-7225-4415-ab37-b69c7d7934b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:05.900644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0e611-7225-4415-ab37-b69c7d7934b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:05.900644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0e611-7225-4415-ab37-b69c7d7934b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:05.902497 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0e611-7225-4415-ab37-b69c7d7934b0 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:05.933568 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1015/2048] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:53:05 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:53:05.937585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63a586-4012-4cfc-a2b3-24b4eec4c5bb None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:05.950890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63a586-4012-4cfc-a2b3-24b4eec4c5bb None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:06.030716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99440dad-7a23-4b53-aebf-b038b94ce559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:06.031491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99440dad-7a23-4b53-aebf-b038b94ce559 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:06.031946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99440dad-7a23-4b53-aebf-b038b94ce559 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:06.032240 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99440dad-7a23-4b53-aebf-b038b94ce559 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:06.032935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99440dad-7a23-4b53-aebf-b038b94ce559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:06.035107 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99440dad-7a23-4b53-aebf-b038b94ce559 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:06.062737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0e611-7225-4415-ab37-b69c7d7934b0 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:06.064270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1034/2049] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:53:05 2022] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:53:06.077448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0e611-7225-4415-ab37-b69c7d7934b0 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:06.102728 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87478f7f-09c2-4e9c-af54-5689d43a39f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:06.103378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87478f7f-09c2-4e9c-af54-5689d43a39f0 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:06.103662 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87478f7f-09c2-4e9c-af54-5689d43a39f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:06.103939 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87478f7f-09c2-4e9c-af54-5689d43a39f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:06.104612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87478f7f-09c2-4e9c-af54-5689d43a39f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:06.106308 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87478f7f-09c2-4e9c-af54-5689d43a39f0 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:06.121061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1016/2050] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:53:06.123810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99440dad-7a23-4b53-aebf-b038b94ce559 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:06.153286 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99440dad-7a23-4b53-aebf-b038b94ce559 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:06.176346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5601226-7194-4359-8b03-50f068912908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:06.177109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5601226-7194-4359-8b03-50f068912908 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:06.177377 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5601226-7194-4359-8b03-50f068912908 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:06.177684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5601226-7194-4359-8b03-50f068912908 admin admin] PATH_INFO: `/v3/projects/15449304d2a84e33bd5edc973cd3e3ab/users/19ed8d76ac6e4bca8b3ccd2a52532f98/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:06.203004 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5601226-7194-4359-8b03-50f068912908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15449304d2a84e33bd5edc973cd3e3ab, user_id=19ed8d76ac6e4bca8b3ccd2a52532f98, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:06.206677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5601226-7194-4359-8b03-50f068912908 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:06.241041 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1035/2051] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:53:06 2022] PUT /identity/v3/projects/15449304d2a84e33bd5edc973cd3e3ab/users/19ed8d76ac6e4bca8b3ccd2a52532f98/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:53:06.243956 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87478f7f-09c2-4e9c-af54-5689d43a39f0 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:06.258438 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87478f7f-09c2-4e9c-af54-5689d43a39f0 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:06.366009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bcb88-d4a7-4fa7-ad2c-79d4a48d16aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:06.366665 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bcb88-d4a7-4fa7-ad2c-79d4a48d16aa admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:06.373375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bcb88-d4a7-4fa7-ad2c-79d4a48d16aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:06.373735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bcb88-d4a7-4fa7-ad2c-79d4a48d16aa admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:06.374847 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bcb88-d4a7-4fa7-ad2c-79d4a48d16aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:06.380400 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bcb88-d4a7-4fa7-ad2c-79d4a48d16aa admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:06.405851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1017/2052] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:53:06.406124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5601226-7194-4359-8b03-50f068912908 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:06.413726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:06.419920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5601226-7194-4359-8b03-50f068912908 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:06.427418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25749ee2-a140-48e9-a22f-794ea9314b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:06.428269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25749ee2-a140-48e9-a22f-794ea9314b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:06.428868 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25749ee2-a140-48e9-a22f-794ea9314b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:06.429242 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25749ee2-a140-48e9-a22f-794ea9314b72 admin admin] PATH_INFO: `/v3/projects/15449304d2a84e33bd5edc973cd3e3ab/users/19ed8d76ac6e4bca8b3ccd2a52532f98/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:06.431891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25749ee2-a140-48e9-a22f-794ea9314b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15449304d2a84e33bd5edc973cd3e3ab, user_id=19ed8d76ac6e4bca8b3ccd2a52532f98, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:06.434748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25749ee2-a140-48e9-a22f-794ea9314b72 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:06.450606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1036/2053] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:53:06 2022] PUT /identity/v3/projects/15449304d2a84e33bd5edc973cd3e3ab/users/19ed8d76ac6e4bca8b3ccd2a52532f98/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:06.461894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce37140-060f-4f63-bb06-31fdc776bf43 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:06.462197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce37140-060f-4f63-bb06-31fdc776bf43 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:06.462480 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce37140-060f-4f63-bb06-31fdc776bf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:06.495801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-bce37140-060f-4f63-bb06-31fdc776bf43 None None] MFA Rules not processed for user `19ed8d76ac6e4bca8b3ccd2a52532f98`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:06.497112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-bce37140-060f-4f63-bb06-31fdc776bf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:06.524804 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:06.597038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1018/2054] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:06.608168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25749ee2-a140-48e9-a22f-794ea9314b72 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:06.614275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-25749ee2-a140-48e9-a22f-794ea9314b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:06.686625 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25749ee2-a140-48e9-a22f-794ea9314b72 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:06.690780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f9bbd-6ddf-4caf-a0fd-702c28ed456f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:06.691551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f9bbd-6ddf-4caf-a0fd-702c28ed456f service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:06.691870 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f9bbd-6ddf-4caf-a0fd-702c28ed456f service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:06.692148 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f9bbd-6ddf-4caf-a0fd-702c28ed456f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:06.757895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f9bbd-6ddf-4caf-a0fd-702c28ed456f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:06.759364 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f9bbd-6ddf-4caf-a0fd-702c28ed456f service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:06.769185 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1037/2055] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:53:07.543940 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce37140-060f-4f63-bb06-31fdc776bf43 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:07.545490 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-bce37140-060f-4f63-bb06-31fdc776bf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:07.625281 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce37140-060f-4f63-bb06-31fdc776bf43 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:07.633692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b7945-f45a-4ac3-aca6-76f850845435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:07.634445 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b7945-f45a-4ac3-aca6-76f850845435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:07.634738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b7945-f45a-4ac3-aca6-76f850845435 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:07.635028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b7945-f45a-4ac3-aca6-76f850845435 admin admin] PATH_INFO: `/v3/users/624d56714534457d8df7c3a5b6ecf483` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:07.636576 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b7945-f45a-4ac3-aca6-76f850845435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=624d56714534457d8df7c3a5b6ecf483)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:07.638686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b7945-f45a-4ac3-aca6-76f850845435 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:07.697151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7f1b7945-f45a-4ac3-aca6-76f850845435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624d56714534457d8df7c3a5b6ecf483'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:07.705406 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7f1b7945-f45a-4ac3-aca6-76f850845435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624d56714534457d8df7c3a5b6ecf483'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:07.706174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7f1b7945-f45a-4ac3-aca6-76f850845435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624d56714534457d8df7c3a5b6ecf483'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:07.706806 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7f1b7945-f45a-4ac3-aca6-76f850845435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624d56714534457d8df7c3a5b6ecf483'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:07.718595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7f1b7945-f45a-4ac3-aca6-76f850845435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624d56714534457d8df7c3a5b6ecf483'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:07.744114 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1019/2056] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:53:07 2022] DELETE /identity/v3/users/624d56714534457d8df7c3a5b6ecf483 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:07.748725 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582cee6-2f04-4d14-87a3-d5ef0ac79e72 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:07.751186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582cee6-2f04-4d14-87a3-d5ef0ac79e72 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:07.751186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582cee6-2f04-4d14-87a3-d5ef0ac79e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:07.769668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0582cee6-2f04-4d14-87a3-d5ef0ac79e72 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:07.771288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0582cee6-2f04-4d14-87a3-d5ef0ac79e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:07.839677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1038/2057] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:07.850329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b7945-f45a-4ac3-aca6-76f850845435 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:07.851988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7f1b7945-f45a-4ac3-aca6-76f850845435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:07.896729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:07.913770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b7945-f45a-4ac3-aca6-76f850845435 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:07.917971 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75661c-b77e-45b0-8cd7-14cd60b7c886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:07.918649 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75661c-b77e-45b0-8cd7-14cd60b7c886 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:07.919033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75661c-b77e-45b0-8cd7-14cd60b7c886 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:07.919338 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75661c-b77e-45b0-8cd7-14cd60b7c886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:07.929209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75661c-b77e-45b0-8cd7-14cd60b7c886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:07.930660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75661c-b77e-45b0-8cd7-14cd60b7c886 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:07.940448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1020/2058] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:53:08.345166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582cee6-2f04-4d14-87a3-d5ef0ac79e72 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:08.348018 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0582cee6-2f04-4d14-87a3-d5ef0ac79e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:08.377779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582cee6-2f04-4d14-87a3-d5ef0ac79e72 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:08.383465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6c076-63bf-432a-be1b-e36ca96b77d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:08.384094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6c076-63bf-432a-be1b-e36ca96b77d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:08.384387 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6c076-63bf-432a-be1b-e36ca96b77d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:08.384872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6c076-63bf-432a-be1b-e36ca96b77d6 admin admin] PATH_INFO: `/v3/projects/e8453efd8b2d4be0b255d91d0ffd9e81` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:08.386668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6c076-63bf-432a-be1b-e36ca96b77d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8453efd8b2d4be0b255d91d0ffd9e81)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:08.388585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6c076-63bf-432a-be1b-e36ca96b77d6 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:08.446095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:08.455428 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b0d6c076-63bf-432a-be1b-e36ca96b77d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8453efd8b2d4be0b255d91d0ffd9e81', 'request_id': 'req-b0d6c076-63bf-432a-be1b-e36ca96b77d6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:08.465714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b0d6c076-63bf-432a-be1b-e36ca96b77d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8453efd8b2d4be0b255d91d0ffd9e81', 'request_id': 'req-b0d6c076-63bf-432a-be1b-e36ca96b77d6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:08.478172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b0d6c076-63bf-432a-be1b-e36ca96b77d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8453efd8b2d4be0b255d91d0ffd9e81', 'request_id': 'req-b0d6c076-63bf-432a-be1b-e36ca96b77d6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:08.491377 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b0d6c076-63bf-432a-be1b-e36ca96b77d6 admin admin] The token cache is being invalidate because project e8453efd8b2d4be0b255d91d0ffd9e81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:53:08.491672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b0d6c076-63bf-432a-be1b-e36ca96b77d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:08.492384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b0d6c076-63bf-432a-be1b-e36ca96b77d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:08.494141 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1039/2059] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:53:08 2022] DELETE /identity/v3/projects/e8453efd8b2d4be0b255d91d0ffd9e81 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:08.498417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75661c-b77e-45b0-8cd7-14cd60b7c886 service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:08.511222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75661c-b77e-45b0-8cd7-14cd60b7c886 service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:08.598497 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ac52b-abea-4676-bbcf-f956eaf42bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:08.599250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ac52b-abea-4676-bbcf-f956eaf42bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:08.599438 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ac52b-abea-4676-bbcf-f956eaf42bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:08.600412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ac52b-abea-4676-bbcf-f956eaf42bdd admin admin] PATH_INFO: `/v3/users/a764eebcb73143b5981cc7255f57d028` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:08.601197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ac52b-abea-4676-bbcf-f956eaf42bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a764eebcb73143b5981cc7255f57d028)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:08.603454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ac52b-abea-4676-bbcf-f956eaf42bdd admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:08.660415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8c0ac52b-abea-4676-bbcf-f956eaf42bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a764eebcb73143b5981cc7255f57d028'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:08.677632 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8c0ac52b-abea-4676-bbcf-f956eaf42bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a764eebcb73143b5981cc7255f57d028'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:08.678450 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8c0ac52b-abea-4676-bbcf-f956eaf42bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a764eebcb73143b5981cc7255f57d028'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:08.679232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8c0ac52b-abea-4676-bbcf-f956eaf42bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a764eebcb73143b5981cc7255f57d028'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:08.697256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8c0ac52b-abea-4676-bbcf-f956eaf42bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a764eebcb73143b5981cc7255f57d028'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:08.716721 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1021/2060] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:53:08 2022] DELETE /identity/v3/users/a764eebcb73143b5981cc7255f57d028 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:09.074406 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6c076-63bf-432a-be1b-e36ca96b77d6 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:09.076488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b0d6c076-63bf-432a-be1b-e36ca96b77d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:09.090834 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6c076-63bf-432a-be1b-e36ca96b77d6 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:09.150072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4115c4d-b6db-4de9-a379-2a75bf39dfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:09.150705 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4115c4d-b6db-4de9-a379-2a75bf39dfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:09.150985 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4115c4d-b6db-4de9-a379-2a75bf39dfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:09.151258 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4115c4d-b6db-4de9-a379-2a75bf39dfaf admin admin] PATH_INFO: `/v3/projects/0a6bd726101c43b6911e48025cc69c04` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:09.152412 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4115c4d-b6db-4de9-a379-2a75bf39dfaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6bd726101c43b6911e48025cc69c04)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:09.154347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4115c4d-b6db-4de9-a379-2a75bf39dfaf admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:09.203418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e4115c4d-b6db-4de9-a379-2a75bf39dfaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6bd726101c43b6911e48025cc69c04', 'request_id': 'req-e4115c4d-b6db-4de9-a379-2a75bf39dfaf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:09.209935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e4115c4d-b6db-4de9-a379-2a75bf39dfaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6bd726101c43b6911e48025cc69c04', 'request_id': 'req-e4115c4d-b6db-4de9-a379-2a75bf39dfaf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:09.218688 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e4115c4d-b6db-4de9-a379-2a75bf39dfaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6bd726101c43b6911e48025cc69c04', 'request_id': 'req-e4115c4d-b6db-4de9-a379-2a75bf39dfaf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:09.229982 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e4115c4d-b6db-4de9-a379-2a75bf39dfaf admin admin] The token cache is being invalidate because project 0a6bd726101c43b6911e48025cc69c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:53:09.230312 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e4115c4d-b6db-4de9-a379-2a75bf39dfaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:09.230970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e4115c4d-b6db-4de9-a379-2a75bf39dfaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:09.232465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1040/2061] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:53:09 2022] DELETE /identity/v3/projects/0a6bd726101c43b6911e48025cc69c04 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:09.238040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03726a6-077b-4233-a6cb-1a26f3a5cf59 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:09.238331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03726a6-077b-4233-a6cb-1a26f3a5cf59 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:09.238604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03726a6-077b-4233-a6cb-1a26f3a5cf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:09.261481 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-e03726a6-077b-4233-a6cb-1a26f3a5cf59 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:09.262687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-e03726a6-077b-4233-a6cb-1a26f3a5cf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:09.313725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:09.323286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1022/2062] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:09.331572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc209575-5f06-4280-8a09-70a4250317a7 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:09.331942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc209575-5f06-4280-8a09-70a4250317a7 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:09.332402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc209575-5f06-4280-8a09-70a4250317a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:09.356379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-bc209575-5f06-4280-8a09-70a4250317a7 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:09.357660 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-bc209575-5f06-4280-8a09-70a4250317a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:09.366415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1041/2063] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:09.370772 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03726a6-077b-4233-a6cb-1a26f3a5cf59 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:09.380803 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03726a6-077b-4233-a6cb-1a26f3a5cf59 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:09.386004 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734dd39-a0d6-49fc-8003-0bf396e6154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:09.386631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734dd39-a0d6-49fc-8003-0bf396e6154e admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:09.386914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734dd39-a0d6-49fc-8003-0bf396e6154e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:09.387189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734dd39-a0d6-49fc-8003-0bf396e6154e admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:09.387880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734dd39-a0d6-49fc-8003-0bf396e6154e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:53:09.388184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734dd39-a0d6-49fc-8003-0bf396e6154e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:09.389822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734dd39-a0d6-49fc-8003-0bf396e6154e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:09.408064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1023/2064] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:53:09.412024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc209575-5f06-4280-8a09-70a4250317a7 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:09.421400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc209575-5f06-4280-8a09-70a4250317a7 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:09.426211 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599fafd-bd9a-4c45-84b3-e47dca4ef22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:09.426813 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599fafd-bd9a-4c45-84b3-e47dca4ef22c admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:09.427097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599fafd-bd9a-4c45-84b3-e47dca4ef22c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:09.427372 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599fafd-bd9a-4c45-84b3-e47dca4ef22c admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:09.428030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599fafd-bd9a-4c45-84b3-e47dca4ef22c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:09.429979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599fafd-bd9a-4c45-84b3-e47dca4ef22c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:09.460601 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1042/2065] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:53:09 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:53:09.464719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734dd39-a0d6-49fc-8003-0bf396e6154e admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:09.475553 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734dd39-a0d6-49fc-8003-0bf396e6154e admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:09.536039 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239268a-160e-481f-9aab-42c4b44994cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:09.536662 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239268a-160e-481f-9aab-42c4b44994cd admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:09.536951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239268a-160e-481f-9aab-42c4b44994cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:09.537261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239268a-160e-481f-9aab-42c4b44994cd admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:09.537900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239268a-160e-481f-9aab-42c4b44994cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:09.539838 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239268a-160e-481f-9aab-42c4b44994cd admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:09.559476 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1024/2066] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:53:09 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:53:09.563500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599fafd-bd9a-4c45-84b3-e47dca4ef22c admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:09.574722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599fafd-bd9a-4c45-84b3-e47dca4ef22c admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:09.580148 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de65e4d-7e3e-404d-b767-9e8f1b56363e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:09.581330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de65e4d-7e3e-404d-b767-9e8f1b56363e admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:09.581330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de65e4d-7e3e-404d-b767-9e8f1b56363e admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:09.581330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de65e4d-7e3e-404d-b767-9e8f1b56363e admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:09.581970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de65e4d-7e3e-404d-b767-9e8f1b56363e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:09.583627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de65e4d-7e3e-404d-b767-9e8f1b56363e admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:09.595556 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1043/2067] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:53:09.599589 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239268a-160e-481f-9aab-42c4b44994cd admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:09.609696 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239268a-160e-481f-9aab-42c4b44994cd admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:09.614612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4f5a3-c012-4410-813e-16b855f03014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:09.615234 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4f5a3-c012-4410-813e-16b855f03014 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:09.615518 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4f5a3-c012-4410-813e-16b855f03014 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:09.615795 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4f5a3-c012-4410-813e-16b855f03014 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:09.616446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4f5a3-c012-4410-813e-16b855f03014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:09.618088 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4f5a3-c012-4410-813e-16b855f03014 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:09.629718 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1025/2068] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:53:09.633757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de65e4d-7e3e-404d-b767-9e8f1b56363e admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:09.644101 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de65e4d-7e3e-404d-b767-9e8f1b56363e admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:09.649011 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb25375-016c-41f1-ac9e-8c81936ab1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:09.649666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb25375-016c-41f1-ac9e-8c81936ab1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:09.649949 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb25375-016c-41f1-ac9e-8c81936ab1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:09.650227 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb25375-016c-41f1-ac9e-8c81936ab1eb admin admin] PATH_INFO: `/v3/projects/117f92cf7c5946c293c97d716df51b38/users/d2248a68c1744d0a964d0c0a63d91248/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:09.665633 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb25375-016c-41f1-ac9e-8c81936ab1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=117f92cf7c5946c293c97d716df51b38, user_id=d2248a68c1744d0a964d0c0a63d91248, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:09.668350 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb25375-016c-41f1-ac9e-8c81936ab1eb admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:09.671423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:09.682230 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1044/2069] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:53:09 2022] PUT /identity/v3/projects/117f92cf7c5946c293c97d716df51b38/users/d2248a68c1744d0a964d0c0a63d91248/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:09.694066 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab0ebb-88b3-4f62-8c14-7a8a2ce44f9c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:09.694354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab0ebb-88b3-4f62-8c14-7a8a2ce44f9c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:09.694634 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab0ebb-88b3-4f62-8c14-7a8a2ce44f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:09.722931 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-cbab0ebb-88b3-4f62-8c14-7a8a2ce44f9c None None] MFA Rules not processed for user `d2248a68c1744d0a964d0c0a63d91248`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:09.724144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-cbab0ebb-88b3-4f62-8c14-7a8a2ce44f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:09.799693 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1026/2070] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:09.811463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb25375-016c-41f1-ac9e-8c81936ab1eb admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:09.813272 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0bb25375-016c-41f1-ac9e-8c81936ab1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:09.882527 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb25375-016c-41f1-ac9e-8c81936ab1eb admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:09.886278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3db7d-058b-4a2a-9217-e3141c1fede7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:09.886904 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3db7d-058b-4a2a-9217-e3141c1fede7 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:09.887193 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3db7d-058b-4a2a-9217-e3141c1fede7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:09.887502 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3db7d-058b-4a2a-9217-e3141c1fede7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:09.898170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3db7d-058b-4a2a-9217-e3141c1fede7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:09.899766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3db7d-058b-4a2a-9217-e3141c1fede7 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:09.911606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1045/2071] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:53:11.426774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab0ebb-88b3-4f62-8c14-7a8a2ce44f9c None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:11.428724 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-cbab0ebb-88b3-4f62-8c14-7a8a2ce44f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:11.448509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab0ebb-88b3-4f62-8c14-7a8a2ce44f9c None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:11.453038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7865b-4599-47c6-a597-b6dd453611a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:11.454379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7865b-4599-47c6-a597-b6dd453611a5 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:11.455158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7865b-4599-47c6-a597-b6dd453611a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:11.455158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7865b-4599-47c6-a597-b6dd453611a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:11.457141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-34a7865b-4599-47c6-a597-b6dd453611a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:11.525136 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:11.544213 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7865b-4599-47c6-a597-b6dd453611a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:11.546151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7865b-4599-47c6-a597-b6dd453611a5 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:11.558814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1027/2072] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:53:16.567602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3db7d-058b-4a2a-9217-e3141c1fede7 service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:16.569123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-97b3db7d-058b-4a2a-9217-e3141c1fede7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:16.648444 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3db7d-058b-4a2a-9217-e3141c1fede7 service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:16.656347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708d493-14cb-4f50-8369-ab5373951f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:16.657793 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708d493-14cb-4f50-8369-ab5373951f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:16.658212 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708d493-14cb-4f50-8369-ab5373951f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:16.658540 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708d493-14cb-4f50-8369-ab5373951f82 admin admin] PATH_INFO: `/v3/users/26608cd0888f40f88b33e76912271d84` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:16.659898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708d493-14cb-4f50-8369-ab5373951f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26608cd0888f40f88b33e76912271d84)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:16.662176 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708d493-14cb-4f50-8369-ab5373951f82 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:16.732520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b708d493-14cb-4f50-8369-ab5373951f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26608cd0888f40f88b33e76912271d84'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:16.753030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b708d493-14cb-4f50-8369-ab5373951f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26608cd0888f40f88b33e76912271d84'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:16.753767 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b708d493-14cb-4f50-8369-ab5373951f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26608cd0888f40f88b33e76912271d84'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:16.769487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b708d493-14cb-4f50-8369-ab5373951f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26608cd0888f40f88b33e76912271d84'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:16.775385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b708d493-14cb-4f50-8369-ab5373951f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26608cd0888f40f88b33e76912271d84'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:16.781559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1046/2073] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:53:16 2022] DELETE /identity/v3/users/26608cd0888f40f88b33e76912271d84 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:53:16.786379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b11c11-61ce-497b-8929-5723baa9478e None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:16.786864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b11c11-61ce-497b-8929-5723baa9478e None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:16.786958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b11c11-61ce-497b-8929-5723baa9478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:16.806974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-48b11c11-61ce-497b-8929-5723baa9478e None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:16.808185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-48b11c11-61ce-497b-8929-5723baa9478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:16.874116 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1028/2074] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:16.887191 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708d493-14cb-4f50-8369-ab5373951f82 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:16.888481 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b708d493-14cb-4f50-8369-ab5373951f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:16.914283 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:16.971880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708d493-14cb-4f50-8369-ab5373951f82 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:16.976108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58855910-307b-4432-aca1-6aaa5d0e92fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:16.976866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58855910-307b-4432-aca1-6aaa5d0e92fb service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:16.977373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58855910-307b-4432-aca1-6aaa5d0e92fb service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:16.977716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58855910-307b-4432-aca1-6aaa5d0e92fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:16.988339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58855910-307b-4432-aca1-6aaa5d0e92fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:16.989818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58855910-307b-4432-aca1-6aaa5d0e92fb service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:17.002667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1047/2075] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:53:17.357819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b11c11-61ce-497b-8929-5723baa9478e None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:17.360105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-48b11c11-61ce-497b-8929-5723baa9478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:17.375261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b11c11-61ce-497b-8929-5723baa9478e None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:17.381319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdcf7e-2653-4f23-aa8e-fbee62d32653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:17.382673 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdcf7e-2653-4f23-aa8e-fbee62d32653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:17.382962 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdcf7e-2653-4f23-aa8e-fbee62d32653 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:17.383239 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdcf7e-2653-4f23-aa8e-fbee62d32653 admin admin] PATH_INFO: `/v3/projects/2d78ca7540bf41a68f78757675eaf4a5` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:17.384508 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdcf7e-2653-4f23-aa8e-fbee62d32653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d78ca7540bf41a68f78757675eaf4a5)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:17.386652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdcf7e-2653-4f23-aa8e-fbee62d32653 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:17.435333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-49bdcf7e-2653-4f23-aa8e-fbee62d32653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d78ca7540bf41a68f78757675eaf4a5', 'request_id': 'req-49bdcf7e-2653-4f23-aa8e-fbee62d32653'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:17.442627 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-49bdcf7e-2653-4f23-aa8e-fbee62d32653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d78ca7540bf41a68f78757675eaf4a5', 'request_id': 'req-49bdcf7e-2653-4f23-aa8e-fbee62d32653'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:17.450857 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-49bdcf7e-2653-4f23-aa8e-fbee62d32653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d78ca7540bf41a68f78757675eaf4a5', 'request_id': 'req-49bdcf7e-2653-4f23-aa8e-fbee62d32653'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:17.464043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-49bdcf7e-2653-4f23-aa8e-fbee62d32653 admin admin] The token cache is being invalidate because project 2d78ca7540bf41a68f78757675eaf4a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:53:17.464335 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-49bdcf7e-2653-4f23-aa8e-fbee62d32653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:17.465038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-49bdcf7e-2653-4f23-aa8e-fbee62d32653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:17.466593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1029/2076] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:53:17 2022] DELETE /identity/v3/projects/2d78ca7540bf41a68f78757675eaf4a5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:17.471288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58855910-307b-4432-aca1-6aaa5d0e92fb service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:17.481059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58855910-307b-4432-aca1-6aaa5d0e92fb service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:17.545763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac8fd-09f7-4484-9dc7-81506863fee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:17.546453 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac8fd-09f7-4484-9dc7-81506863fee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:17.546741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac8fd-09f7-4484-9dc7-81506863fee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:17.547138 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac8fd-09f7-4484-9dc7-81506863fee8 admin admin] PATH_INFO: `/v3/users/19ed8d76ac6e4bca8b3ccd2a52532f98` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:17.549335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ac8fd-09f7-4484-9dc7-81506863fee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ed8d76ac6e4bca8b3ccd2a52532f98)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:17.550882 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ac8fd-09f7-4484-9dc7-81506863fee8 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:17.611353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-670ac8fd-09f7-4484-9dc7-81506863fee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ed8d76ac6e4bca8b3ccd2a52532f98'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:17.621319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-670ac8fd-09f7-4484-9dc7-81506863fee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ed8d76ac6e4bca8b3ccd2a52532f98'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:17.622072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-670ac8fd-09f7-4484-9dc7-81506863fee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ed8d76ac6e4bca8b3ccd2a52532f98'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:17.631093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-670ac8fd-09f7-4484-9dc7-81506863fee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ed8d76ac6e4bca8b3ccd2a52532f98'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:17.645107 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-670ac8fd-09f7-4484-9dc7-81506863fee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ed8d76ac6e4bca8b3ccd2a52532f98'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:17.651664 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1048/2077] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:53:17 2022] DELETE /identity/v3/users/19ed8d76ac6e4bca8b3ccd2a52532f98 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:18.049020 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdcf7e-2653-4f23-aa8e-fbee62d32653 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:18.051536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-49bdcf7e-2653-4f23-aa8e-fbee62d32653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:18.069375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdcf7e-2653-4f23-aa8e-fbee62d32653 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:18.131465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584fdea-9ef5-47a9-8640-7290f5452406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:18.132256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584fdea-9ef5-47a9-8640-7290f5452406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:18.132592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584fdea-9ef5-47a9-8640-7290f5452406 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:18.132937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584fdea-9ef5-47a9-8640-7290f5452406 admin admin] PATH_INFO: `/v3/projects/15449304d2a84e33bd5edc973cd3e3ab` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:18.134107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584fdea-9ef5-47a9-8640-7290f5452406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15449304d2a84e33bd5edc973cd3e3ab)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:18.136031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584fdea-9ef5-47a9-8640-7290f5452406 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:18.152647 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:18.189376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d584fdea-9ef5-47a9-8640-7290f5452406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15449304d2a84e33bd5edc973cd3e3ab', 'request_id': 'req-d584fdea-9ef5-47a9-8640-7290f5452406'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:18.196138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d584fdea-9ef5-47a9-8640-7290f5452406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15449304d2a84e33bd5edc973cd3e3ab', 'request_id': 'req-d584fdea-9ef5-47a9-8640-7290f5452406'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:18.204382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d584fdea-9ef5-47a9-8640-7290f5452406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15449304d2a84e33bd5edc973cd3e3ab', 'request_id': 'req-d584fdea-9ef5-47a9-8640-7290f5452406'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:18.215608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d584fdea-9ef5-47a9-8640-7290f5452406 admin admin] The token cache is being invalidate because project 15449304d2a84e33bd5edc973cd3e3ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:53:18.215847 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d584fdea-9ef5-47a9-8640-7290f5452406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:18.216540 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d584fdea-9ef5-47a9-8640-7290f5452406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:18.218362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1030/2078] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:53:18 2022] DELETE /identity/v3/projects/15449304d2a84e33bd5edc973cd3e3ab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:18.224888 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ab3b1-afa0-496d-a1a4-a8bae6919ee4 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:18.225298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ab3b1-afa0-496d-a1a4-a8bae6919ee4 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:18.225659 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ab3b1-afa0-496d-a1a4-a8bae6919ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:18.257913 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-a76ab3b1-afa0-496d-a1a4-a8bae6919ee4 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:18.259273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a76ab3b1-afa0-496d-a1a4-a8bae6919ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:18.310946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:18.343281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1049/2079] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:18.353822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbaedd-643a-4166-acee-015d6b5cfd96 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:18.354461 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbaedd-643a-4166-acee-015d6b5cfd96 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:18.354994 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbaedd-643a-4166-acee-015d6b5cfd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:18.382305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-1adbaedd-643a-4166-acee-015d6b5cfd96 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:18.383581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1adbaedd-643a-4166-acee-015d6b5cfd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:18.393534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1031/2080] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:18.398024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ab3b1-afa0-496d-a1a4-a8bae6919ee4 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:18.411718 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ab3b1-afa0-496d-a1a4-a8bae6919ee4 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:18.417456 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e6ef0-9080-4655-b241-beddd3bb95b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:18.419106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e6ef0-9080-4655-b241-beddd3bb95b3 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:18.419781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e6ef0-9080-4655-b241-beddd3bb95b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:18.420384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e6ef0-9080-4655-b241-beddd3bb95b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:18.423599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e6ef0-9080-4655-b241-beddd3bb95b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:53:18.423599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e6ef0-9080-4655-b241-beddd3bb95b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:18.424850 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e6ef0-9080-4655-b241-beddd3bb95b3 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:18.442882 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1050/2081] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:53:18.446536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbaedd-643a-4166-acee-015d6b5cfd96 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:18.457265 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbaedd-643a-4166-acee-015d6b5cfd96 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:18.466538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e47f7-3a24-4184-a8f8-f97be6be877f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:18.467696 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e47f7-3a24-4184-a8f8-f97be6be877f admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:18.468188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e47f7-3a24-4184-a8f8-f97be6be877f admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:18.468878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e47f7-3a24-4184-a8f8-f97be6be877f admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:18.470346 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e47f7-3a24-4184-a8f8-f97be6be877f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:18.472701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e47f7-3a24-4184-a8f8-f97be6be877f admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:18.507945 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1032/2082] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:53:18 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:53:18.510383 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e6ef0-9080-4655-b241-beddd3bb95b3 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:18.524092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e6ef0-9080-4655-b241-beddd3bb95b3 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:18.603388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723128b4-500b-493d-86b1-e06aacb54dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:18.604107 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723128b4-500b-493d-86b1-e06aacb54dee admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:18.604653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723128b4-500b-493d-86b1-e06aacb54dee admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:18.605221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723128b4-500b-493d-86b1-e06aacb54dee admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:18.606095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723128b4-500b-493d-86b1-e06aacb54dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:18.609014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723128b4-500b-493d-86b1-e06aacb54dee admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:18.635340 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1051/2083] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:53:18 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:53:18.639858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e47f7-3a24-4184-a8f8-f97be6be877f admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:18.651277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e47f7-3a24-4184-a8f8-f97be6be877f admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:18.657893 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd661727-1347-4c0e-aade-af0ec8fabda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:18.658751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd661727-1347-4c0e-aade-af0ec8fabda6 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:18.659072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd661727-1347-4c0e-aade-af0ec8fabda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:18.659378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd661727-1347-4c0e-aade-af0ec8fabda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:18.660061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd661727-1347-4c0e-aade-af0ec8fabda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:18.661900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd661727-1347-4c0e-aade-af0ec8fabda6 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:18.675691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1033/2084] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:53:18.676885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723128b4-500b-493d-86b1-e06aacb54dee admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:18.690693 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723128b4-500b-493d-86b1-e06aacb54dee admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:18.698555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa889846-5472-4b4b-9d5b-1f39d0cd5a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:18.699435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa889846-5472-4b4b-9d5b-1f39d0cd5a29 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:18.699907 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa889846-5472-4b4b-9d5b-1f39d0cd5a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:18.700678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa889846-5472-4b4b-9d5b-1f39d0cd5a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:18.701730 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa889846-5472-4b4b-9d5b-1f39d0cd5a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:18.705466 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa889846-5472-4b4b-9d5b-1f39d0cd5a29 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:18.721156 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1052/2085] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:53:18.722759 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd661727-1347-4c0e-aade-af0ec8fabda6 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:18.734072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd661727-1347-4c0e-aade-af0ec8fabda6 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:18.739354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b502-95bb-44b3-9136-4b1293a0e696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:18.740178 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b502-95bb-44b3-9136-4b1293a0e696 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:18.740537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b502-95bb-44b3-9136-4b1293a0e696 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:18.740888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b502-95bb-44b3-9136-4b1293a0e696 admin admin] PATH_INFO: `/v3/projects/c30f2628896a4630b852021bfc0d9dab/users/ba4e37df1dbc4545991f6146ba1ab6fe/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:18.761415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5b502-95bb-44b3-9136-4b1293a0e696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30f2628896a4630b852021bfc0d9dab, user_id=ba4e37df1dbc4545991f6146ba1ab6fe, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:18.764360 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5b502-95bb-44b3-9136-4b1293a0e696 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:18.792774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1034/2086] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:53:18 2022] PUT /identity/v3/projects/c30f2628896a4630b852021bfc0d9dab/users/ba4e37df1dbc4545991f6146ba1ab6fe/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:18.803856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46cc67-8213-4e3a-bf8b-eaca5e321627 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:18.804159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46cc67-8213-4e3a-bf8b-eaca5e321627 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:18.804439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46cc67-8213-4e3a-bf8b-eaca5e321627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:18.837046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-3d46cc67-8213-4e3a-bf8b-eaca5e321627 None None] MFA Rules not processed for user `ba4e37df1dbc4545991f6146ba1ab6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:18.837723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-3d46cc67-8213-4e3a-bf8b-eaca5e321627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:18.911737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1053/2087] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:18.923026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b502-95bb-44b3-9136-4b1293a0e696 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:18.925257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ffc5b502-95bb-44b3-9136-4b1293a0e696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:18.985135 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b502-95bb-44b3-9136-4b1293a0e696 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:18.988698 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4a506-a06e-41e9-ba03-f528d60e6aa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:18.989346 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4a506-a06e-41e9-ba03-f528d60e6aa9 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:18.989630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4a506-a06e-41e9-ba03-f528d60e6aa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:18.989906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4a506-a06e-41e9-ba03-f528d60e6aa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:18.998147 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4a506-a06e-41e9-ba03-f528d60e6aa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:18.999570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4a506-a06e-41e9-ba03-f528d60e6aa9 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:19.011110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1035/2088] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:53:19.033450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46cc67-8213-4e3a-bf8b-eaca5e321627 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:19.080716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:19.107409 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46cc67-8213-4e3a-bf8b-eaca5e321627 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:19.112580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cad70-03d5-473c-8383-d697004a48ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:19.113517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cad70-03d5-473c-8383-d697004a48ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:19.113765 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cad70-03d5-473c-8383-d697004a48ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:19.114036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cad70-03d5-473c-8383-d697004a48ac admin admin] PATH_INFO: `/v3/users/ba4e37df1dbc4545991f6146ba1ab6fe` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:19.115518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cad70-03d5-473c-8383-d697004a48ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba4e37df1dbc4545991f6146ba1ab6fe)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:19.117667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cad70-03d5-473c-8383-d697004a48ac admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:19.173829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8e5cad70-03d5-473c-8383-d697004a48ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba4e37df1dbc4545991f6146ba1ab6fe'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:19.182419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8e5cad70-03d5-473c-8383-d697004a48ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba4e37df1dbc4545991f6146ba1ab6fe'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:19.183129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8e5cad70-03d5-473c-8383-d697004a48ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba4e37df1dbc4545991f6146ba1ab6fe'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:19.191220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8e5cad70-03d5-473c-8383-d697004a48ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba4e37df1dbc4545991f6146ba1ab6fe'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:19.207361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8e5cad70-03d5-473c-8383-d697004a48ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba4e37df1dbc4545991f6146ba1ab6fe'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:19.213880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1054/2089] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:53:19 2022] DELETE /identity/v3/users/ba4e37df1dbc4545991f6146ba1ab6fe => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:19.218485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed1055-3ffb-486f-8c52-36b46a9ea057 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:19.219025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed1055-3ffb-486f-8c52-36b46a9ea057 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:19.219119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed1055-3ffb-486f-8c52-36b46a9ea057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:19.239990 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-f5ed1055-3ffb-486f-8c52-36b46a9ea057 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:19.241531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-f5ed1055-3ffb-486f-8c52-36b46a9ea057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:19.282492 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:19.317799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1036/2090] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:19.327622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cad70-03d5-473c-8383-d697004a48ac admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:19.329124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-8e5cad70-03d5-473c-8383-d697004a48ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:19.393750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cad70-03d5-473c-8383-d697004a48ac admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:19.398748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb573b3b-7e4c-40b3-a2e4-55be04150784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:19.399460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb573b3b-7e4c-40b3-a2e4-55be04150784 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:19.400055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb573b3b-7e4c-40b3-a2e4-55be04150784 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:19.400055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb573b3b-7e4c-40b3-a2e4-55be04150784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:19.410503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb573b3b-7e4c-40b3-a2e4-55be04150784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:19.412023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb573b3b-7e4c-40b3-a2e4-55be04150784 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:19.421934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1055/2091] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:53:19.885474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed1055-3ffb-486f-8c52-36b46a9ea057 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:19.888215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-f5ed1055-3ffb-486f-8c52-36b46a9ea057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:19.912966 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed1055-3ffb-486f-8c52-36b46a9ea057 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:19.921645 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed864a-081c-420b-8354-d4fd67f306b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:19.922887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed864a-081c-420b-8354-d4fd67f306b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:19.923242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed864a-081c-420b-8354-d4fd67f306b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:19.923593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed864a-081c-420b-8354-d4fd67f306b3 admin admin] PATH_INFO: `/v3/projects/c30f2628896a4630b852021bfc0d9dab` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:19.924794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed864a-081c-420b-8354-d4fd67f306b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30f2628896a4630b852021bfc0d9dab)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:19.926818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed864a-081c-420b-8354-d4fd67f306b3 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:19.996878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2aed864a-081c-420b-8354-d4fd67f306b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30f2628896a4630b852021bfc0d9dab', 'request_id': 'req-2aed864a-081c-420b-8354-d4fd67f306b3'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:20.007675 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2aed864a-081c-420b-8354-d4fd67f306b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30f2628896a4630b852021bfc0d9dab', 'request_id': 'req-2aed864a-081c-420b-8354-d4fd67f306b3'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:20.017123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2aed864a-081c-420b-8354-d4fd67f306b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30f2628896a4630b852021bfc0d9dab', 'request_id': 'req-2aed864a-081c-420b-8354-d4fd67f306b3'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:20.029450 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2aed864a-081c-420b-8354-d4fd67f306b3 admin admin] The token cache is being invalidate because project c30f2628896a4630b852021bfc0d9dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:53:20.029936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2aed864a-081c-420b-8354-d4fd67f306b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:20.030587 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2aed864a-081c-420b-8354-d4fd67f306b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:20.032232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1037/2092] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:53:19 2022] DELETE /identity/v3/projects/c30f2628896a4630b852021bfc0d9dab => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:20.037247 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8ff25-b604-4ce2-b4b3-8744ad0e0c25 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:20.037738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8ff25-b604-4ce2-b4b3-8744ad0e0c25 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:20.037838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8ff25-b604-4ce2-b4b3-8744ad0e0c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:20.071222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-04a8ff25-b604-4ce2-b4b3-8744ad0e0c25 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:20.072795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-04a8ff25-b604-4ce2-b4b3-8744ad0e0c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:20.136970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:20.149299 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1056/2093] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:20.157716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab2d92-4b7d-48f8-b38a-e52dba197956 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:20.158009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab2d92-4b7d-48f8-b38a-e52dba197956 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:20.158286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab2d92-4b7d-48f8-b38a-e52dba197956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:20.179057 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-76ab2d92-4b7d-48f8-b38a-e52dba197956 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:20.180274 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-76ab2d92-4b7d-48f8-b38a-e52dba197956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:20.188686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1038/2094] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:20.193278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8ff25-b604-4ce2-b4b3-8744ad0e0c25 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:20.205859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8ff25-b604-4ce2-b4b3-8744ad0e0c25 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:20.223236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66911c-4e8c-4f74-ad8a-687fb964b4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:20.223986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66911c-4e8c-4f74-ad8a-687fb964b4cb admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:20.224136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66911c-4e8c-4f74-ad8a-687fb964b4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:20.224415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66911c-4e8c-4f74-ad8a-687fb964b4cb admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:20.225133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66911c-4e8c-4f74-ad8a-687fb964b4cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:53:20.225414 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66911c-4e8c-4f74-ad8a-687fb964b4cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:20.228146 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66911c-4e8c-4f74-ad8a-687fb964b4cb admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:20.241042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1057/2095] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:53:20.245129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab2d92-4b7d-48f8-b38a-e52dba197956 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:20.256936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab2d92-4b7d-48f8-b38a-e52dba197956 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:20.262786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483434e-3353-461d-b1d6-c47f9a30d1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:20.263505 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483434e-3353-461d-b1d6-c47f9a30d1fc admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:20.263761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483434e-3353-461d-b1d6-c47f9a30d1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:20.264263 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483434e-3353-461d-b1d6-c47f9a30d1fc admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:20.264966 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483434e-3353-461d-b1d6-c47f9a30d1fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:20.266996 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483434e-3353-461d-b1d6-c47f9a30d1fc admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:20.303722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1039/2096] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:53:20 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:53:20.306029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66911c-4e8c-4f74-ad8a-687fb964b4cb admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:20.318509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66911c-4e8c-4f74-ad8a-687fb964b4cb admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:20.398648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2a0d3-b2df-4b53-853f-51ecdf773f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:20.399788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2a0d3-b2df-4b53-853f-51ecdf773f5b admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:20.400273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2a0d3-b2df-4b53-853f-51ecdf773f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:20.400763 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2a0d3-b2df-4b53-853f-51ecdf773f5b admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:20.401837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2a0d3-b2df-4b53-853f-51ecdf773f5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:20.403984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2a0d3-b2df-4b53-853f-51ecdf773f5b admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:20.432669 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1058/2097] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:53:20 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:53:20.437166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483434e-3353-461d-b1d6-c47f9a30d1fc admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:20.450596 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483434e-3353-461d-b1d6-c47f9a30d1fc admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:20.462801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e30c26-bc2d-456a-a133-45abb4dc92b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:20.463787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30c26-bc2d-456a-a133-45abb4dc92b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:20.464222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30c26-bc2d-456a-a133-45abb4dc92b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:20.464730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30c26-bc2d-456a-a133-45abb4dc92b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:20.466382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e30c26-bc2d-456a-a133-45abb4dc92b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:20.469435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e30c26-bc2d-456a-a133-45abb4dc92b4 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:20.482416 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1040/2098] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:53:20.486326 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2a0d3-b2df-4b53-853f-51ecdf773f5b admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:20.502400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2a0d3-b2df-4b53-853f-51ecdf773f5b admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:20.510766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4ad2a-30fb-4380-a6f9-69c32e670d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:20.512080 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4ad2a-30fb-4380-a6f9-69c32e670d01 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:20.512700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4ad2a-30fb-4380-a6f9-69c32e670d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:20.513313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4ad2a-30fb-4380-a6f9-69c32e670d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:20.514323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4ad2a-30fb-4380-a6f9-69c32e670d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:20.517388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4ad2a-30fb-4380-a6f9-69c32e670d01 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:20.529969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1059/2099] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:53:20.542218 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e30c26-bc2d-456a-a133-45abb4dc92b4 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:20.559247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e30c26-bc2d-456a-a133-45abb4dc92b4 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:20.567642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c686f50-f22e-4667-85d0-6f52bd9ee020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:20.568384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c686f50-f22e-4667-85d0-6f52bd9ee020 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:20.568845 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c686f50-f22e-4667-85d0-6f52bd9ee020 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:20.569153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c686f50-f22e-4667-85d0-6f52bd9ee020 admin admin] PATH_INFO: `/v3/projects/f11eeb1228464d978a266608071cb94f/users/82268395e3de45d08feddd09ea82b249/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:20.593763 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c686f50-f22e-4667-85d0-6f52bd9ee020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11eeb1228464d978a266608071cb94f, user_id=82268395e3de45d08feddd09ea82b249, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:20.596508 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c686f50-f22e-4667-85d0-6f52bd9ee020 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:20.613091 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1041/2100] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:53:20 2022] PUT /identity/v3/projects/f11eeb1228464d978a266608071cb94f/users/82268395e3de45d08feddd09ea82b249/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:20.624163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d0a73-5426-42f2-a287-2d7300daa1e0 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:20.624603 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d0a73-5426-42f2-a287-2d7300daa1e0 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:20.624947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d0a73-5426-42f2-a287-2d7300daa1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:20.653303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-442d0a73-5426-42f2-a287-2d7300daa1e0 None None] MFA Rules not processed for user `82268395e3de45d08feddd09ea82b249`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:20.654614 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-442d0a73-5426-42f2-a287-2d7300daa1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:20.732544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1060/2101] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:20.741733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c686f50-f22e-4667-85d0-6f52bd9ee020 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:20.744025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1c686f50-f22e-4667-85d0-6f52bd9ee020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:20.812547 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c686f50-f22e-4667-85d0-6f52bd9ee020 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:20.817008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf93334-dff8-4c35-9355-7392e8454bde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:20.817680 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf93334-dff8-4c35-9355-7392e8454bde service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:20.817965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf93334-dff8-4c35-9355-7392e8454bde service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:20.818241 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf93334-dff8-4c35-9355-7392e8454bde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:20.826979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf93334-dff8-4c35-9355-7392e8454bde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:20.828431 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf93334-dff8-4c35-9355-7392e8454bde service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:20.837358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1042/2102] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:53:20.864133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d0a73-5426-42f2-a287-2d7300daa1e0 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:20.928711 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:20.942254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d0a73-5426-42f2-a287-2d7300daa1e0 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:20.948360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4da624-00f9-470e-9cc8-d889312f6efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:20.949039 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4da624-00f9-470e-9cc8-d889312f6efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:20.949330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4da624-00f9-470e-9cc8-d889312f6efe admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:20.949605 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4da624-00f9-470e-9cc8-d889312f6efe admin admin] PATH_INFO: `/v3/users/82268395e3de45d08feddd09ea82b249` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:20.950764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4da624-00f9-470e-9cc8-d889312f6efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=82268395e3de45d08feddd09ea82b249)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:20.952724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4da624-00f9-470e-9cc8-d889312f6efe admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:21.001585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ac4da624-00f9-470e-9cc8-d889312f6efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82268395e3de45d08feddd09ea82b249'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:21.010664 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ac4da624-00f9-470e-9cc8-d889312f6efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82268395e3de45d08feddd09ea82b249'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:21.011330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ac4da624-00f9-470e-9cc8-d889312f6efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82268395e3de45d08feddd09ea82b249'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:21.022195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ac4da624-00f9-470e-9cc8-d889312f6efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82268395e3de45d08feddd09ea82b249'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:21.035664 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ac4da624-00f9-470e-9cc8-d889312f6efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82268395e3de45d08feddd09ea82b249'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:21.045048 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1061/2103] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:53:20 2022] DELETE /identity/v3/users/82268395e3de45d08feddd09ea82b249 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:21.049726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf572f-6473-403f-a42f-c7889d1e7571 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:21.050041 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf572f-6473-403f-a42f-c7889d1e7571 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:21.050341 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf572f-6473-403f-a42f-c7889d1e7571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:21.059528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:21.077380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-cacf572f-6473-403f-a42f-c7889d1e7571 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:21.082078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-cacf572f-6473-403f-a42f-c7889d1e7571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:21.214215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1043/2104] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:21.222400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4da624-00f9-470e-9cc8-d889312f6efe admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:21.225117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ac4da624-00f9-470e-9cc8-d889312f6efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:21.318057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4da624-00f9-470e-9cc8-d889312f6efe admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:21.328614 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee89e8-051c-481e-a49a-5192ecd237cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:21.329331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee89e8-051c-481e-a49a-5192ecd237cd service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:21.329687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee89e8-051c-481e-a49a-5192ecd237cd service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:21.330052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee89e8-051c-481e-a49a-5192ecd237cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:21.340489 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee89e8-051c-481e-a49a-5192ecd237cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:21.342068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee89e8-051c-481e-a49a-5192ecd237cd service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:21.353167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1062/2105] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:53:21.779430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf572f-6473-403f-a42f-c7889d1e7571 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:21.782905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-cacf572f-6473-403f-a42f-c7889d1e7571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:21.804735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf572f-6473-403f-a42f-c7889d1e7571 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:21.814777 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192a467-ae2e-4450-a5ac-987c11ca4ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:21.814777 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192a467-ae2e-4450-a5ac-987c11ca4ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:21.814777 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192a467-ae2e-4450-a5ac-987c11ca4ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:21.814777 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192a467-ae2e-4450-a5ac-987c11ca4ef0 admin admin] PATH_INFO: `/v3/projects/f11eeb1228464d978a266608071cb94f` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:21.816440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192a467-ae2e-4450-a5ac-987c11ca4ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f11eeb1228464d978a266608071cb94f)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:21.841963 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192a467-ae2e-4450-a5ac-987c11ca4ef0 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:21.935860 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a192a467-ae2e-4450-a5ac-987c11ca4ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f11eeb1228464d978a266608071cb94f', 'request_id': 'req-a192a467-ae2e-4450-a5ac-987c11ca4ef0'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:21.942935 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a192a467-ae2e-4450-a5ac-987c11ca4ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f11eeb1228464d978a266608071cb94f', 'request_id': 'req-a192a467-ae2e-4450-a5ac-987c11ca4ef0'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:21.956304 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a192a467-ae2e-4450-a5ac-987c11ca4ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f11eeb1228464d978a266608071cb94f', 'request_id': 'req-a192a467-ae2e-4450-a5ac-987c11ca4ef0'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:21.972802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a192a467-ae2e-4450-a5ac-987c11ca4ef0 admin admin] The token cache is being invalidate because project f11eeb1228464d978a266608071cb94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:53:21.973204 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a192a467-ae2e-4450-a5ac-987c11ca4ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:21.974298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a192a467-ae2e-4450-a5ac-987c11ca4ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:21.975593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1044/2106] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:53:21 2022] DELETE /identity/v3/projects/f11eeb1228464d978a266608071cb94f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:22.286327 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89f89-139c-42e1-9110-bd23e2da3b24 None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:22.286807 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89f89-139c-42e1-9110-bd23e2da3b24 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:22.286972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89f89-139c-42e1-9110-bd23e2da3b24 None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:22.288695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1063/2107] 10.222.0.76 () {54 vars in 921 bytes} [Fri Aug 26 08:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:53:22.302747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea967e7a-da3e-45bc-8af1-03f9092d91ab None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:22.303113 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea967e7a-da3e-45bc-8af1-03f9092d91ab None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:22.303434 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea967e7a-da3e-45bc-8af1-03f9092d91ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:22.323238 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ea967e7a-da3e-45bc-8af1-03f9092d91ab None None] MFA Rules not processed for user `95abbd88e549427abbf5699efed0451a`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:22.324379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ea967e7a-da3e-45bc-8af1-03f9092d91ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:22.364009 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c89f89-139c-42e1-9110-bd23e2da3b24 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:22.366353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f2c89f89-139c-42e1-9110-bd23e2da3b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:22.403979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1045/2108] 10.222.0.76 () {58 vars in 1018 bytes} [Fri Aug 26 08:53:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:22.418632 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea967e7a-da3e-45bc-8af1-03f9092d91ab None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:22.420032 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ea967e7a-da3e-45bc-8af1-03f9092d91ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:22.432976 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea967e7a-da3e-45bc-8af1-03f9092d91ab None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:22.438756 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a15c8e-e493-4cd2-8bb9-34fc3708e186 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95abbd88e549427abbf5699efed0451a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:22.439440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a15c8e-e493-4cd2-8bb9-34fc3708e186 service placement] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:22.439721 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a15c8e-e493-4cd2-8bb9-34fc3708e186 service placement] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:22.439994 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a15c8e-e493-4cd2-8bb9-34fc3708e186 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:22.449044 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a15c8e-e493-4cd2-8bb9-34fc3708e186 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:22.450635 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a15c8e-e493-4cd2-8bb9-34fc3708e186 service placement] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:22.457964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c89f89-139c-42e1-9110-bd23e2da3b24 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:22.460832 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1046/2109] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:53:22.462713 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ee1b9-d22c-4e53-8372-a284e4c4054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:22.463345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ee1b9-d22c-4e53-8372-a284e4c4054a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:22.463631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ee1b9-d22c-4e53-8372-a284e4c4054a admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:22.463909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ee1b9-d22c-4e53-8372-a284e4c4054a admin admin] PATH_INFO: `/v3/users/0479c86d4cfc40c8a811a390bfd53152` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:22.465178 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ee1b9-d22c-4e53-8372-a284e4c4054a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0479c86d4cfc40c8a811a390bfd53152)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:22.467093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ee1b9-d22c-4e53-8372-a284e4c4054a admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:22.489300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:22.522017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a67ee1b9-d22c-4e53-8372-a284e4c4054a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0479c86d4cfc40c8a811a390bfd53152'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:22.529236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a67ee1b9-d22c-4e53-8372-a284e4c4054a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0479c86d4cfc40c8a811a390bfd53152'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:22.529875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a67ee1b9-d22c-4e53-8372-a284e4c4054a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0479c86d4cfc40c8a811a390bfd53152'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:22.536892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a67ee1b9-d22c-4e53-8372-a284e4c4054a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0479c86d4cfc40c8a811a390bfd53152'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:22.549285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a67ee1b9-d22c-4e53-8372-a284e4c4054a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0479c86d4cfc40c8a811a390bfd53152'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:22.555397 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1064/2110] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:53:22 2022] DELETE /identity/v3/users/0479c86d4cfc40c8a811a390bfd53152 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:22.930608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a15c8e-e493-4cd2-8bb9-34fc3708e186 service placement] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:22.943862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a15c8e-e493-4cd2-8bb9-34fc3708e186 service placement] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:22.954993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:23.017410 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa53f1-2fcc-4733-ae45-279d193c86d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:23.018045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa53f1-2fcc-4733-ae45-279d193c86d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:23.018329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa53f1-2fcc-4733-ae45-279d193c86d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:23.018607 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa53f1-2fcc-4733-ae45-279d193c86d4 admin admin] PATH_INFO: `/v3/projects/a1d3ea5ec9cd42e8b6cac6d60f15a652` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:23.019724 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa53f1-2fcc-4733-ae45-279d193c86d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d3ea5ec9cd42e8b6cac6d60f15a652)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:23.021688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa53f1-2fcc-4733-ae45-279d193c86d4 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:23.075065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-15aa53f1-2fcc-4733-ae45-279d193c86d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d3ea5ec9cd42e8b6cac6d60f15a652', 'request_id': 'req-15aa53f1-2fcc-4733-ae45-279d193c86d4'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:23.087054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-15aa53f1-2fcc-4733-ae45-279d193c86d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d3ea5ec9cd42e8b6cac6d60f15a652', 'request_id': 'req-15aa53f1-2fcc-4733-ae45-279d193c86d4'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:23.095161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-15aa53f1-2fcc-4733-ae45-279d193c86d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d3ea5ec9cd42e8b6cac6d60f15a652', 'request_id': 'req-15aa53f1-2fcc-4733-ae45-279d193c86d4'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:23.111483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-15aa53f1-2fcc-4733-ae45-279d193c86d4 admin admin] The token cache is being invalidate because project a1d3ea5ec9cd42e8b6cac6d60f15a652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:53:23.111784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-15aa53f1-2fcc-4733-ae45-279d193c86d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:23.112511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-15aa53f1-2fcc-4733-ae45-279d193c86d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:53:23.114080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1047/2111] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:53:22 2022] DELETE /identity/v3/projects/a1d3ea5ec9cd42e8b6cac6d60f15a652 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:53:23.118963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd5a0f-8af5-49c3-8f75-95d06a32f967 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:23.119256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd5a0f-8af5-49c3-8f75-95d06a32f967 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:23.119533 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd5a0f-8af5-49c3-8f75-95d06a32f967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:23.139463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-edfd5a0f-8af5-49c3-8f75-95d06a32f967 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:23.140669 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-edfd5a0f-8af5-49c3-8f75-95d06a32f967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:23.217646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1065/2112] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:23.222166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02098bc9-d543-4fa4-ae35-b00e94c3522c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:23.222452 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02098bc9-d543-4fa4-ae35-b00e94c3522c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:23.222702 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02098bc9-d543-4fa4-ae35-b00e94c3522c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:23.243079 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-02098bc9-d543-4fa4-ae35-b00e94c3522c None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:23.244404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-02098bc9-d543-4fa4-ae35-b00e94c3522c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:23.252751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1048/2113] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:23.256985 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd5a0f-8af5-49c3-8f75-95d06a32f967 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:23.267048 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd5a0f-8af5-49c3-8f75-95d06a32f967 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:23.271717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116aec5-f9b1-4dc5-ae61-88cc8f79fce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:23.272318 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116aec5-f9b1-4dc5-ae61-88cc8f79fce5 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:23.272601 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116aec5-f9b1-4dc5-ae61-88cc8f79fce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:23.272871 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116aec5-f9b1-4dc5-ae61-88cc8f79fce5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:23.273555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116aec5-f9b1-4dc5-ae61-88cc8f79fce5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:53:23.273859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116aec5-f9b1-4dc5-ae61-88cc8f79fce5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:23.275479 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116aec5-f9b1-4dc5-ae61-88cc8f79fce5 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:23.288026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1066/2114] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:53:23.292581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02098bc9-d543-4fa4-ae35-b00e94c3522c None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:23.302781 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02098bc9-d543-4fa4-ae35-b00e94c3522c None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:23.307525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2138e-9c0e-43f7-be58-4cc81ecc3d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:23.308126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2138e-9c0e-43f7-be58-4cc81ecc3d57 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:23.308408 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2138e-9c0e-43f7-be58-4cc81ecc3d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:23.308689 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2138e-9c0e-43f7-be58-4cc81ecc3d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:23.309357 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2138e-9c0e-43f7-be58-4cc81ecc3d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:23.311252 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2138e-9c0e-43f7-be58-4cc81ecc3d57 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:23.343336 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1049/2115] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:53:23 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:53:23.345046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116aec5-f9b1-4dc5-ae61-88cc8f79fce5 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:23.356585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116aec5-f9b1-4dc5-ae61-88cc8f79fce5 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:23.414545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e14b6-caaf-4474-a161-cdccfd0eb146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:23.415150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e14b6-caaf-4474-a161-cdccfd0eb146 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:23.415431 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e14b6-caaf-4474-a161-cdccfd0eb146 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:23.415703 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e14b6-caaf-4474-a161-cdccfd0eb146 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:23.416336 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e14b6-caaf-4474-a161-cdccfd0eb146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:23.418278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e14b6-caaf-4474-a161-cdccfd0eb146 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:23.439506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1067/2116] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:53:23 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:53:23.443837 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2138e-9c0e-43f7-be58-4cc81ecc3d57 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:23.454212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2138e-9c0e-43f7-be58-4cc81ecc3d57 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:23.458836 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c9f12-2bc4-4324-a49a-a22eafcd02cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:23.459428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c9f12-2bc4-4324-a49a-a22eafcd02cd admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:23.459711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c9f12-2bc4-4324-a49a-a22eafcd02cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:23.459985 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c9f12-2bc4-4324-a49a-a22eafcd02cd admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:23.460623 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c9f12-2bc4-4324-a49a-a22eafcd02cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:23.462685 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c9f12-2bc4-4324-a49a-a22eafcd02cd admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:23.473582 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1050/2117] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:53:23.477751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e14b6-caaf-4474-a161-cdccfd0eb146 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:23.488413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e14b6-caaf-4474-a161-cdccfd0eb146 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:23.492931 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbaafd-15ea-4754-9058-a5171f9c8a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:23.493620 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbaafd-15ea-4754-9058-a5171f9c8a07 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:23.493902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbaafd-15ea-4754-9058-a5171f9c8a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:23.494179 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbaafd-15ea-4754-9058-a5171f9c8a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:23.494821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbaafd-15ea-4754-9058-a5171f9c8a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:23.496391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbaafd-15ea-4754-9058-a5171f9c8a07 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:23.501655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:23.507741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1068/2118] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:53:23.511384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c9f12-2bc4-4324-a49a-a22eafcd02cd admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:23.521962 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c9f12-2bc4-4324-a49a-a22eafcd02cd admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:23.526718 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236b792-bbb4-4c7e-a654-55399997addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:23.527357 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236b792-bbb4-4c7e-a654-55399997addb admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:23.527640 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236b792-bbb4-4c7e-a654-55399997addb admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:23.527913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236b792-bbb4-4c7e-a654-55399997addb admin admin] PATH_INFO: `/v3/projects/3082c759fb9e437eb1f4cb735dc43ef9/users/5541bfa4efc54abe85faf6b58196a2d7/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:23.543828 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236b792-bbb4-4c7e-a654-55399997addb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3082c759fb9e437eb1f4cb735dc43ef9, user_id=5541bfa4efc54abe85faf6b58196a2d7, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:23.546580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236b792-bbb4-4c7e-a654-55399997addb admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:23.559973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1051/2119] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:53:23 2022] PUT /identity/v3/projects/3082c759fb9e437eb1f4cb735dc43ef9/users/5541bfa4efc54abe85faf6b58196a2d7/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:53:23.567372 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22e401-2377-420e-a096-f1d10893438b None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:23.567717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22e401-2377-420e-a096-f1d10893438b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:23.567998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22e401-2377-420e-a096-f1d10893438b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:23.587726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-ba22e401-2377-420e-a096-f1d10893438b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:23.588950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ba22e401-2377-420e-a096-f1d10893438b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:23.648581 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1069/2120] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:23.658883 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236b792-bbb4-4c7e-a654-55399997addb admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:23.660663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b236b792-bbb4-4c7e-a654-55399997addb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:23.704074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:23.720907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236b792-bbb4-4c7e-a654-55399997addb admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:23.724520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767526c-82c1-4614-94ed-46d3f0521f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:23.725154 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767526c-82c1-4614-94ed-46d3f0521f2a service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:23.725433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767526c-82c1-4614-94ed-46d3f0521f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:23.725704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767526c-82c1-4614-94ed-46d3f0521f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:23.734329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767526c-82c1-4614-94ed-46d3f0521f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:23.736208 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767526c-82c1-4614-94ed-46d3f0521f2a service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:23.745460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1052/2121] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:53:28.106866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d3fa7-0116-4cf5-ae71-91a6415eb1f0 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:28.107335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d3fa7-0116-4cf5-ae71-91a6415eb1f0 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:28.107523 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d3fa7-0116-4cf5-ae71-91a6415eb1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:28.147330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-976d3fa7-0116-4cf5-ae71-91a6415eb1f0 None None] MFA Rules not processed for user `5541bfa4efc54abe85faf6b58196a2d7`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:28.148590 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-976d3fa7-0116-4cf5-ae71-91a6415eb1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:28.225312 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1070/2122] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:28.240620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767526c-82c1-4614-94ed-46d3f0521f2a service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:53:28.242493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-8767526c-82c1-4614-94ed-46d3f0521f2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:28.327818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767526c-82c1-4614-94ed-46d3f0521f2a service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:53:28.333519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e2498-9bb3-4ddc-bde3-2f13778fe0b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:53:28.334238 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e2498-9bb3-4ddc-bde3-2f13778fe0b3 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:28.334665 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e2498-9bb3-4ddc-bde3-2f13778fe0b3 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:28.335011 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e2498-9bb3-4ddc-bde3-2f13778fe0b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:28.343935 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e2498-9bb3-4ddc-bde3-2f13778fe0b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:53:28.345564 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e2498-9bb3-4ddc-bde3-2f13778fe0b3 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:53:28.355102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1053/2123] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:53:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:53:29.726850 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde9664-794a-49f2-b3f3-550cedbef850 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:53:29.727313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde9664-794a-49f2-b3f3-550cedbef850 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:53:29.727415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde9664-794a-49f2-b3f3-550cedbef850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:53:29.753686 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-9dde9664-794a-49f2-b3f3-550cedbef850 None None] MFA Rules not processed for user `5541bfa4efc54abe85faf6b58196a2d7`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:53:29.754941 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9dde9664-794a-49f2-b3f3-550cedbef850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:53:29.761839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1071/2124] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:53:38.350709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=43 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:39.745942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=62 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:02.382640 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f8a94-efcf-462b-b405-5fc84459fb7a None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:02.383196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f8a94-efcf-462b-b405-5fc84459fb7a None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:02.383319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f8a94-efcf-462b-b405-5fc84459fb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:02.403899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-206f8a94-efcf-462b-b405-5fc84459fb7a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:02.405233 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-206f8a94-efcf-462b-b405-5fc84459fb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:02.413198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1054/2125] 10.222.0.98 () {58 vars in 1016 bytes} [Fri Aug 26 08:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:54:02.437826 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde9664-794a-49f2-b3f3-550cedbef850 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:02.439715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9dde9664-794a-49f2-b3f3-550cedbef850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:02.456767 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde9664-794a-49f2-b3f3-550cedbef850 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:02.462490 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7b479-ddd4-4230-9643-56a69cd0f656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:02.463228 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7b479-ddd4-4230-9643-56a69cd0f656 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:02.463517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7b479-ddd4-4230-9643-56a69cd0f656 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:02.463795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7b479-ddd4-4230-9643-56a69cd0f656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:02.475819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7b479-ddd4-4230-9643-56a69cd0f656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:02.477469 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7b479-ddd4-4230-9643-56a69cd0f656 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:02.488381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1072/2126] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:54:07.521747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931c9bc-8051-49ff-8602-b43cf6d0b3e3 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:07.522282 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931c9bc-8051-49ff-8602-b43cf6d0b3e3 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:07.522435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931c9bc-8051-49ff-8602-b43cf6d0b3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:07.544526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-f931c9bc-8051-49ff-8602-b43cf6d0b3e3 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:07.545830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-f931c9bc-8051-49ff-8602-b43cf6d0b3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:07.554585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1055/2127] 10.222.0.98 () {58 vars in 1016 bytes} [Fri Aug 26 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:07.572079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7b479-ddd4-4230-9643-56a69cd0f656 service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:07.585579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7b479-ddd4-4230-9643-56a69cd0f656 service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:07.592022 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7768e8-f9c0-4ea2-83c3-ef68f1c295ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:07.592892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7768e8-f9c0-4ea2-83c3-ef68f1c295ea service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:07.593402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7768e8-f9c0-4ea2-83c3-ef68f1c295ea service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:07.593681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7768e8-f9c0-4ea2-83c3-ef68f1c295ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:07.604075 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7768e8-f9c0-4ea2-83c3-ef68f1c295ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:07.605786 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7768e8-f9c0-4ea2-83c3-ef68f1c295ea service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:07.616190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1073/2128] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:54:10.690973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931c9bc-8051-49ff-8602-b43cf6d0b3e3 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:10.692410 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-f931c9bc-8051-49ff-8602-b43cf6d0b3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:10.704224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931c9bc-8051-49ff-8602-b43cf6d0b3e3 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:10.708788 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bdf9c-e322-4b4f-89ec-0a1cbcf50da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:10.709453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bdf9c-e322-4b4f-89ec-0a1cbcf50da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:10.709737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bdf9c-e322-4b4f-89ec-0a1cbcf50da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:10.710014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bdf9c-e322-4b4f-89ec-0a1cbcf50da6 admin admin] PATH_INFO: `/v3/users/d2248a68c1744d0a964d0c0a63d91248` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:10.711139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bdf9c-e322-4b4f-89ec-0a1cbcf50da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2248a68c1744d0a964d0c0a63d91248)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:10.713090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bdf9c-e322-4b4f-89ec-0a1cbcf50da6 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:10.762994 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b06bdf9c-e322-4b4f-89ec-0a1cbcf50da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2248a68c1744d0a964d0c0a63d91248'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:10.770325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b06bdf9c-e322-4b4f-89ec-0a1cbcf50da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2248a68c1744d0a964d0c0a63d91248'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:10.770924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b06bdf9c-e322-4b4f-89ec-0a1cbcf50da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2248a68c1744d0a964d0c0a63d91248'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:10.771540 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b06bdf9c-e322-4b4f-89ec-0a1cbcf50da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2248a68c1744d0a964d0c0a63d91248'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:10.778401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b06bdf9c-e322-4b4f-89ec-0a1cbcf50da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2248a68c1744d0a964d0c0a63d91248'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:10.795207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1056/2129] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:54:10 2022] DELETE /identity/v3/users/d2248a68c1744d0a964d0c0a63d91248 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:54:10.800112 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d8702-733a-480a-b0b9-27846ddd04f2 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:10.800618 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d8702-733a-480a-b0b9-27846ddd04f2 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:10.800813 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d8702-733a-480a-b0b9-27846ddd04f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:10.819572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-a34d8702-733a-480a-b0b9-27846ddd04f2 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:10.820767 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a34d8702-733a-480a-b0b9-27846ddd04f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:10.877105 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1074/2130] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:10.887167 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bdf9c-e322-4b4f-89ec-0a1cbcf50da6 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:10.888516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b06bdf9c-e322-4b4f-89ec-0a1cbcf50da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:10.903998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d8702-733a-480a-b0b9-27846ddd04f2 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:10.905396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a34d8702-733a-480a-b0b9-27846ddd04f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:10.917183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d8702-733a-480a-b0b9-27846ddd04f2 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:10.921783 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3ac7e-89d2-4725-80fc-fcedef3449f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:10.922510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3ac7e-89d2-4725-80fc-fcedef3449f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:10.922852 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3ac7e-89d2-4725-80fc-fcedef3449f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:10.923074 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3ac7e-89d2-4725-80fc-fcedef3449f2 admin admin] PATH_INFO: `/v3/users/e446942f69f1467f81a57a295bb00cbf` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:10.924195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3ac7e-89d2-4725-80fc-fcedef3449f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e446942f69f1467f81a57a295bb00cbf)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:10.926674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3ac7e-89d2-4725-80fc-fcedef3449f2 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:10.946399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bdf9c-e322-4b4f-89ec-0a1cbcf50da6 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:10.950083 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a0a73-7da0-47df-be8c-1fc51fdbf5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:10.950690 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0a73-7da0-47df-be8c-1fc51fdbf5bf service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:10.950978 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0a73-7da0-47df-be8c-1fc51fdbf5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:10.951297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0a73-7da0-47df-be8c-1fc51fdbf5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:10.961561 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a0a73-7da0-47df-be8c-1fc51fdbf5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:10.963179 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a0a73-7da0-47df-be8c-1fc51fdbf5bf service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:10.972987 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1057/2131] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:54:10.974596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-30d3ac7e-89d2-4725-80fc-fcedef3449f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e446942f69f1467f81a57a295bb00cbf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:10.982241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-30d3ac7e-89d2-4725-80fc-fcedef3449f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e446942f69f1467f81a57a295bb00cbf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:10.983222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-30d3ac7e-89d2-4725-80fc-fcedef3449f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e446942f69f1467f81a57a295bb00cbf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:10.991103 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-30d3ac7e-89d2-4725-80fc-fcedef3449f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e446942f69f1467f81a57a295bb00cbf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:11.004165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-30d3ac7e-89d2-4725-80fc-fcedef3449f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e446942f69f1467f81a57a295bb00cbf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:11.010682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1075/2132] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:54:10 2022] DELETE /identity/v3/users/e446942f69f1467f81a57a295bb00cbf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:54:11.015401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694495d-a56c-488e-b4df-b6b5d8dd245b None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.015721 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694495d-a56c-488e-b4df-b6b5d8dd245b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.016028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694495d-a56c-488e-b4df-b6b5d8dd245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.036069 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-d694495d-a56c-488e-b4df-b6b5d8dd245b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:11.037389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d694495d-a56c-488e-b4df-b6b5d8dd245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:11.100118 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1058/2133] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:54:11.119401 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3ac7e-89d2-4725-80fc-fcedef3449f2 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:11.122757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-30d3ac7e-89d2-4725-80fc-fcedef3449f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:11.185131 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:11.194023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3ac7e-89d2-4725-80fc-fcedef3449f2 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:11.198302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed42da-dbc0-4167-b98d-74c6dd792769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:11.198920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed42da-dbc0-4167-b98d-74c6dd792769 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.199205 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed42da-dbc0-4167-b98d-74c6dd792769 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.199480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed42da-dbc0-4167-b98d-74c6dd792769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.208926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed42da-dbc0-4167-b98d-74c6dd792769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:11.210386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed42da-dbc0-4167-b98d-74c6dd792769 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:11.221944 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1076/2134] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:54:11.263892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694495d-a56c-488e-b4df-b6b5d8dd245b None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:11.265707 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d694495d-a56c-488e-b4df-b6b5d8dd245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:11.272946 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:11.278834 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694495d-a56c-488e-b4df-b6b5d8dd245b None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:11.286194 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806940e-d7a3-4d3c-a303-10fdf5276cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:11.287174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806940e-d7a3-4d3c-a303-10fdf5276cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.287686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806940e-d7a3-4d3c-a303-10fdf5276cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.287960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806940e-d7a3-4d3c-a303-10fdf5276cc8 admin admin] PATH_INFO: `/v3/projects/117f92cf7c5946c293c97d716df51b38` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.289161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806940e-d7a3-4d3c-a303-10fdf5276cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=117f92cf7c5946c293c97d716df51b38)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:11.291152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806940e-d7a3-4d3c-a303-10fdf5276cc8 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:11.352313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a806940e-d7a3-4d3c-a303-10fdf5276cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '117f92cf7c5946c293c97d716df51b38', 'request_id': 'req-a806940e-d7a3-4d3c-a303-10fdf5276cc8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:11.359208 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a806940e-d7a3-4d3c-a303-10fdf5276cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '117f92cf7c5946c293c97d716df51b38', 'request_id': 'req-a806940e-d7a3-4d3c-a303-10fdf5276cc8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:11.367202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a806940e-d7a3-4d3c-a303-10fdf5276cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '117f92cf7c5946c293c97d716df51b38', 'request_id': 'req-a806940e-d7a3-4d3c-a303-10fdf5276cc8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:11.377851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a806940e-d7a3-4d3c-a303-10fdf5276cc8 admin admin] The token cache is being invalidate because project 117f92cf7c5946c293c97d716df51b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:54:11.378140 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a806940e-d7a3-4d3c-a303-10fdf5276cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:11.378819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a806940e-d7a3-4d3c-a303-10fdf5276cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:11.380348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1059/2135] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:54:11 2022] DELETE /identity/v3/projects/117f92cf7c5946c293c97d716df51b38 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:54:11.386757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fee2b5-a634-4250-88a8-41bacfeab4a9 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.387049 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fee2b5-a634-4250-88a8-41bacfeab4a9 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.387379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fee2b5-a634-4250-88a8-41bacfeab4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.420407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-b4fee2b5-a634-4250-88a8-41bacfeab4a9 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:11.421755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b4fee2b5-a634-4250-88a8-41bacfeab4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:11.488875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1077/2136] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:11.496660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecff121-a6ac-4240-9d00-632c398ce18a None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.496959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecff121-a6ac-4240-9d00-632c398ce18a None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.497490 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecff121-a6ac-4240-9d00-632c398ce18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.516779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-cecff121-a6ac-4240-9d00-632c398ce18a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:11.518041 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-cecff121-a6ac-4240-9d00-632c398ce18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:11.527045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1060/2137] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:54:11.531616 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fee2b5-a634-4250-88a8-41bacfeab4a9 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:11.531761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecff121-a6ac-4240-9d00-632c398ce18a None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:11.533108 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-cecff121-a6ac-4240-9d00-632c398ce18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:11.545731 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecff121-a6ac-4240-9d00-632c398ce18a None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:11.548260 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fee2b5-a634-4250-88a8-41bacfeab4a9 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:11.550650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25894c-41e4-4dd6-8c33-dc97f2b7cdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:11.551244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25894c-41e4-4dd6-8c33-dc97f2b7cdfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.551536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25894c-41e4-4dd6-8c33-dc97f2b7cdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.551815 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25894c-41e4-4dd6-8c33-dc97f2b7cdfc admin admin] PATH_INFO: `/v3/projects/87b3126b021d42d6bbd2e913755bd8ee` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.552948 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25894c-41e4-4dd6-8c33-dc97f2b7cdfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b3126b021d42d6bbd2e913755bd8ee)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:11.554499 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41f7c7-b2b7-4dc0-8ec5-6dd914deb5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:11.554959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25894c-41e4-4dd6-8c33-dc97f2b7cdfc admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:11.555453 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41f7c7-b2b7-4dc0-8ec5-6dd914deb5ff admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.555765 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41f7c7-b2b7-4dc0-8ec5-6dd914deb5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.556045 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41f7c7-b2b7-4dc0-8ec5-6dd914deb5ff admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.556695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41f7c7-b2b7-4dc0-8ec5-6dd914deb5ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:54:11.556981 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41f7c7-b2b7-4dc0-8ec5-6dd914deb5ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:11.558610 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41f7c7-b2b7-4dc0-8ec5-6dd914deb5ff admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:11.571151 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1078/2138] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:54:11.577989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41f7c7-b2b7-4dc0-8ec5-6dd914deb5ff admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:11.590189 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41f7c7-b2b7-4dc0-8ec5-6dd914deb5ff admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:11.595277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e1ecf-82b9-4c0f-aeec-9c78fa24f0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:11.595874 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e1ecf-82b9-4c0f-aeec-9c78fa24f0ba admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.596150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e1ecf-82b9-4c0f-aeec-9c78fa24f0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.597040 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e1ecf-82b9-4c0f-aeec-9c78fa24f0ba admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.597664 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e1ecf-82b9-4c0f-aeec-9c78fa24f0ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:11.599545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e1ecf-82b9-4c0f-aeec-9c78fa24f0ba admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:11.609493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ab25894c-41e4-4dd6-8c33-dc97f2b7cdfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b3126b021d42d6bbd2e913755bd8ee', 'request_id': 'req-ab25894c-41e4-4dd6-8c33-dc97f2b7cdfc'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:11.615892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ab25894c-41e4-4dd6-8c33-dc97f2b7cdfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b3126b021d42d6bbd2e913755bd8ee', 'request_id': 'req-ab25894c-41e4-4dd6-8c33-dc97f2b7cdfc'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:11.625010 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ab25894c-41e4-4dd6-8c33-dc97f2b7cdfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b3126b021d42d6bbd2e913755bd8ee', 'request_id': 'req-ab25894c-41e4-4dd6-8c33-dc97f2b7cdfc'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:11.630048 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1079/2139] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:54:11 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:54:11.635269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e1ecf-82b9-4c0f-aeec-9c78fa24f0ba admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:11.637014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ab25894c-41e4-4dd6-8c33-dc97f2b7cdfc admin admin] The token cache is being invalidate because project 87b3126b021d42d6bbd2e913755bd8ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:54:11.637503 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ab25894c-41e4-4dd6-8c33-dc97f2b7cdfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:11.638243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ab25894c-41e4-4dd6-8c33-dc97f2b7cdfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:11.640104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1061/2140] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:54:11 2022] DELETE /identity/v3/projects/87b3126b021d42d6bbd2e913755bd8ee => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:54:11.646344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f22906-248b-43fa-b859-1741a29d1beb None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.646811 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f22906-248b-43fa-b859-1741a29d1beb None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.647228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f22906-248b-43fa-b859-1741a29d1beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.677800 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-74f22906-248b-43fa-b859-1741a29d1beb None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:11.679771 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-74f22906-248b-43fa-b859-1741a29d1beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:11.726390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e1ecf-82b9-4c0f-aeec-9c78fa24f0ba admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:11.733253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe432d-3b1c-4712-ae61-bcf4fd855f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:11.733968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe432d-3b1c-4712-ae61-bcf4fd855f18 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.734281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe432d-3b1c-4712-ae61-bcf4fd855f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.734564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe432d-3b1c-4712-ae61-bcf4fd855f18 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.735282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe432d-3b1c-4712-ae61-bcf4fd855f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:11.737256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe432d-3b1c-4712-ae61-bcf4fd855f18 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:11.762456 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1080/2141] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:54:11 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:54:11.766289 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe432d-3b1c-4712-ae61-bcf4fd855f18 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:11.768173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-8dbe432d-3b1c-4712-ae61-bcf4fd855f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:11.772027 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1062/2142] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:54:11.779392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e5ced-55fc-48b2-ba46-86763984c98b None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.779688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e5ced-55fc-48b2-ba46-86763984c98b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.779961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e5ced-55fc-48b2-ba46-86763984c98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.782920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe432d-3b1c-4712-ae61-bcf4fd855f18 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:11.789348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:11.792703 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e972b0-08f8-4e2a-8e4e-86c4ea28142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:11.793156 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e972b0-08f8-4e2a-8e4e-86c4ea28142d admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.793302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e972b0-08f8-4e2a-8e4e-86c4ea28142d admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.793753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e972b0-08f8-4e2a-8e4e-86c4ea28142d admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.794280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e972b0-08f8-4e2a-8e4e-86c4ea28142d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:11.796277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e972b0-08f8-4e2a-8e4e-86c4ea28142d admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:11.803587 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-777e5ced-55fc-48b2-ba46-86763984c98b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:11.806003 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-777e5ced-55fc-48b2-ba46-86763984c98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:11.809213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1081/2143] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:54:11.812712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e972b0-08f8-4e2a-8e4e-86c4ea28142d admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:11.817536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1063/2144] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:54:11.821652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e5ced-55fc-48b2-ba46-86763984c98b None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:11.823565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e972b0-08f8-4e2a-8e4e-86c4ea28142d admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:11.828299 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71167846-4a8a-4068-9706-6f49d55385ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:11.828918 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71167846-4a8a-4068-9706-6f49d55385ca admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.829252 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71167846-4a8a-4068-9706-6f49d55385ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.829509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71167846-4a8a-4068-9706-6f49d55385ca admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.830200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71167846-4a8a-4068-9706-6f49d55385ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:11.832383 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71167846-4a8a-4068-9706-6f49d55385ca admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:11.838118 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e5ced-55fc-48b2-ba46-86763984c98b None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:11.843390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c564bb-23a0-4288-af37-cf7dd331a87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:11.844103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c564bb-23a0-4288-af37-cf7dd331a87e admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.844455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c564bb-23a0-4288-af37-cf7dd331a87e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.844799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c564bb-23a0-4288-af37-cf7dd331a87e admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.845548 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c564bb-23a0-4288-af37-cf7dd331a87e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:54:11.845924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c564bb-23a0-4288-af37-cf7dd331a87e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:11.849154 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1082/2145] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:54:11.849297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c564bb-23a0-4288-af37-cf7dd331a87e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:11.850364 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71167846-4a8a-4068-9706-6f49d55385ca admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:11.860751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1064/2146] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:54:11.863045 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71167846-4a8a-4068-9706-6f49d55385ca admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:11.865094 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c564bb-23a0-4288-af37-cf7dd331a87e admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:11.868271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8969a-9c55-4442-8a0f-fa0fb256beb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:11.869151 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8969a-9c55-4442-8a0f-fa0fb256beb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.869606 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8969a-9c55-4442-8a0f-fa0fb256beb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.870053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8969a-9c55-4442-8a0f-fa0fb256beb9 admin admin] PATH_INFO: `/v3/projects/be3effe1c7174488beea7800cf28999f/users/410920eca8e246c7bdd9da55ff27eee7/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.876396 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c564bb-23a0-4288-af37-cf7dd331a87e admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:11.882686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3ed97-c4a7-43ca-b17b-d90ed9687ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:11.883293 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3ed97-c4a7-43ca-b17b-d90ed9687ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.883579 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3ed97-c4a7-43ca-b17b-d90ed9687ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.883856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3ed97-c4a7-43ca-b17b-d90ed9687ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.884483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3ed97-c4a7-43ca-b17b-d90ed9687ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:11.886419 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3ed97-c4a7-43ca-b17b-d90ed9687ef7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:11.887217 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8969a-9c55-4442-8a0f-fa0fb256beb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3effe1c7174488beea7800cf28999f, user_id=410920eca8e246c7bdd9da55ff27eee7, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:11.890027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8969a-9c55-4442-8a0f-fa0fb256beb9 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:11.899530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:11.911568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1083/2147] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:54:11 2022] PUT /identity/v3/projects/be3effe1c7174488beea7800cf28999f/users/410920eca8e246c7bdd9da55ff27eee7/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:54:11.917106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587bd4f-2181-4f86-b12c-b87fe032e506 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.917720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587bd4f-2181-4f86-b12c-b87fe032e506 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.918272 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587bd4f-2181-4f86-b12c-b87fe032e506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.924329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1065/2148] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:54:11 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:54:11.925682 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3ed97-c4a7-43ca-b17b-d90ed9687ef7 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:11.938564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-4587bd4f-2181-4f86-b12c-b87fe032e506 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:11.939784 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4587bd4f-2181-4f86-b12c-b87fe032e506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:11.989412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3ed97-c4a7-43ca-b17b-d90ed9687ef7 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:11.993997 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22d259-0d51-4e18-a693-49ac09a8ba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:11.994604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22d259-0d51-4e18-a693-49ac09a8ba47 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:11.994887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22d259-0d51-4e18-a693-49ac09a8ba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:11.995162 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22d259-0d51-4e18-a693-49ac09a8ba47 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:11.995815 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22d259-0d51-4e18-a693-49ac09a8ba47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:11.997771 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22d259-0d51-4e18-a693-49ac09a8ba47 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:12.005083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1084/2149] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:54:12.015496 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587bd4f-2181-4f86-b12c-b87fe032e506 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:12.016950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4587bd4f-2181-4f86-b12c-b87fe032e506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:12.025116 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1066/2150] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:54:11 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:54:12.026308 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22d259-0d51-4e18-a693-49ac09a8ba47 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:12.036316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22d259-0d51-4e18-a693-49ac09a8ba47 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:12.040954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bfea4-3fc4-4b7b-8880-bd2bf58051b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:12.041562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bfea4-3fc4-4b7b-8880-bd2bf58051b3 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:12.041843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bfea4-3fc4-4b7b-8880-bd2bf58051b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:12.042121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bfea4-3fc4-4b7b-8880-bd2bf58051b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:12.042750 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bfea4-3fc4-4b7b-8880-bd2bf58051b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:12.044415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bfea4-3fc4-4b7b-8880-bd2bf58051b3 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:12.054415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1067/2151] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:54:12.058250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bfea4-3fc4-4b7b-8880-bd2bf58051b3 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:12.068758 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bfea4-3fc4-4b7b-8880-bd2bf58051b3 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:12.073454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8688b-01da-4f46-a5af-79af3f28bcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:12.074048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8688b-01da-4f46-a5af-79af3f28bcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:12.074339 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8688b-01da-4f46-a5af-79af3f28bcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:12.074735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8688b-01da-4f46-a5af-79af3f28bcb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:12.075380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8688b-01da-4f46-a5af-79af3f28bcb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:12.076961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8688b-01da-4f46-a5af-79af3f28bcb3 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:12.079065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587bd4f-2181-4f86-b12c-b87fe032e506 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:12.083149 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edea51c-4c00-4867-83d3-b3f12f8ea92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:12.083751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edea51c-4c00-4867-83d3-b3f12f8ea92e service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:12.084029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edea51c-4c00-4867-83d3-b3f12f8ea92e service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:12.084300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edea51c-4c00-4867-83d3-b3f12f8ea92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:12.088415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1068/2152] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:54:12.092858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8688b-01da-4f46-a5af-79af3f28bcb3 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:12.093955 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edea51c-4c00-4867-83d3-b3f12f8ea92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:12.095417 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edea51c-4c00-4867-83d3-b3f12f8ea92e service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:12.102343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8688b-01da-4f46-a5af-79af3f28bcb3 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:12.105119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1085/2153] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:54:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:54:12.107128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f709d90-7b81-4af1-b84d-aedd185d970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:12.107759 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f709d90-7b81-4af1-b84d-aedd185d970e admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:12.108039 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f709d90-7b81-4af1-b84d-aedd185d970e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:12.108313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f709d90-7b81-4af1-b84d-aedd185d970e admin admin] PATH_INFO: `/v3/projects/a8b4402027c2457b846811ebef24e6f0/users/c95252705eb94c608e38402fbc9f359a/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:12.123215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f709d90-7b81-4af1-b84d-aedd185d970e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b4402027c2457b846811ebef24e6f0, user_id=c95252705eb94c608e38402fbc9f359a, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:12.126032 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f709d90-7b81-4af1-b84d-aedd185d970e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:12.138942 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1069/2154] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:54:12 2022] PUT /identity/v3/projects/a8b4402027c2457b846811ebef24e6f0/users/c95252705eb94c608e38402fbc9f359a/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:54:12.149934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb276b-49be-4e08-82ad-3113933c6c63 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:12.150219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb276b-49be-4e08-82ad-3113933c6c63 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:12.150491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb276b-49be-4e08-82ad-3113933c6c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:12.179175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-7cfb276b-49be-4e08-82ad-3113933c6c63 None None] MFA Rules not processed for user `c95252705eb94c608e38402fbc9f359a`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:12.180528 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-7cfb276b-49be-4e08-82ad-3113933c6c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:12.253270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1086/2155] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:12.265566 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f709d90-7b81-4af1-b84d-aedd185d970e admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:12.267471 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7f709d90-7b81-4af1-b84d-aedd185d970e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:12.338561 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f709d90-7b81-4af1-b84d-aedd185d970e admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:12.342834 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fba5c-668c-4fc8-a710-68d0438e02eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fde38c1a2a844368acd3e1b9aa10151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:12.343436 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fba5c-668c-4fc8-a710-68d0438e02eb service glance] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:12.343720 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fba5c-668c-4fc8-a710-68d0438e02eb service glance] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:12.344386 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fba5c-668c-4fc8-a710-68d0438e02eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:12.352950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fba5c-668c-4fc8-a710-68d0438e02eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:12.354461 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fba5c-668c-4fc8-a710-68d0438e02eb service glance] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:12.364462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1070/2156] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:54:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:54:14.062018 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637413ae-da44-453f-ab7b-1d4ae969e365 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:14.062506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637413ae-da44-453f-ab7b-1d4ae969e365 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:14.062715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637413ae-da44-453f-ab7b-1d4ae969e365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:14.084218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-637413ae-da44-453f-ab7b-1d4ae969e365 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:14.085448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-637413ae-da44-453f-ab7b-1d4ae969e365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:14.116427 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:14.155724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1087/2157] 10.222.0.98 () {58 vars in 1016 bytes} [Fri Aug 26 08:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:14.173893 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fba5c-668c-4fc8-a710-68d0438e02eb service glance] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:14.175929 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ee6fba5c-668c-4fc8-a710-68d0438e02eb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:14.185954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:14.264355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fba5c-668c-4fc8-a710-68d0438e02eb service glance] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:14.270431 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f35390-2819-42bb-8a9e-89f71faf2ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:14.271048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f35390-2819-42bb-8a9e-89f71faf2ec0 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:14.271335 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f35390-2819-42bb-8a9e-89f71faf2ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:14.271762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f35390-2819-42bb-8a9e-89f71faf2ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:14.284316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f35390-2819-42bb-8a9e-89f71faf2ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:14.285955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f35390-2819-42bb-8a9e-89f71faf2ec0 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:14.296282 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1071/2158] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:54:16.852673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d7bfa-e28e-4948-ab50-b0c44643a6c1 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:16.853197 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d7bfa-e28e-4948-ab50-b0c44643a6c1 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:16.853197 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d7bfa-e28e-4948-ab50-b0c44643a6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:16.886928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-653d7bfa-e28e-4948-ab50-b0c44643a6c1 None None] MFA Rules not processed for user `410920eca8e246c7bdd9da55ff27eee7`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:16.888182 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-653d7bfa-e28e-4948-ab50-b0c44643a6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:16.976799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1088/2159] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:16.981459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f35390-2819-42bb-8a9e-89f71faf2ec0 service nova] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:16.994815 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f35390-2819-42bb-8a9e-89f71faf2ec0 service nova] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:17.001474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b5013-fc9a-4b5d-a874-0225612935a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:17.002100 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b5013-fc9a-4b5d-a874-0225612935a5 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:17.002471 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b5013-fc9a-4b5d-a874-0225612935a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:17.003562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b5013-fc9a-4b5d-a874-0225612935a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:17.004202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b5013-fc9a-4b5d-a874-0225612935a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:17.006210 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b5013-fc9a-4b5d-a874-0225612935a5 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:17.038886 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1072/2160] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:54:16 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:54:17.042997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d7bfa-e28e-4948-ab50-b0c44643a6c1 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:17.055250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d7bfa-e28e-4948-ab50-b0c44643a6c1 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:17.120726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f292c-1e43-45be-b8f0-c42c1dafde47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:17.121380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f292c-1e43-45be-b8f0-c42c1dafde47 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:17.121820 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f292c-1e43-45be-b8f0-c42c1dafde47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:17.121910 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f292c-1e43-45be-b8f0-c42c1dafde47 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:17.122545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f292c-1e43-45be-b8f0-c42c1dafde47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:17.124655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f292c-1e43-45be-b8f0-c42c1dafde47 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:17.164122 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1089/2161] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:54:17 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:54:17.168176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b5013-fc9a-4b5d-a874-0225612935a5 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:17.178757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b5013-fc9a-4b5d-a874-0225612935a5 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:17.183777 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d9bb7-a9c4-4b46-ab9f-4102cec9034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:17.184332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d9bb7-a9c4-4b46-ab9f-4102cec9034b admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:17.184615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d9bb7-a9c4-4b46-ab9f-4102cec9034b admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:17.184891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d9bb7-a9c4-4b46-ab9f-4102cec9034b admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:17.185649 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d9bb7-a9c4-4b46-ab9f-4102cec9034b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:17.187188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d9bb7-a9c4-4b46-ab9f-4102cec9034b admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:17.200078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1073/2162] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:54:17.204244 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f292c-1e43-45be-b8f0-c42c1dafde47 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:17.215059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f292c-1e43-45be-b8f0-c42c1dafde47 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:17.220161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79931830-e150-47b3-b383-33f1268110a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:17.220837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79931830-e150-47b3-b383-33f1268110a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:17.221194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79931830-e150-47b3-b383-33f1268110a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:17.221986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79931830-e150-47b3-b383-33f1268110a1 admin admin] PATH_INFO: `/v3/projects/c2f3a961f0d84281ab2a0adce42cfdab/users/0907af6794a84571840e855dc7150ba2/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:17.242845 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79931830-e150-47b3-b383-33f1268110a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f3a961f0d84281ab2a0adce42cfdab, user_id=0907af6794a84571840e855dc7150ba2, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:17.245605 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79931830-e150-47b3-b383-33f1268110a1 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:17.259916 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1090/2163] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:54:17 2022] PUT /identity/v3/projects/c2f3a961f0d84281ab2a0adce42cfdab/users/0907af6794a84571840e855dc7150ba2/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:54:17.263927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d9bb7-a9c4-4b46-ab9f-4102cec9034b admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:17.277379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d9bb7-a9c4-4b46-ab9f-4102cec9034b admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:17.338379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653f7a8-f247-475e-854f-da0fe5fed786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:17.339021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653f7a8-f247-475e-854f-da0fe5fed786 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:17.339295 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653f7a8-f247-475e-854f-da0fe5fed786 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:17.339567 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653f7a8-f247-475e-854f-da0fe5fed786 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:17.340405 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653f7a8-f247-475e-854f-da0fe5fed786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:17.342057 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653f7a8-f247-475e-854f-da0fe5fed786 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:17.354807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1074/2164] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:54:17.358917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79931830-e150-47b3-b383-33f1268110a1 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:17.370560 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79931830-e150-47b3-b383-33f1268110a1 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:17.375434 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d8c38-502a-472c-8879-157febda28e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:17.376104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d8c38-502a-472c-8879-157febda28e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:17.376391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d8c38-502a-472c-8879-157febda28e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:17.376667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d8c38-502a-472c-8879-157febda28e8 admin admin] PATH_INFO: `/v3/projects/c2f3a961f0d84281ab2a0adce42cfdab/users/0907af6794a84571840e855dc7150ba2/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:17.379193 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d8c38-502a-472c-8879-157febda28e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f3a961f0d84281ab2a0adce42cfdab, user_id=0907af6794a84571840e855dc7150ba2, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:17.381894 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d8c38-502a-472c-8879-157febda28e8 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:17.397115 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1091/2165] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:54:17 2022] PUT /identity/v3/projects/c2f3a961f0d84281ab2a0adce42cfdab/users/0907af6794a84571840e855dc7150ba2/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:54:21.461273 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17842f6e-ed34-4927-94aa-981a371466d8 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:21.461766 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17842f6e-ed34-4927-94aa-981a371466d8 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:21.461850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17842f6e-ed34-4927-94aa-981a371466d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:21.517973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-17842f6e-ed34-4927-94aa-981a371466d8 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:21.520419 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-17842f6e-ed34-4927-94aa-981a371466d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:21.657508 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:21.695327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1075/2166] 10.222.0.98 () {58 vars in 1016 bytes} [Fri Aug 26 08:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:21.711438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d8c38-502a-472c-8879-157febda28e8 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:21.714146 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9e1d8c38-502a-472c-8879-157febda28e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:21.766621 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:21.859578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d8c38-502a-472c-8879-157febda28e8 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:21.868893 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e5928-fcdf-45a0-85c9-6ff54dd53048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:21.869708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e5928-fcdf-45a0-85c9-6ff54dd53048 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:21.870196 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e5928-fcdf-45a0-85c9-6ff54dd53048 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:21.870578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e5928-fcdf-45a0-85c9-6ff54dd53048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:21.885402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e5928-fcdf-45a0-85c9-6ff54dd53048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:21.887876 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e5928-fcdf-45a0-85c9-6ff54dd53048 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:21.906463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1092/2167] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:54:22.434789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb912c6e-362f-4ed4-8d03-2cc841f7d130 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:22.435077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb912c6e-362f-4ed4-8d03-2cc841f7d130 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:22.435353 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb912c6e-362f-4ed4-8d03-2cc841f7d130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:22.480144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-fb912c6e-362f-4ed4-8d03-2cc841f7d130 None None] MFA Rules not processed for user `0907af6794a84571840e855dc7150ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:22.481407 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-fb912c6e-362f-4ed4-8d03-2cc841f7d130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:22.580208 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1076/2168] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:22.593645 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e5928-fcdf-45a0-85c9-6ff54dd53048 service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:22.660914 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e5928-fcdf-45a0-85c9-6ff54dd53048 service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:22.664724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04db67-734f-44ee-8017-15ca2ca8e9cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fde38c1a2a844368acd3e1b9aa10151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:22.665392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04db67-734f-44ee-8017-15ca2ca8e9cb service glance] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:22.665663 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04db67-734f-44ee-8017-15ca2ca8e9cb service glance] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:22.665937 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04db67-734f-44ee-8017-15ca2ca8e9cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:22.746001 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04db67-734f-44ee-8017-15ca2ca8e9cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:22.747450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04db67-734f-44ee-8017-15ca2ca8e9cb service glance] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:22.759881 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1093/2169] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:54:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:54:22.916499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7d530-a8d9-4ee7-abee-65e313ba1519 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:22.916669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7d530-a8d9-4ee7-abee-65e313ba1519 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:22.917065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7d530-a8d9-4ee7-abee-65e313ba1519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:22.940486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-0cd7d530-a8d9-4ee7-abee-65e313ba1519 None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:22.941756 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0cd7d530-a8d9-4ee7-abee-65e313ba1519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:23.001321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1077/2170] 10.222.0.76 () {58 vars in 1009 bytes} [Fri Aug 26 08:54:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:23.055602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04db67-734f-44ee-8017-15ca2ca8e9cb service glance] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:23.057235 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1f04db67-734f-44ee-8017-15ca2ca8e9cb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:23.119643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:23.137748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04db67-734f-44ee-8017-15ca2ca8e9cb service glance] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:23.143293 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c93e83-7e2e-4aba-9d9b-4b3b0c7f5cf0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:23.143901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c93e83-7e2e-4aba-9d9b-4b3b0c7f5cf0 service swift] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:23.144195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c93e83-7e2e-4aba-9d9b-4b3b0c7f5cf0 service swift] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:23.144449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c93e83-7e2e-4aba-9d9b-4b3b0c7f5cf0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:23.153284 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c93e83-7e2e-4aba-9d9b-4b3b0c7f5cf0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:23.154960 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c93e83-7e2e-4aba-9d9b-4b3b0c7f5cf0 service swift] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:23.167475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1094/2171] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 08:54:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 08:54:25.210874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f983c77-7acf-4bf7-9259-c48f204f08d0 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:25.214256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f983c77-7acf-4bf7-9259-c48f204f08d0 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:25.214713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f983c77-7acf-4bf7-9259-c48f204f08d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:25.257334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-7f983c77-7acf-4bf7-9259-c48f204f08d0 None None] MFA Rules not processed for user `598d44b6fb21463985745e862d0b827f`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:25.258757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7f983c77-7acf-4bf7-9259-c48f204f08d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:25.361387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1078/2172] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:26.798418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc8ef2-d908-4d99-bc52-df1cd35f74b3 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:26.799009 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc8ef2-d908-4d99-bc52-df1cd35f74b3 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:26.799698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc8ef2-d908-4d99-bc52-df1cd35f74b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:26.833438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-57fc8ef2-d908-4d99-bc52-df1cd35f74b3 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:26.835374 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-57fc8ef2-d908-4d99-bc52-df1cd35f74b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:26.859147 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1095/2173] 10.222.0.98 () {58 vars in 1016 bytes} [Fri Aug 26 08:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:26.891813 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f983c77-7acf-4bf7-9259-c48f204f08d0 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:26.911641 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f983c77-7acf-4bf7-9259-c48f204f08d0 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:26.918946 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374bd5e-bb77-40a2-884d-1c1c21fbc627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:26.919690 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374bd5e-bb77-40a2-884d-1c1c21fbc627 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:26.919982 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374bd5e-bb77-40a2-884d-1c1c21fbc627 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:26.920263 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374bd5e-bb77-40a2-884d-1c1c21fbc627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:26.930818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374bd5e-bb77-40a2-884d-1c1c21fbc627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:26.932590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374bd5e-bb77-40a2-884d-1c1c21fbc627 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:26.962610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1079/2174] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:54:32.060281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22032e-2fd5-4803-a25c-a357055e2d7b None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:32.061211 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22032e-2fd5-4803-a25c-a357055e2d7b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:32.061646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22032e-2fd5-4803-a25c-a357055e2d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:32.083861 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0f22032e-2fd5-4803-a25c-a357055e2d7b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:32.085480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0f22032e-2fd5-4803-a25c-a357055e2d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:32.093953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1096/2175] 10.222.0.98 () {58 vars in 1016 bytes} [Fri Aug 26 08:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:32.110176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374bd5e-bb77-40a2-884d-1c1c21fbc627 service nova] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:32.121660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374bd5e-bb77-40a2-884d-1c1c21fbc627 service nova] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:32.131617 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081af368-a888-491e-acac-c8f8d1bedd9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:32.132480 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081af368-a888-491e-acac-c8f8d1bedd9e service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:32.132866 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081af368-a888-491e-acac-c8f8d1bedd9e service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:32.133374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081af368-a888-491e-acac-c8f8d1bedd9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:32.144778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081af368-a888-491e-acac-c8f8d1bedd9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:32.146529 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081af368-a888-491e-acac-c8f8d1bedd9e service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:32.163664 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1080/2176] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:54:33.573840 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de53f3a-1ea7-4089-9ba2-2bdba714adf8 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:33.574402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de53f3a-1ea7-4089-9ba2-2bdba714adf8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:33.574402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de53f3a-1ea7-4089-9ba2-2bdba714adf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:33.594106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-4de53f3a-1ea7-4089-9ba2-2bdba714adf8 None None] MFA Rules not processed for user `410920eca8e246c7bdd9da55ff27eee7`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:33.595319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4de53f3a-1ea7-4089-9ba2-2bdba714adf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:33.602220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1097/2177] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:39.991980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a9f96-82f0-4e03-acee-b7101754f0bc None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:39.991980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a9f96-82f0-4e03-acee-b7101754f0bc None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:39.992639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a9f96-82f0-4e03-acee-b7101754f0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:40.000730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:40.013888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-030a9f96-82f0-4e03-acee-b7101754f0bc None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:40.015097 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-030a9f96-82f0-4e03-acee-b7101754f0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:40.022487 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1081/2178] 10.222.0.76 () {58 vars in 1009 bytes} [Fri Aug 26 08:54:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:40.034870 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de53f3a-1ea7-4089-9ba2-2bdba714adf8 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:40.054471 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de53f3a-1ea7-4089-9ba2-2bdba714adf8 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:40.059532 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61418f-8fa0-4757-942f-4c4ad0e35d51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:40.060789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61418f-8fa0-4757-942f-4c4ad0e35d51 service swift] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:40.060789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61418f-8fa0-4757-942f-4c4ad0e35d51 service swift] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:40.060789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61418f-8fa0-4757-942f-4c4ad0e35d51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:40.071537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61418f-8fa0-4757-942f-4c4ad0e35d51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:40.073132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61418f-8fa0-4757-942f-4c4ad0e35d51 service swift] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:40.086575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1098/2179] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 08:54:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 08:54:44.933336 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a9f96-82f0-4e03-acee-b7101754f0bc None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:44.946962 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a9f96-82f0-4e03-acee-b7101754f0bc None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:44.951506 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98020a-3279-4013-8921-0240551f6536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:44.952167 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98020a-3279-4013-8921-0240551f6536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:44.952453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98020a-3279-4013-8921-0240551f6536 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:44.952733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98020a-3279-4013-8921-0240551f6536 admin admin] PATH_INFO: `/v3/users/c95252705eb94c608e38402fbc9f359a` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:44.953910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98020a-3279-4013-8921-0240551f6536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c95252705eb94c608e38402fbc9f359a)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:44.955839 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98020a-3279-4013-8921-0240551f6536 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:45.056065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6f98020a-3279-4013-8921-0240551f6536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c95252705eb94c608e38402fbc9f359a'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:45.068657 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6f98020a-3279-4013-8921-0240551f6536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c95252705eb94c608e38402fbc9f359a'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:45.069613 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6f98020a-3279-4013-8921-0240551f6536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c95252705eb94c608e38402fbc9f359a'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:45.070092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6f98020a-3279-4013-8921-0240551f6536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c95252705eb94c608e38402fbc9f359a'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:45.078555 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6f98020a-3279-4013-8921-0240551f6536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c95252705eb94c608e38402fbc9f359a'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:45.096406 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1082/2180] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:54:44 2022] DELETE /identity/v3/users/c95252705eb94c608e38402fbc9f359a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:54:45.101501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72adcbc-0ef9-400c-bcc7-5ed68a3502b0 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:45.102053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72adcbc-0ef9-400c-bcc7-5ed68a3502b0 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:45.102053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72adcbc-0ef9-400c-bcc7-5ed68a3502b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:45.121026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-a72adcbc-0ef9-400c-bcc7-5ed68a3502b0 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:45.122237 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a72adcbc-0ef9-400c-bcc7-5ed68a3502b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:45.182334 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1099/2181] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:45.191795 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98020a-3279-4013-8921-0240551f6536 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:45.193235 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-6f98020a-3279-4013-8921-0240551f6536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:45.253681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98020a-3279-4013-8921-0240551f6536 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:45.257483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff7f7f-3d54-4641-9524-6f60984bc5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:45.258099 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff7f7f-3d54-4641-9524-6f60984bc5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:45.258382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff7f7f-3d54-4641-9524-6f60984bc5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:45.259154 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff7f7f-3d54-4641-9524-6f60984bc5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:45.269499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff7f7f-3d54-4641-9524-6f60984bc5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:45.270941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff7f7f-3d54-4641-9524-6f60984bc5d4 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:45.281358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1083/2182] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:54:45.548348 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72adcbc-0ef9-400c-bcc7-5ed68a3502b0 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:45.550064 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a72adcbc-0ef9-400c-bcc7-5ed68a3502b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:45.567733 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72adcbc-0ef9-400c-bcc7-5ed68a3502b0 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:45.574692 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82da4e-b91d-422d-a9e8-a79f75c714dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:45.575446 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82da4e-b91d-422d-a9e8-a79f75c714dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:45.575803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82da4e-b91d-422d-a9e8-a79f75c714dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:45.576183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82da4e-b91d-422d-a9e8-a79f75c714dd admin admin] PATH_INFO: `/v3/projects/a8b4402027c2457b846811ebef24e6f0` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:45.577413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82da4e-b91d-422d-a9e8-a79f75c714dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8b4402027c2457b846811ebef24e6f0)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:45.581945 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82da4e-b91d-422d-a9e8-a79f75c714dd admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:45.640947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be82da4e-b91d-422d-a9e8-a79f75c714dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b4402027c2457b846811ebef24e6f0', 'request_id': 'req-be82da4e-b91d-422d-a9e8-a79f75c714dd'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:45.647773 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be82da4e-b91d-422d-a9e8-a79f75c714dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b4402027c2457b846811ebef24e6f0', 'request_id': 'req-be82da4e-b91d-422d-a9e8-a79f75c714dd'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:45.655315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be82da4e-b91d-422d-a9e8-a79f75c714dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b4402027c2457b846811ebef24e6f0', 'request_id': 'req-be82da4e-b91d-422d-a9e8-a79f75c714dd'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:45.665925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be82da4e-b91d-422d-a9e8-a79f75c714dd admin admin] The token cache is being invalidate because project a8b4402027c2457b846811ebef24e6f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:54:45.666276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be82da4e-b91d-422d-a9e8-a79f75c714dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:45.666969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be82da4e-b91d-422d-a9e8-a79f75c714dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:45.668835 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1100/2183] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:54:45 2022] DELETE /identity/v3/projects/a8b4402027c2457b846811ebef24e6f0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:54:45.673448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9450caf-a0f7-4d09-a972-b457de190f92 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:45.673742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9450caf-a0f7-4d09-a972-b457de190f92 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:45.674023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9450caf-a0f7-4d09-a972-b457de190f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:45.695015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-d9450caf-a0f7-4d09-a972-b457de190f92 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:45.696234 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d9450caf-a0f7-4d09-a972-b457de190f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:45.766011 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1084/2184] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:45.774035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e549ee8-8e97-4de8-813d-7fe0fc73b761 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:45.774326 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e549ee8-8e97-4de8-813d-7fe0fc73b761 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:45.774605 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e549ee8-8e97-4de8-813d-7fe0fc73b761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:45.800378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-6e549ee8-8e97-4de8-813d-7fe0fc73b761 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:45.801784 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6e549ee8-8e97-4de8-813d-7fe0fc73b761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:45.818315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1101/2185] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:45.821720 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9450caf-a0f7-4d09-a972-b457de190f92 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:45.833369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9450caf-a0f7-4d09-a972-b457de190f92 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:45.838261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6400f-c880-4dc0-8d6a-852ff5457579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:45.839235 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6400f-c880-4dc0-8d6a-852ff5457579 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:45.839520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6400f-c880-4dc0-8d6a-852ff5457579 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:45.839796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6400f-c880-4dc0-8d6a-852ff5457579 admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:45.840520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6400f-c880-4dc0-8d6a-852ff5457579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:54:45.840774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6400f-c880-4dc0-8d6a-852ff5457579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:45.842480 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6400f-c880-4dc0-8d6a-852ff5457579 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:45.852891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:45.858337 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1085/2186] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:54:45.861556 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e549ee8-8e97-4de8-813d-7fe0fc73b761 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:45.873822 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e549ee8-8e97-4de8-813d-7fe0fc73b761 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:45.879883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22c9d6-89b6-4f3d-9fe5-7338ff00fcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:45.880717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22c9d6-89b6-4f3d-9fe5-7338ff00fcb4 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:45.881219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22c9d6-89b6-4f3d-9fe5-7338ff00fcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:45.881668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22c9d6-89b6-4f3d-9fe5-7338ff00fcb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:45.882479 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22c9d6-89b6-4f3d-9fe5-7338ff00fcb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:45.884731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22c9d6-89b6-4f3d-9fe5-7338ff00fcb4 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:45.937764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1102/2187] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:54:45 2022] POST /identity/v3/projects => generated 389 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:54:45.942581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6400f-c880-4dc0-8d6a-852ff5457579 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:45.954549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6400f-c880-4dc0-8d6a-852ff5457579 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:46.038575 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892664ed-d06b-43c4-b88c-d75be4d4dac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:46.039175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892664ed-d06b-43c4-b88c-d75be4d4dac0 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:46.039460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892664ed-d06b-43c4-b88c-d75be4d4dac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:46.039735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892664ed-d06b-43c4-b88c-d75be4d4dac0 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:46.040374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892664ed-d06b-43c4-b88c-d75be4d4dac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:46.042349 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892664ed-d06b-43c4-b88c-d75be4d4dac0 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:46.064094 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1086/2188] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:54:45 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:54:46.069433 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22c9d6-89b6-4f3d-9fe5-7338ff00fcb4 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:46.076826 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:46.080875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22c9d6-89b6-4f3d-9fe5-7338ff00fcb4 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:46.087093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59365d-308f-42a7-86c7-9294f3954489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:46.087929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59365d-308f-42a7-86c7-9294f3954489 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:46.088237 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59365d-308f-42a7-86c7-9294f3954489 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:46.089022 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59365d-308f-42a7-86c7-9294f3954489 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:46.089392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59365d-308f-42a7-86c7-9294f3954489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:46.091037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59365d-308f-42a7-86c7-9294f3954489 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:46.106909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1103/2189] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:54:46.111143 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892664ed-d06b-43c4-b88c-d75be4d4dac0 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:46.121885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892664ed-d06b-43c4-b88c-d75be4d4dac0 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:46.129355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac65b5-03b7-439b-985f-f2ccfc58b35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:46.129970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac65b5-03b7-439b-985f-f2ccfc58b35f admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:46.130266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac65b5-03b7-439b-985f-f2ccfc58b35f admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:46.130645 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac65b5-03b7-439b-985f-f2ccfc58b35f admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:46.131415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac65b5-03b7-439b-985f-f2ccfc58b35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:46.133102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac65b5-03b7-439b-985f-f2ccfc58b35f admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:46.144753 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1087/2190] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:54:46.149309 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59365d-308f-42a7-86c7-9294f3954489 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:46.160948 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59365d-308f-42a7-86c7-9294f3954489 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:46.166240 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23857f-c463-473c-97b0-2766c77d1be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:46.171122 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23857f-c463-473c-97b0-2766c77d1be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:46.171460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23857f-c463-473c-97b0-2766c77d1be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:46.171735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23857f-c463-473c-97b0-2766c77d1be0 admin admin] PATH_INFO: `/v3/projects/e9ec109bce34461693da7853130ab4c8/users/1130c9be4979465c8adf073d2cd27fa9/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:46.188080 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23857f-c463-473c-97b0-2766c77d1be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ec109bce34461693da7853130ab4c8, user_id=1130c9be4979465c8adf073d2cd27fa9, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:46.193574 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23857f-c463-473c-97b0-2766c77d1be0 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:46.207578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1104/2191] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:54:46 2022] PUT /identity/v3/projects/e9ec109bce34461693da7853130ab4c8/users/1130c9be4979465c8adf073d2cd27fa9/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:54:46.218298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b236a6-394b-42e6-9ec4-a84320c97b33 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:46.218583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b236a6-394b-42e6-9ec4-a84320c97b33 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:46.218999 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b236a6-394b-42e6-9ec4-a84320c97b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:46.248610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-33b236a6-394b-42e6-9ec4-a84320c97b33 None None] MFA Rules not processed for user `1130c9be4979465c8adf073d2cd27fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:46.249879 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-33b236a6-394b-42e6-9ec4-a84320c97b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:46.320675 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1088/2192] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:54:46.331671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23857f-c463-473c-97b0-2766c77d1be0 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:46.333444 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ba23857f-c463-473c-97b0-2766c77d1be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:46.393769 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23857f-c463-473c-97b0-2766c77d1be0 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:46.397481 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc7a88-932e-42e2-ba6f-b1367753001a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:46.398089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc7a88-932e-42e2-ba6f-b1367753001a service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:46.398377 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc7a88-932e-42e2-ba6f-b1367753001a service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:46.398657 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc7a88-932e-42e2-ba6f-b1367753001a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:46.407512 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc7a88-932e-42e2-ba6f-b1367753001a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:46.408955 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc7a88-932e-42e2-ba6f-b1367753001a service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:46.418365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1105/2193] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:54:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:54:56.317193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:56.414256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:58.302808 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b236a6-394b-42e6-9ec4-a84320c97b33 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:58.304370 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-33b236a6-394b-42e6-9ec4-a84320c97b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:58.397821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b236a6-394b-42e6-9ec4-a84320c97b33 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:58.417837 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed0107-175b-45ba-a2e3-5642aacd16e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95abbd88e549427abbf5699efed0451a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:58.418425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed0107-175b-45ba-a2e3-5642aacd16e5 service placement] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:58.418765 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed0107-175b-45ba-a2e3-5642aacd16e5 service placement] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:58.419122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed0107-175b-45ba-a2e3-5642aacd16e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:58.421041 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-63ed0107-175b-45ba-a2e3-5642aacd16e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:58.434033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed0107-175b-45ba-a2e3-5642aacd16e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:58.436148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed0107-175b-45ba-a2e3-5642aacd16e5 service placement] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:58.448601 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1089/2194] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:54:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:54:58.665906 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc7a88-932e-42e2-ba6f-b1367753001a service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:58.776207 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc7a88-932e-42e2-ba6f-b1367753001a service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:58.786202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645fe8a-24c8-4bd4-8c99-360a73653064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:58.790577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645fe8a-24c8-4bd4-8c99-360a73653064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:58.790577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645fe8a-24c8-4bd4-8c99-360a73653064 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:58.790577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645fe8a-24c8-4bd4-8c99-360a73653064 admin admin] PATH_INFO: `/v3/users/1130c9be4979465c8adf073d2cd27fa9` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:58.792957 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645fe8a-24c8-4bd4-8c99-360a73653064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1130c9be4979465c8adf073d2cd27fa9)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:58.795855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645fe8a-24c8-4bd4-8c99-360a73653064 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:58.902822 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6645fe8a-24c8-4bd4-8c99-360a73653064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1130c9be4979465c8adf073d2cd27fa9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:58.924953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6645fe8a-24c8-4bd4-8c99-360a73653064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1130c9be4979465c8adf073d2cd27fa9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:58.925925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6645fe8a-24c8-4bd4-8c99-360a73653064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1130c9be4979465c8adf073d2cd27fa9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:58.940873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6645fe8a-24c8-4bd4-8c99-360a73653064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1130c9be4979465c8adf073d2cd27fa9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:58.975844 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6645fe8a-24c8-4bd4-8c99-360a73653064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1130c9be4979465c8adf073d2cd27fa9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:58.997724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1106/2195] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:54:58 2022] DELETE /identity/v3/users/1130c9be4979465c8adf073d2cd27fa9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:54:59.003570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126e99e-faff-4f91-82f0-ac0c619e8ca2 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:59.003930 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126e99e-faff-4f91-82f0-ac0c619e8ca2 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:59.004275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126e99e-faff-4f91-82f0-ac0c619e8ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:59.030198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-a126e99e-faff-4f91-82f0-ac0c619e8ca2 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:54:59.031598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a126e99e-faff-4f91-82f0-ac0c619e8ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:59.109081 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1090/2196] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:54:59.126687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645fe8a-24c8-4bd4-8c99-360a73653064 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:59.129864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6645fe8a-24c8-4bd4-8c99-360a73653064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:59.194185 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645fe8a-24c8-4bd4-8c99-360a73653064 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:59.198234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1a7a2-9f02-471d-bde3-a3fe333a7091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:59.199015 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1a7a2-9f02-471d-bde3-a3fe333a7091 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:59.201061 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1a7a2-9f02-471d-bde3-a3fe333a7091 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:59.201061 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1a7a2-9f02-471d-bde3-a3fe333a7091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:59.210621 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1a7a2-9f02-471d-bde3-a3fe333a7091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:59.212142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1a7a2-9f02-471d-bde3-a3fe333a7091 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:59.222102 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1107/2197] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:54:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:54:59.504272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126e99e-faff-4f91-82f0-ac0c619e8ca2 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:54:59.506712 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a126e99e-faff-4f91-82f0-ac0c619e8ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:54:59.523365 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126e99e-faff-4f91-82f0-ac0c619e8ca2 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:54:59.534459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30a6d4-33e8-4f01-8569-67f80bcaa8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:54:59.535301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30a6d4-33e8-4f01-8569-67f80bcaa8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:54:59.535682 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30a6d4-33e8-4f01-8569-67f80bcaa8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:54:59.536175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30a6d4-33e8-4f01-8569-67f80bcaa8cc admin admin] PATH_INFO: `/v3/projects/e9ec109bce34461693da7853130ab4c8` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:54:59.537771 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30a6d4-33e8-4f01-8569-67f80bcaa8cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ec109bce34461693da7853130ab4c8)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:54:59.540200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30a6d4-33e8-4f01-8569-67f80bcaa8cc admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:54:59.626704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5d30a6d4-33e8-4f01-8569-67f80bcaa8cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ec109bce34461693da7853130ab4c8', 'request_id': 'req-5d30a6d4-33e8-4f01-8569-67f80bcaa8cc'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:59.633960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5d30a6d4-33e8-4f01-8569-67f80bcaa8cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ec109bce34461693da7853130ab4c8', 'request_id': 'req-5d30a6d4-33e8-4f01-8569-67f80bcaa8cc'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:59.642597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5d30a6d4-33e8-4f01-8569-67f80bcaa8cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ec109bce34461693da7853130ab4c8', 'request_id': 'req-5d30a6d4-33e8-4f01-8569-67f80bcaa8cc'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:59.654008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5d30a6d4-33e8-4f01-8569-67f80bcaa8cc admin admin] The token cache is being invalidate because project e9ec109bce34461693da7853130ab4c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:54:59.654295 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5d30a6d4-33e8-4f01-8569-67f80bcaa8cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:59.654933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5d30a6d4-33e8-4f01-8569-67f80bcaa8cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:54:59.656406 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1091/2198] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:54:59 2022] DELETE /identity/v3/projects/e9ec109bce34461693da7853130ab4c8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:55:09.218147 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:09.650955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:15.604683 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e6abc-a99d-4516-a3aa-38d7cb6fd7d7 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:55:15.605218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e6abc-a99d-4516-a3aa-38d7cb6fd7d7 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:55:15.605398 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e6abc-a99d-4516-a3aa-38d7cb6fd7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:55:15.624324 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-b04e6abc-a99d-4516-a3aa-38d7cb6fd7d7 None None] MFA Rules not processed for user `227b557cd48c4fe8810e9b4c25ea202a`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:55:15.625507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b04e6abc-a99d-4516-a3aa-38d7cb6fd7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:55:15.678377 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1108/2199] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:55:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:55:25.671881 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=25 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:28.498366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7f1b1-02b4-4ea9-b14a-6ab58f0a0830 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:55:28.499212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7f1b1-02b4-4ea9-b14a-6ab58f0a0830 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:55:28.499656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7f1b1-02b4-4ea9-b14a-6ab58f0a0830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:55:28.502180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e6abc-a99d-4516-a3aa-38d7cb6fd7d7 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:55:28.504642 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b04e6abc-a99d-4516-a3aa-38d7cb6fd7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:55:28.522793 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-e3e7f1b1-02b4-4ea9-b14a-6ab58f0a0830 None None] MFA Rules not processed for user `798c692df3b141849d5a4427b3cd1e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:55:28.524205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-e3e7f1b1-02b4-4ea9-b14a-6ab58f0a0830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:55:28.567352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e6abc-a99d-4516-a3aa-38d7cb6fd7d7 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:55:28.571345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9ea77-b4d9-44cd-b5c5-a47edc1f21ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:55:28.571941 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9ea77-b4d9-44cd-b5c5-a47edc1f21ce service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:55:28.572218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9ea77-b4d9-44cd-b5c5-a47edc1f21ce service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:55:28.572490 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9ea77-b4d9-44cd-b5c5-a47edc1f21ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:55:28.578278 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-26d9ea77-b4d9-44cd-b5c5-a47edc1f21ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:55:28.588309 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1092/2200] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:55:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:55:28.642716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9ea77-b4d9-44cd-b5c5-a47edc1f21ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:55:28.644692 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9ea77-b4d9-44cd-b5c5-a47edc1f21ce service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:55:28.654761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1109/2201] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:55:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:55:36.525093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a026e27-88ff-474e-af15-340b6bd08631 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:55:36.525617 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a026e27-88ff-474e-af15-340b6bd08631 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:55:36.525734 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a026e27-88ff-474e-af15-340b6bd08631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:55:36.545168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-0a026e27-88ff-474e-af15-340b6bd08631 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:55:36.546382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0a026e27-88ff-474e-af15-340b6bd08631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:55:36.612192 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1093/2202] 10.222.0.98 () {58 vars in 1016 bytes} [Fri Aug 26 08:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:55:36.632420 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9ea77-b4d9-44cd-b5c5-a47edc1f21ce service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:55:36.633928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-26d9ea77-b4d9-44cd-b5c5-a47edc1f21ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:55:36.714530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9ea77-b4d9-44cd-b5c5-a47edc1f21ce service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:55:36.720389 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d130103-1c02-424b-9594-98292f0df150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:55:36.720987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d130103-1c02-424b-9594-98292f0df150 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:55:36.721304 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d130103-1c02-424b-9594-98292f0df150 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:55:36.721574 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d130103-1c02-424b-9594-98292f0df150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:55:36.730768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d130103-1c02-424b-9594-98292f0df150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:55:36.732908 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d130103-1c02-424b-9594-98292f0df150 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:55:36.744513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1110/2203] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:55:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:55:44.963031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a5d88-9a90-492b-b31f-1d890de16b66 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:55:44.963481 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a5d88-9a90-492b-b31f-1d890de16b66 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:55:44.963698 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a5d88-9a90-492b-b31f-1d890de16b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:55:44.984032 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-637a5d88-9a90-492b-b31f-1d890de16b66 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:55:44.985264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-637a5d88-9a90-492b-b31f-1d890de16b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:55:44.993007 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1094/2204] 10.222.0.98 () {58 vars in 1016 bytes} [Fri Aug 26 08:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:55:45.011110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d130103-1c02-424b-9594-98292f0df150 service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:55:45.022635 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d130103-1c02-424b-9594-98292f0df150 service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:55:45.028002 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c45166-ca66-475c-a0b8-82654452c121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:55:45.028584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c45166-ca66-475c-a0b8-82654452c121 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:55:45.028863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c45166-ca66-475c-a0b8-82654452c121 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:55:45.029179 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c45166-ca66-475c-a0b8-82654452c121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:55:45.037089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c45166-ca66-475c-a0b8-82654452c121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:55:45.038639 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c45166-ca66-475c-a0b8-82654452c121 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:55:45.047850 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1111/2205] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:55:52.165427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060145c-1fed-411c-8c4f-0026b3fbdf51 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:55:52.166007 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060145c-1fed-411c-8c4f-0026b3fbdf51 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:55:52.166007 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060145c-1fed-411c-8c4f-0026b3fbdf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:55:52.173751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=56 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:52.186980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-9060145c-1fed-411c-8c4f-0026b3fbdf51 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:55:52.188220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-9060145c-1fed-411c-8c4f-0026b3fbdf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:55:52.196820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1095/2206] 10.222.0.98 () {58 vars in 1016 bytes} [Fri Aug 26 08:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:55:52.230516 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c45166-ca66-475c-a0b8-82654452c121 service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:55:52.242372 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c45166-ca66-475c-a0b8-82654452c121 service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:55:52.247942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1131c-6b4c-49a8-81dd-cb869f091db5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:55:52.248560 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1131c-6b4c-49a8-81dd-cb869f091db5 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:55:52.248846 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1131c-6b4c-49a8-81dd-cb869f091db5 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:55:52.249155 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1131c-6b4c-49a8-81dd-cb869f091db5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:55:52.259064 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1131c-6b4c-49a8-81dd-cb869f091db5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:55:52.260736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1131c-6b4c-49a8-81dd-cb869f091db5 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:55:52.272705 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1112/2207] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:55:57.340474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba6cf2-8508-4323-8fd1-5296d0388f32 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:55:57.340933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba6cf2-8508-4323-8fd1-5296d0388f32 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:55:57.341069 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba6cf2-8508-4323-8fd1-5296d0388f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:55:57.360445 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ecba6cf2-8508-4323-8fd1-5296d0388f32 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:55:57.361669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ecba6cf2-8508-4323-8fd1-5296d0388f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:55:57.369874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1096/2208] 10.222.0.98 () {58 vars in 1016 bytes} [Fri Aug 26 08:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:55:57.390119 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1131c-6b4c-49a8-81dd-cb869f091db5 service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:55:57.396010 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:57.402311 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1131c-6b4c-49a8-81dd-cb869f091db5 service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:55:57.407719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf924a-40e6-4bc6-9b02-9a6327452678 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:55:57.408355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf924a-40e6-4bc6-9b02-9a6327452678 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:55:57.408632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf924a-40e6-4bc6-9b02-9a6327452678 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:55:57.408900 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf924a-40e6-4bc6-9b02-9a6327452678 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:55:57.417576 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf924a-40e6-4bc6-9b02-9a6327452678 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:55:57.419128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf924a-40e6-4bc6-9b02-9a6327452678 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:55:57.428894 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1113/2209] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:56:03.615988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787dc73a-62ce-4a4c-aa7e-ffb50fd42bdb None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:56:03.616447 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787dc73a-62ce-4a4c-aa7e-ffb50fd42bdb None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:56:03.616644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787dc73a-62ce-4a4c-aa7e-ffb50fd42bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:56:03.635512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-787dc73a-62ce-4a4c-aa7e-ffb50fd42bdb None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:56:03.636680 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-787dc73a-62ce-4a4c-aa7e-ffb50fd42bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:56:03.644308 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1097/2210] 10.222.0.98 () {58 vars in 1016 bytes} [Fri Aug 26 08:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:56:03.659956 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf924a-40e6-4bc6-9b02-9a6327452678 service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:56:03.662041 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c2bf924a-40e6-4bc6-9b02-9a6327452678 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:56:03.676321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf924a-40e6-4bc6-9b02-9a6327452678 service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:56:03.682379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d56c72-6473-4476-8b2a-be33a8497d5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:56:03.682967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d56c72-6473-4476-8b2a-be33a8497d5b service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:56:03.683248 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d56c72-6473-4476-8b2a-be33a8497d5b service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:56:03.683523 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d56c72-6473-4476-8b2a-be33a8497d5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:56:03.691517 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d56c72-6473-4476-8b2a-be33a8497d5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:56:03.693106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d56c72-6473-4476-8b2a-be33a8497d5b service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:56:03.702414 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1114/2211] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:56:13.631033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=8 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:56:13.698263 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=11 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:56:39.026835 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787dc73a-62ce-4a4c-aa7e-ffb50fd42bdb None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:56:39.028879 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-787dc73a-62ce-4a4c-aa7e-ffb50fd42bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:56:39.041369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787dc73a-62ce-4a4c-aa7e-ffb50fd42bdb None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:56:39.046314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f556b-4d3f-4ee0-b0d8-154192381e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:56:39.046971 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f556b-4d3f-4ee0-b0d8-154192381e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:56:39.047256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f556b-4d3f-4ee0-b0d8-154192381e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:56:39.047530 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f556b-4d3f-4ee0-b0d8-154192381e93 admin admin] PATH_INFO: `/v3/users/227b557cd48c4fe8810e9b4c25ea202a` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:56:39.048677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f556b-4d3f-4ee0-b0d8-154192381e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=227b557cd48c4fe8810e9b4c25ea202a)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:56:39.050651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f556b-4d3f-4ee0-b0d8-154192381e93 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:56:39.099550 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-312f556b-4d3f-4ee0-b0d8-154192381e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227b557cd48c4fe8810e9b4c25ea202a'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:56:39.106976 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-312f556b-4d3f-4ee0-b0d8-154192381e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227b557cd48c4fe8810e9b4c25ea202a'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:56:39.107644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-312f556b-4d3f-4ee0-b0d8-154192381e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227b557cd48c4fe8810e9b4c25ea202a'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:56:39.108399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-312f556b-4d3f-4ee0-b0d8-154192381e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227b557cd48c4fe8810e9b4c25ea202a'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:56:39.115432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-312f556b-4d3f-4ee0-b0d8-154192381e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227b557cd48c4fe8810e9b4c25ea202a'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:56:39.132104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1098/2212] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:56:39 2022] DELETE /identity/v3/users/227b557cd48c4fe8810e9b4c25ea202a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:56:39.310609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d56c72-6473-4476-8b2a-be33a8497d5b service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:56:39.328666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d56c72-6473-4476-8b2a-be33a8497d5b service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:56:39.395267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f5821-deba-4ac4-b12c-f71647cd5332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:56:39.395903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f5821-deba-4ac4-b12c-f71647cd5332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:56:39.396187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f5821-deba-4ac4-b12c-f71647cd5332 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:56:39.396464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f5821-deba-4ac4-b12c-f71647cd5332 admin admin] PATH_INFO: `/v3/projects/675f043ad5aa4c60a8d6831975eea4df` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:56:39.397621 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f5821-deba-4ac4-b12c-f71647cd5332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=675f043ad5aa4c60a8d6831975eea4df)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:56:39.399529 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f5821-deba-4ac4-b12c-f71647cd5332 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:56:39.457100 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d38f5821-deba-4ac4-b12c-f71647cd5332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '675f043ad5aa4c60a8d6831975eea4df', 'request_id': 'req-d38f5821-deba-4ac4-b12c-f71647cd5332'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:56:39.463676 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d38f5821-deba-4ac4-b12c-f71647cd5332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '675f043ad5aa4c60a8d6831975eea4df', 'request_id': 'req-d38f5821-deba-4ac4-b12c-f71647cd5332'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:56:39.472984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d38f5821-deba-4ac4-b12c-f71647cd5332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '675f043ad5aa4c60a8d6831975eea4df', 'request_id': 'req-d38f5821-deba-4ac4-b12c-f71647cd5332'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:56:39.483901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d38f5821-deba-4ac4-b12c-f71647cd5332 admin admin] The token cache is being invalidate because project 675f043ad5aa4c60a8d6831975eea4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:56:39.484197 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d38f5821-deba-4ac4-b12c-f71647cd5332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:56:39.484837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d38f5821-deba-4ac4-b12c-f71647cd5332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:56:39.486577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1115/2213] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:56:39 2022] DELETE /identity/v3/projects/675f043ad5aa4c60a8d6831975eea4df => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:56:45.770519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8a498-81fa-4aa3-945c-bb2890961f04 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:56:45.770985 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8a498-81fa-4aa3-945c-bb2890961f04 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:56:45.771322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8a498-81fa-4aa3-945c-bb2890961f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:56:45.791949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-15c8a498-81fa-4aa3-945c-bb2890961f04 None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:56:45.793698 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-15c8a498-81fa-4aa3-945c-bb2890961f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:56:45.849993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1099/2214] 10.222.0.76 () {58 vars in 1009 bytes} [Fri Aug 26 08:56:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:56:45.890299 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f5821-deba-4ac4-b12c-f71647cd5332 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:56:45.891694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d38f5821-deba-4ac4-b12c-f71647cd5332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:56:45.960090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f5821-deba-4ac4-b12c-f71647cd5332 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:56:45.965121 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b9d0f-b871-45d0-ba97-35e309580c27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:56:45.965726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b9d0f-b871-45d0-ba97-35e309580c27 service swift] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:56:45.966128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b9d0f-b871-45d0-ba97-35e309580c27 service swift] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:56:45.966407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b9d0f-b871-45d0-ba97-35e309580c27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:56:45.974803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b9d0f-b871-45d0-ba97-35e309580c27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:56:45.976411 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b9d0f-b871-45d0-ba97-35e309580c27 service swift] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:56:45.984955 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1116/2215] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 08:56:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 08:56:54.862299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8a498-81fa-4aa3-945c-bb2890961f04 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:56:54.864623 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-15c8a498-81fa-4aa3-945c-bb2890961f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:56:54.942475 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8a498-81fa-4aa3-945c-bb2890961f04 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:56:54.946484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b99af-173e-40db-8381-8d55fca17d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:56:54.947219 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b99af-173e-40db-8381-8d55fca17d4d service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:56:54.947605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b99af-173e-40db-8381-8d55fca17d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:56:54.947998 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b99af-173e-40db-8381-8d55fca17d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:56:54.950644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-256b99af-173e-40db-8381-8d55fca17d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:56:54.985318 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:56:55.029225 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b99af-173e-40db-8381-8d55fca17d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:56:55.030663 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b99af-173e-40db-8381-8d55fca17d4d service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:56:55.049064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1100/2216] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:56:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:56:55.265117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b9d0f-b871-45d0-ba97-35e309580c27 service swift] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:56:55.274430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b9d0f-b871-45d0-ba97-35e309580c27 service swift] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:56:55.278054 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97db80-7773-4145-bddb-e0657aab46a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:56:55.278641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97db80-7773-4145-bddb-e0657aab46a7 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:56:55.278924 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97db80-7773-4145-bddb-e0657aab46a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:56:55.279197 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97db80-7773-4145-bddb-e0657aab46a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:56:55.280875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6e97db80-7773-4145-bddb-e0657aab46a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:56:55.293901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97db80-7773-4145-bddb-e0657aab46a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:56:55.295309 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97db80-7773-4145-bddb-e0657aab46a7 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:56:55.306202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1117/2217] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:56:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:57:00.464498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf64ac-171c-452b-ada4-a20e19f169a7 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:00.465071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf64ac-171c-452b-ada4-a20e19f169a7 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:00.465198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf64ac-171c-452b-ada4-a20e19f169a7 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:00.466469 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1101/2218] 10.222.0.76 () {54 vars in 921 bytes} [Fri Aug 26 08:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:57:00.472807 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c3a45-d98b-455f-bfe2-b97750b40d0b None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:00.473284 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c3a45-d98b-455f-bfe2-b97750b40d0b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:00.473430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c3a45-d98b-455f-bfe2-b97750b40d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:00.487552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:00.493645 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-362c3a45-d98b-455f-bfe2-b97750b40d0b None None] MFA Rules not processed for user `b63d6e588f6e4b598b75a2ec13bea25d`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:57:00.495997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-362c3a45-d98b-455f-bfe2-b97750b40d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:00.505877 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1118/2219] 10.222.0.76 () {58 vars in 1018 bytes} [Fri Aug 26 08:57:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:57:00.517572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf64ac-171c-452b-ada4-a20e19f169a7 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:57:00.519275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-bebf64ac-171c-452b-ada4-a20e19f169a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:00.581593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf64ac-171c-452b-ada4-a20e19f169a7 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:57:00.585522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548393f-a4df-4861-9ed0-cbf5c66dfb56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fde38c1a2a844368acd3e1b9aa10151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:57:00.586379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548393f-a4df-4861-9ed0-cbf5c66dfb56 service glance] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:00.586823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548393f-a4df-4861-9ed0-cbf5c66dfb56 service glance] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:00.587267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548393f-a4df-4861-9ed0-cbf5c66dfb56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:00.598920 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548393f-a4df-4861-9ed0-cbf5c66dfb56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:57:00.600338 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548393f-a4df-4861-9ed0-cbf5c66dfb56 service glance] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:57:00.611472 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1102/2220] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:57:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:57:00.677814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07288be0-78cf-4ddb-8be4-860051582dcb None None] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:00.678035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07288be0-78cf-4ddb-8be4-860051582dcb None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:00.678314 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07288be0-78cf-4ddb-8be4-860051582dcb None None] PATH_INFO: `/` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:00.679664 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1119/2221] 10.222.0.76 () {54 vars in 921 bytes} [Fri Aug 26 08:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:57:00.684267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebeb61-e290-4549-b00b-ee95cfb4b2c7 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:00.684585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebeb61-e290-4549-b00b-ee95cfb4b2c7 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:00.684896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebeb61-e290-4549-b00b-ee95cfb4b2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:00.704290 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-c3ebeb61-e290-4549-b00b-ee95cfb4b2c7 None None] MFA Rules not processed for user `e8a867070e974a918a906148bbfd1fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:57:00.705514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c3ebeb61-e290-4549-b00b-ee95cfb4b2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:00.711859 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1103/2222] 10.222.0.76 () {58 vars in 1018 bytes} [Fri Aug 26 08:57:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:57:00.724498 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07288be0-78cf-4ddb-8be4-860051582dcb None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:57:00.726235 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-07288be0-78cf-4ddb-8be4-860051582dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:00.739479 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07288be0-78cf-4ddb-8be4-860051582dcb None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:57:00.743036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b555b9-f30e-4ce1-9659-a680b2308b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:57:00.743623 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b555b9-f30e-4ce1-9659-a680b2308b61 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:00.743904 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b555b9-f30e-4ce1-9659-a680b2308b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:00.744178 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b555b9-f30e-4ce1-9659-a680b2308b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:00.751328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b555b9-f30e-4ce1-9659-a680b2308b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:57:00.752733 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b555b9-f30e-4ce1-9659-a680b2308b61 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:57:00.760422 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1120/2223] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:57:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:57:00.844129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3b5af-bed6-4324-a6b4-899f3d757e10 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:00.844426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3b5af-bed6-4324-a6b4-899f3d757e10 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:00.844707 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3b5af-bed6-4324-a6b4-899f3d757e10 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:00.846114 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1104/2224] 10.222.0.76 () {54 vars in 921 bytes} [Fri Aug 26 08:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:57:00.851288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d61202-5085-4591-b528-219574a3ef1e None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:00.851577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d61202-5085-4591-b528-219574a3ef1e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:00.851856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d61202-5085-4591-b528-219574a3ef1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:00.870936 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-c9d61202-5085-4591-b528-219574a3ef1e None None] MFA Rules not processed for user `b63d6e588f6e4b598b75a2ec13bea25d`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:57:00.872122 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c9d61202-5085-4591-b528-219574a3ef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:00.881070 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1121/2225] 10.222.0.76 () {58 vars in 1018 bytes} [Fri Aug 26 08:57:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:57:00.891692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3b5af-bed6-4324-a6b4-899f3d757e10 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:57:00.903184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3b5af-bed6-4324-a6b4-899f3d757e10 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:57:00.906784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f1927-f391-4a5c-b0f4-d742041ace1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:57:00.907399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f1927-f391-4a5c-b0f4-d742041ace1b service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:00.907683 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f1927-f391-4a5c-b0f4-d742041ace1b service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:00.907961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f1927-f391-4a5c-b0f4-d742041ace1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:00.918037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f1927-f391-4a5c-b0f4-d742041ace1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:57:00.919478 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f1927-f391-4a5c-b0f4-d742041ace1b service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:57:00.929993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1105/2226] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:57:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:57:03.701975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd342827-3b23-4a7e-9c8a-6953aa5a4023 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:03.702543 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd342827-3b23-4a7e-9c8a-6953aa5a4023 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:03.702543 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd342827-3b23-4a7e-9c8a-6953aa5a4023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:03.724695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-bd342827-3b23-4a7e-9c8a-6953aa5a4023 None None] MFA Rules not processed for user `598d44b6fb21463985745e862d0b827f`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:57:03.725958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-bd342827-3b23-4a7e-9c8a-6953aa5a4023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:03.792407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1122/2227] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:57:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:57:05.052223 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95de60-4775-45dc-8365-df8070308fe8 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:05.052713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95de60-4775-45dc-8365-df8070308fe8 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:05.052811 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95de60-4775-45dc-8365-df8070308fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:05.072631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-1a95de60-4775-45dc-8365-df8070308fe8 None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:57:05.073909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1a95de60-4775-45dc-8365-df8070308fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:05.081396 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1106/2228] 10.222.0.76 () {58 vars in 1009 bytes} [Fri Aug 26 08:57:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:57:05.093743 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd342827-3b23-4a7e-9c8a-6953aa5a4023 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:57:05.105854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd342827-3b23-4a7e-9c8a-6953aa5a4023 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:57:05.110903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62d00-86b1-4a33-bb1f-68b998d9f802 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:57:05.111568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62d00-86b1-4a33-bb1f-68b998d9f802 service swift] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:05.111856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62d00-86b1-4a33-bb1f-68b998d9f802 service swift] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:05.112133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62d00-86b1-4a33-bb1f-68b998d9f802 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:05.120068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a62d00-86b1-4a33-bb1f-68b998d9f802 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:57:05.121703 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a62d00-86b1-4a33-bb1f-68b998d9f802 service swift] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:57:05.129685 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1123/2229] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 08:57:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 08:57:12.704153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95de60-4775-45dc-8365-df8070308fe8 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:57:12.705566 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1a95de60-4775-45dc-8365-df8070308fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:12.721100 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95de60-4775-45dc-8365-df8070308fe8 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:57:12.726467 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd52a30-c7c4-4fad-a021-171a5157ad6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:57:12.727052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd52a30-c7c4-4fad-a021-171a5157ad6c service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:12.727330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd52a30-c7c4-4fad-a021-171a5157ad6c service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:12.727599 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd52a30-c7c4-4fad-a021-171a5157ad6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:12.730187 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-dfd52a30-c7c4-4fad-a021-171a5157ad6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:12.744449 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd52a30-c7c4-4fad-a021-171a5157ad6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:57:12.747038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd52a30-c7c4-4fad-a021-171a5157ad6c service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:57:12.760333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1107/2230] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:57:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:57:15.126580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=40 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:22.754183 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=63 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:28.758939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62d00-86b1-4a33-bb1f-68b998d9f802 service swift] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:57:28.771195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62d00-86b1-4a33-bb1f-68b998d9f802 service swift] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:57:28.775116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594de71-cd23-4035-81c0-1c896ddf26c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:57:28.775744 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594de71-cd23-4035-81c0-1c896ddf26c3 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:28.776027 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594de71-cd23-4035-81c0-1c896ddf26c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:28.776299 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594de71-cd23-4035-81c0-1c896ddf26c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:28.778650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d594de71-cd23-4035-81c0-1c896ddf26c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:28.789771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594de71-cd23-4035-81c0-1c896ddf26c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:57:28.791187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594de71-cd23-4035-81c0-1c896ddf26c3 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:57:28.800024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1124/2231] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:57:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:57:29.972345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd52a30-c7c4-4fad-a021-171a5157ad6c service nova] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:57:29.986100 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd52a30-c7c4-4fad-a021-171a5157ad6c service nova] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:57:29.996092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819901b-18a0-43be-a1c5-118521ec4f87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:57:29.997024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819901b-18a0-43be-a1c5-118521ec4f87 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:29.997540 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819901b-18a0-43be-a1c5-118521ec4f87 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:29.998041 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819901b-18a0-43be-a1c5-118521ec4f87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:30.001414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-4819901b-18a0-43be-a1c5-118521ec4f87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:30.066435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819901b-18a0-43be-a1c5-118521ec4f87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:57:30.068043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819901b-18a0-43be-a1c5-118521ec4f87 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:57:30.078168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1108/2232] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:57:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:57:31.414314 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594de71-cd23-4035-81c0-1c896ddf26c3 service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:57:31.415745 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d594de71-cd23-4035-81c0-1c896ddf26c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:31.432615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594de71-cd23-4035-81c0-1c896ddf26c3 service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:57:31.438048 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17502f61-f7ef-493a-8952-403c8b5dffe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:57:31.438656 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17502f61-f7ef-493a-8952-403c8b5dffe1 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:31.438942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17502f61-f7ef-493a-8952-403c8b5dffe1 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:31.439221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17502f61-f7ef-493a-8952-403c8b5dffe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:31.440899 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-17502f61-f7ef-493a-8952-403c8b5dffe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:31.452771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17502f61-f7ef-493a-8952-403c8b5dffe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:57:31.454365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17502f61-f7ef-493a-8952-403c8b5dffe1 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:57:31.465234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1125/2233] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:57:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:57:34.763300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676412e-9a3f-4413-93b4-61d9a86bad72 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:34.763804 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676412e-9a3f-4413-93b4-61d9a86bad72 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:34.764396 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676412e-9a3f-4413-93b4-61d9a86bad72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:34.784559 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-1676412e-9a3f-4413-93b4-61d9a86bad72 None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:57:34.785793 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1676412e-9a3f-4413-93b4-61d9a86bad72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:34.793378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1109/2234] 10.222.0.76 () {58 vars in 967 bytes} [Fri Aug 26 08:57:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:57:34.805604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17502f61-f7ef-493a-8952-403c8b5dffe1 service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:57:34.816923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17502f61-f7ef-493a-8952-403c8b5dffe1 service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:57:34.822210 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee451354-d2f8-4173-aa93-7edb244cac78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:57:34.822817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee451354-d2f8-4173-aa93-7edb244cac78 service swift] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:34.823112 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee451354-d2f8-4173-aa93-7edb244cac78 service swift] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:34.823390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee451354-d2f8-4173-aa93-7edb244cac78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:34.831883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee451354-d2f8-4173-aa93-7edb244cac78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:57:34.833494 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee451354-d2f8-4173-aa93-7edb244cac78 service swift] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:57:34.841851 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1126/2235] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 08:57:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 08:57:44.778898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=31 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:44.838307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=18 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:52.564958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676412e-9a3f-4413-93b4-61d9a86bad72 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:57:52.577864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676412e-9a3f-4413-93b4-61d9a86bad72 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:57:52.583305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f337d16-8b70-4584-ab80-27afb7b68551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:57:52.583945 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f337d16-8b70-4584-ab80-27afb7b68551 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:52.584230 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f337d16-8b70-4584-ab80-27afb7b68551 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:52.584508 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f337d16-8b70-4584-ab80-27afb7b68551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:52.586296 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1f337d16-8b70-4584-ab80-27afb7b68551 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:52.643823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f337d16-8b70-4584-ab80-27afb7b68551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:57:52.645447 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f337d16-8b70-4584-ab80-27afb7b68551 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:57:52.654656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1110/2236] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:57:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:57:56.700302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee451354-d2f8-4173-aa93-7edb244cac78 service swift] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:57:56.715845 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee451354-d2f8-4173-aa93-7edb244cac78 service swift] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:57:56.721837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4ccb1-e087-4754-a739-b90a1d90f580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:57:56.722478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4ccb1-e087-4754-a739-b90a1d90f580 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:57:56.722740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4ccb1-e087-4754-a739-b90a1d90f580 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:57:56.723018 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4ccb1-e087-4754-a739-b90a1d90f580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:57:56.724782 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b5f4ccb1-e087-4754-a739-b90a1d90f580 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:57:56.738342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4ccb1-e087-4754-a739-b90a1d90f580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:57:56.739942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4ccb1-e087-4754-a739-b90a1d90f580 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:57:56.752029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1127/2237] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:57:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:58:02.650134 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=28 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:58:06.746986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=6 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:58:07.334879 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d3d48-9812-48c3-81c0-58f83afdafb1 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:58:07.335428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d3d48-9812-48c3-81c0-58f83afdafb1 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:58:07.335428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d3d48-9812-48c3-81c0-58f83afdafb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:58:07.355495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-893d3d48-9812-48c3-81c0-58f83afdafb1 None None] MFA Rules not processed for user `798c692df3b141849d5a4427b3cd1e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:58:07.356700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-893d3d48-9812-48c3-81c0-58f83afdafb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:58:07.363564 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1111/2238] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:58:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:58:07.666267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4ccb1-e087-4754-a739-b90a1d90f580 service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:58:07.675778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4ccb1-e087-4754-a739-b90a1d90f580 service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:58:07.679296 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9359b70-f6ba-486d-9d26-796284452217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:58:07.679884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9359b70-f6ba-486d-9d26-796284452217 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:58:07.680161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9359b70-f6ba-486d-9d26-796284452217 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:58:07.680432 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9359b70-f6ba-486d-9d26-796284452217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:58:07.682121 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a9359b70-f6ba-486d-9d26-796284452217 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:58:07.691702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9359b70-f6ba-486d-9d26-796284452217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:58:07.693139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9359b70-f6ba-486d-9d26-796284452217 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:58:07.701451 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1128/2239] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:58:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:58:08.011180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0112b67-8dbb-47c6-af69-e26f38833bd7 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:58:08.011525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0112b67-8dbb-47c6-af69-e26f38833bd7 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:58:08.012009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0112b67-8dbb-47c6-af69-e26f38833bd7 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:58:08.013658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1112/2240] 10.222.0.76 () {54 vars in 961 bytes} [Fri Aug 26 08:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:58:08.018997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba955110-f7d0-440e-8b6f-2f0e5f9359ea None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:58:08.019470 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba955110-f7d0-440e-8b6f-2f0e5f9359ea None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:58:08.019566 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba955110-f7d0-440e-8b6f-2f0e5f9359ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:58:08.039058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-ba955110-f7d0-440e-8b6f-2f0e5f9359ea None None] MFA Rules not processed for user `95abbd88e549427abbf5699efed0451a`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:58:08.040264 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ba955110-f7d0-440e-8b6f-2f0e5f9359ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:58:08.106212 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1129/2241] 10.222.0.76 () {58 vars in 1058 bytes} [Fri Aug 26 08:58:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:58:08.114126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0112b67-8dbb-47c6-af69-e26f38833bd7 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:58:08.128073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0112b67-8dbb-47c6-af69-e26f38833bd7 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:58:08.132965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9082f2-a9af-44ea-83dc-f76df753ce22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95abbd88e549427abbf5699efed0451a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:58:08.133522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9082f2-a9af-44ea-83dc-f76df753ce22 service placement] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:58:08.133799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9082f2-a9af-44ea-83dc-f76df753ce22 service placement] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:58:08.134874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9082f2-a9af-44ea-83dc-f76df753ce22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:58:08.136069 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-bb9082f2-a9af-44ea-83dc-f76df753ce22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:58:08.147740 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9082f2-a9af-44ea-83dc-f76df753ce22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:58:08.149339 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9082f2-a9af-44ea-83dc-f76df753ce22 service placement] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:58:08.158819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1113/2242] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:58:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:58:17.920769 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba955110-f7d0-440e-8b6f-2f0e5f9359ea None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:58:17.933514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba955110-f7d0-440e-8b6f-2f0e5f9359ea None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:58:17.939701 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9138f3-4c8d-4864-acb9-58ad409d727d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:58:17.940320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9138f3-4c8d-4864-acb9-58ad409d727d service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:58:17.940591 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9138f3-4c8d-4864-acb9-58ad409d727d service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:58:17.940861 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9138f3-4c8d-4864-acb9-58ad409d727d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:58:17.942610 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-8c9138f3-4c8d-4864-acb9-58ad409d727d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:58:17.955493 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9138f3-4c8d-4864-acb9-58ad409d727d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:58:17.957146 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9138f3-4c8d-4864-acb9-58ad409d727d service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:58:17.967662 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1130/2243] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:58:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:58:18.154915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=9 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:58:27.963163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=41 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:07.904927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9082f2-a9af-44ea-83dc-f76df753ce22 service placement] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:07.917342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9082f2-a9af-44ea-83dc-f76df753ce22 service placement] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:07.923347 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd7000-c104-46a4-a05e-01df95f95344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:07.923953 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd7000-c104-46a4-a05e-01df95f95344 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:07.924237 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd7000-c104-46a4-a05e-01df95f95344 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:07.924520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd7000-c104-46a4-a05e-01df95f95344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:07.926285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-88dd7000-c104-46a4-a05e-01df95f95344 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:07.990177 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd7000-c104-46a4-a05e-01df95f95344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:07.991894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd7000-c104-46a4-a05e-01df95f95344 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:08.002358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1114/2244] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:11.303056 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9138f3-4c8d-4864-acb9-58ad409d727d service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:11.312298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9138f3-4c8d-4864-acb9-58ad409d727d service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:11.315911 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca2c14-3ec2-464e-ba74-86cf46c5a435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:11.316504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca2c14-3ec2-464e-ba74-86cf46c5a435 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:11.316810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca2c14-3ec2-464e-ba74-86cf46c5a435 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:11.317162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca2c14-3ec2-464e-ba74-86cf46c5a435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:11.318882 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-88ca2c14-3ec2-464e-ba74-86cf46c5a435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:11.381877 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca2c14-3ec2-464e-ba74-86cf46c5a435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:11.383568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca2c14-3ec2-464e-ba74-86cf46c5a435 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:11.393641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1131/2245] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:14.812652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd7000-c104-46a4-a05e-01df95f95344 service nova] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:14.829215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd7000-c104-46a4-a05e-01df95f95344 service nova] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:14.836659 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088dfc-e844-4408-aff9-61facd6b005c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95abbd88e549427abbf5699efed0451a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:14.837973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088dfc-e844-4408-aff9-61facd6b005c service placement] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:14.837973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088dfc-e844-4408-aff9-61facd6b005c service placement] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:14.838180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088dfc-e844-4408-aff9-61facd6b005c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:14.840683 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-55088dfc-e844-4408-aff9-61facd6b005c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:14.856483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55088dfc-e844-4408-aff9-61facd6b005c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:14.858377 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55088dfc-e844-4408-aff9-61facd6b005c service placement] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:14.881200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1115/2246] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:14.884171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca2c14-3ec2-464e-ba74-86cf46c5a435 service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:14.885684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-88ca2c14-3ec2-464e-ba74-86cf46c5a435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:14.922888 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca2c14-3ec2-464e-ba74-86cf46c5a435 service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:14.930650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ac689-837a-40a6-9d95-86c488d67d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:14.931616 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ac689-837a-40a6-9d95-86c488d67d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:14.932120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ac689-837a-40a6-9d95-86c488d67d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:14.932463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ac689-837a-40a6-9d95-86c488d67d5c admin admin] PATH_INFO: `/v3/users/598d44b6fb21463985745e862d0b827f` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:14.933740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ac689-837a-40a6-9d95-86c488d67d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=598d44b6fb21463985745e862d0b827f)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:14.936663 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ac689-837a-40a6-9d95-86c488d67d5c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:15.006124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be9ac689-837a-40a6-9d95-86c488d67d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598d44b6fb21463985745e862d0b827f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:15.014530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be9ac689-837a-40a6-9d95-86c488d67d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598d44b6fb21463985745e862d0b827f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:15.015347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be9ac689-837a-40a6-9d95-86c488d67d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598d44b6fb21463985745e862d0b827f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:15.026181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be9ac689-837a-40a6-9d95-86c488d67d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598d44b6fb21463985745e862d0b827f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:15.045130 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be9ac689-837a-40a6-9d95-86c488d67d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598d44b6fb21463985745e862d0b827f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:15.051372 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1132/2247] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:59:14 2022] DELETE /identity/v3/users/598d44b6fb21463985745e862d0b827f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:15.238198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088dfc-e844-4408-aff9-61facd6b005c service placement] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:15.254351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088dfc-e844-4408-aff9-61facd6b005c service placement] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:15.329949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32080278-b516-4fa7-b983-9873008a3d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:15.330752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32080278-b516-4fa7-b983-9873008a3d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:15.331035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32080278-b516-4fa7-b983-9873008a3d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:15.331307 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32080278-b516-4fa7-b983-9873008a3d94 admin admin] PATH_INFO: `/v3/projects/f88c5e7347a3409194633c8bd70e1a0a` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:15.332448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32080278-b516-4fa7-b983-9873008a3d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f88c5e7347a3409194633c8bd70e1a0a)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:15.334399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32080278-b516-4fa7-b983-9873008a3d94 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:15.385102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-32080278-b516-4fa7-b983-9873008a3d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f88c5e7347a3409194633c8bd70e1a0a', 'request_id': 'req-32080278-b516-4fa7-b983-9873008a3d94'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:15.391633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-32080278-b516-4fa7-b983-9873008a3d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f88c5e7347a3409194633c8bd70e1a0a', 'request_id': 'req-32080278-b516-4fa7-b983-9873008a3d94'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:15.398737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-32080278-b516-4fa7-b983-9873008a3d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f88c5e7347a3409194633c8bd70e1a0a', 'request_id': 'req-32080278-b516-4fa7-b983-9873008a3d94'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:15.409955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-32080278-b516-4fa7-b983-9873008a3d94 admin admin] The token cache is being invalidate because project f88c5e7347a3409194633c8bd70e1a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:59:15.410249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-32080278-b516-4fa7-b983-9873008a3d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:15.410890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-32080278-b516-4fa7-b983-9873008a3d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:15.412356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1116/2248] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:59:15 2022] DELETE /identity/v3/projects/f88c5e7347a3409194633c8bd70e1a0a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:15.417288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aae9f1-cb4f-4606-bea0-507080e1f745 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:15.417582 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aae9f1-cb4f-4606-bea0-507080e1f745 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:15.417858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aae9f1-cb4f-4606-bea0-507080e1f745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:15.438578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-b1aae9f1-cb4f-4606-bea0-507080e1f745 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:15.440179 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b1aae9f1-cb4f-4606-bea0-507080e1f745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:15.533589 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1133/2249] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:15.541199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f90b3a-1f9f-4d92-88c8-9a334bc58b07 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:15.541616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f90b3a-1f9f-4d92-88c8-9a334bc58b07 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:15.541997 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f90b3a-1f9f-4d92-88c8-9a334bc58b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:15.564903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-87f90b3a-1f9f-4d92-88c8-9a334bc58b07 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:15.566344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-87f90b3a-1f9f-4d92-88c8-9a334bc58b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:15.579430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1117/2250] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:15.583492 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aae9f1-cb4f-4606-bea0-507080e1f745 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:15.600392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aae9f1-cb4f-4606-bea0-507080e1f745 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:15.607745 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cfe90-57a9-4543-a014-1497103f2e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:15.608509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cfe90-57a9-4543-a014-1497103f2e36 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:15.608802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cfe90-57a9-4543-a014-1497103f2e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:15.609853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cfe90-57a9-4543-a014-1497103f2e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:15.610926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cfe90-57a9-4543-a014-1497103f2e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:59:15.611376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cfe90-57a9-4543-a014-1497103f2e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:15.613385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cfe90-57a9-4543-a014-1497103f2e36 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:15.616102 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:15.638370 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1134/2251] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:59:15.639388 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f90b3a-1f9f-4d92-88c8-9a334bc58b07 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:15.648605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f90b3a-1f9f-4d92-88c8-9a334bc58b07 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:15.653903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66af68-ce6b-460c-bd36-ba69f5fa0b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:15.654499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66af68-ce6b-460c-bd36-ba69f5fa0b29 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:15.654776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66af68-ce6b-460c-bd36-ba69f5fa0b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:15.655069 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66af68-ce6b-460c-bd36-ba69f5fa0b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:15.655730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66af68-ce6b-460c-bd36-ba69f5fa0b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:15.657638 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66af68-ce6b-460c-bd36-ba69f5fa0b29 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:15.663000 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:15.687619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1118/2252] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:59:15 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:59:15.692145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cfe90-57a9-4543-a014-1497103f2e36 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:15.702460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cfe90-57a9-4543-a014-1497103f2e36 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:15.766596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9096088-8545-4242-a30c-ba7bf4d615fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:15.767323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9096088-8545-4242-a30c-ba7bf4d615fd admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:15.767605 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9096088-8545-4242-a30c-ba7bf4d615fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:15.767878 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9096088-8545-4242-a30c-ba7bf4d615fd admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:15.768513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9096088-8545-4242-a30c-ba7bf4d615fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:15.770463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9096088-8545-4242-a30c-ba7bf4d615fd admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:15.794957 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1135/2253] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:59:15 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:59:15.799398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66af68-ce6b-460c-bd36-ba69f5fa0b29 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:15.809665 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66af68-ce6b-460c-bd36-ba69f5fa0b29 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:15.814382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd415484-b11e-489a-a317-257040f9dc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:15.815006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd415484-b11e-489a-a317-257040f9dc96 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:15.815239 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd415484-b11e-489a-a317-257040f9dc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:15.815513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd415484-b11e-489a-a317-257040f9dc96 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:15.816147 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd415484-b11e-489a-a317-257040f9dc96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:15.817774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd415484-b11e-489a-a317-257040f9dc96 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:15.828160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1119/2254] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:15.831941 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9096088-8545-4242-a30c-ba7bf4d615fd admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:15.842851 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9096088-8545-4242-a30c-ba7bf4d615fd admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:15.847936 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc94af-b192-409b-9257-6932b3dff053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:15.848966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc94af-b192-409b-9257-6932b3dff053 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:15.848966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc94af-b192-409b-9257-6932b3dff053 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:15.849275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc94af-b192-409b-9257-6932b3dff053 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:15.849928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc94af-b192-409b-9257-6932b3dff053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:15.851515 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc94af-b192-409b-9257-6932b3dff053 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:15.863247 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1136/2255] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:15.867418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd415484-b11e-489a-a317-257040f9dc96 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:15.878047 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd415484-b11e-489a-a317-257040f9dc96 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:15.883309 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18deb55c-3af2-4a01-96f6-813d655c5df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:15.883967 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18deb55c-3af2-4a01-96f6-813d655c5df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:15.884246 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18deb55c-3af2-4a01-96f6-813d655c5df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:15.884719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18deb55c-3af2-4a01-96f6-813d655c5df5 admin admin] PATH_INFO: `/v3/projects/f79cae5432854ea296d785591a240739/users/e396f296a3114e5aa390a8f59c938c96/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:15.900980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18deb55c-3af2-4a01-96f6-813d655c5df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79cae5432854ea296d785591a240739, user_id=e396f296a3114e5aa390a8f59c938c96, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:15.904390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18deb55c-3af2-4a01-96f6-813d655c5df5 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:15.919889 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1120/2256] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:59:15 2022] PUT /identity/v3/projects/f79cae5432854ea296d785591a240739/users/e396f296a3114e5aa390a8f59c938c96/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:59:15.931076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e0bcd-03ba-4821-8203-7837793f2956 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:15.931574 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e0bcd-03ba-4821-8203-7837793f2956 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:15.931681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e0bcd-03ba-4821-8203-7837793f2956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:15.960159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-4e6e0bcd-03ba-4821-8203-7837793f2956 None None] MFA Rules not processed for user `e396f296a3114e5aa390a8f59c938c96`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:15.961769 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4e6e0bcd-03ba-4821-8203-7837793f2956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:16.031791 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1137/2257] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:16.032936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18deb55c-3af2-4a01-96f6-813d655c5df5 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:16.109200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18deb55c-3af2-4a01-96f6-813d655c5df5 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:16.114247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d8bcb-f11e-470b-8edc-3e1a3f30bc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:16.114958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d8bcb-f11e-470b-8edc-3e1a3f30bc5a admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:16.115484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d8bcb-f11e-470b-8edc-3e1a3f30bc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:16.115823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d8bcb-f11e-470b-8edc-3e1a3f30bc5a admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:16.116539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d8bcb-f11e-470b-8edc-3e1a3f30bc5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:16.118533 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d8bcb-f11e-470b-8edc-3e1a3f30bc5a admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:16.150706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1121/2258] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:59:16 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:59:16.155264 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e0bcd-03ba-4821-8203-7837793f2956 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:16.167060 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e0bcd-03ba-4821-8203-7837793f2956 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:16.231883 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd866b-d4ec-44df-a19c-0d04ed22ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:16.232500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd866b-d4ec-44df-a19c-0d04ed22ae21 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:16.232789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd866b-d4ec-44df-a19c-0d04ed22ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:16.233167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd866b-d4ec-44df-a19c-0d04ed22ae21 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:16.233794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd866b-d4ec-44df-a19c-0d04ed22ae21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:16.235736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd866b-d4ec-44df-a19c-0d04ed22ae21 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:16.245760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:16.261962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1138/2259] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:59:16 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:59:16.263545 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d8bcb-f11e-470b-8edc-3e1a3f30bc5a admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:16.274687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d8bcb-f11e-470b-8edc-3e1a3f30bc5a admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:16.280196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc29b1-1886-4f82-aaff-203a127ecb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:16.280983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc29b1-1886-4f82-aaff-203a127ecb93 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:16.281277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc29b1-1886-4f82-aaff-203a127ecb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:16.281548 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc29b1-1886-4f82-aaff-203a127ecb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:16.282533 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc29b1-1886-4f82-aaff-203a127ecb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:16.284455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc29b1-1886-4f82-aaff-203a127ecb93 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:16.299252 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1122/2260] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:59:16.303741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd866b-d4ec-44df-a19c-0d04ed22ae21 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:16.315979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd866b-d4ec-44df-a19c-0d04ed22ae21 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:16.321379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec3c98-0baa-47ce-82d8-471d53e2510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:16.322042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec3c98-0baa-47ce-82d8-471d53e2510a admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:16.322322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec3c98-0baa-47ce-82d8-471d53e2510a admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:16.322598 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec3c98-0baa-47ce-82d8-471d53e2510a admin admin] PATH_INFO: `/v3/projects/32476a9ff7004082b21973650e6bd180/users/b7ac406103ca4ebeb317173a2500cac5/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:16.340092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec3c98-0baa-47ce-82d8-471d53e2510a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32476a9ff7004082b21973650e6bd180, user_id=b7ac406103ca4ebeb317173a2500cac5, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:16.342858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec3c98-0baa-47ce-82d8-471d53e2510a admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:16.356333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1139/2261] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:59:16 2022] PUT /identity/v3/projects/32476a9ff7004082b21973650e6bd180/users/b7ac406103ca4ebeb317173a2500cac5/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:16.360315 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc29b1-1886-4f82-aaff-203a127ecb93 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:16.370283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc29b1-1886-4f82-aaff-203a127ecb93 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:16.429536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b75a5b-37ee-404d-85ae-3944af40b95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:16.430145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b75a5b-37ee-404d-85ae-3944af40b95f admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:16.430433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b75a5b-37ee-404d-85ae-3944af40b95f admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:16.430711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b75a5b-37ee-404d-85ae-3944af40b95f admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:16.431356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b75a5b-37ee-404d-85ae-3944af40b95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:16.432936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b75a5b-37ee-404d-85ae-3944af40b95f admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:16.443345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1123/2262] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:16.447461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec3c98-0baa-47ce-82d8-471d53e2510a admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:16.459015 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec3c98-0baa-47ce-82d8-471d53e2510a admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:16.463622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f5781-f295-466d-960c-7f8cc3dccbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:16.464269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f5781-f295-466d-960c-7f8cc3dccbda admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:16.464549 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f5781-f295-466d-960c-7f8cc3dccbda admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:16.464820 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f5781-f295-466d-960c-7f8cc3dccbda admin admin] PATH_INFO: `/v3/projects/32476a9ff7004082b21973650e6bd180/users/b7ac406103ca4ebeb317173a2500cac5/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:16.467450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f5781-f295-466d-960c-7f8cc3dccbda admin admin] RBAC: Authorizing `identity:create_grant(project_id=32476a9ff7004082b21973650e6bd180, user_id=b7ac406103ca4ebeb317173a2500cac5, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:16.470501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f5781-f295-466d-960c-7f8cc3dccbda admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:16.481715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1140/2263] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:59:16 2022] PUT /identity/v3/projects/32476a9ff7004082b21973650e6bd180/users/b7ac406103ca4ebeb317173a2500cac5/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:59:16.492160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056827d4-dae4-4954-afe4-9d7811512917 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:16.492446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056827d4-dae4-4954-afe4-9d7811512917 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:16.492725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056827d4-dae4-4954-afe4-9d7811512917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:16.520282 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-056827d4-dae4-4954-afe4-9d7811512917 None None] MFA Rules not processed for user `b7ac406103ca4ebeb317173a2500cac5`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:16.521464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-056827d4-dae4-4954-afe4-9d7811512917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:16.532216 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:16.630827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34b580-e472-4107-aa6e-97b43acf9b55 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:16.631409 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34b580-e472-4107-aa6e-97b43acf9b55 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:16.632022 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34b580-e472-4107-aa6e-97b43acf9b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:16.655300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1124/2264] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:16.666893 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056827d4-dae4-4954-afe4-9d7811512917 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:16.667267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-9a34b580-e472-4107-aa6e-97b43acf9b55 None None] MFA Rules not processed for user `5541bfa4efc54abe85faf6b58196a2d7`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:16.668864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-056827d4-dae4-4954-afe4-9d7811512917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:16.669515 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9a34b580-e472-4107-aa6e-97b43acf9b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:16.780042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056827d4-dae4-4954-afe4-9d7811512917 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:16.786120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aa64b-7b35-4643-b377-f9228666fe9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:16.787000 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aa64b-7b35-4643-b377-f9228666fe9f service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:16.787337 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aa64b-7b35-4643-b377-f9228666fe9f service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:16.787771 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aa64b-7b35-4643-b377-f9228666fe9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:16.788135 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1141/2265] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:16.804932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98aa64b-7b35-4643-b377-f9228666fe9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:16.806499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98aa64b-7b35-4643-b377-f9228666fe9f service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:16.821457 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1125/2266] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:17.380892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34b580-e472-4107-aa6e-97b43acf9b55 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:17.453853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34b580-e472-4107-aa6e-97b43acf9b55 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:17.459020 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb6d6e-ea62-444b-a32b-87c336057aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:17.460133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb6d6e-ea62-444b-a32b-87c336057aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:17.460133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb6d6e-ea62-444b-a32b-87c336057aab admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:17.460371 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb6d6e-ea62-444b-a32b-87c336057aab admin admin] PATH_INFO: `/v3/users/e396f296a3114e5aa390a8f59c938c96` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:17.461395 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb6d6e-ea62-444b-a32b-87c336057aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e396f296a3114e5aa390a8f59c938c96)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:17.464498 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb6d6e-ea62-444b-a32b-87c336057aab admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:17.525864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-35eb6d6e-ea62-444b-a32b-87c336057aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e396f296a3114e5aa390a8f59c938c96'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:17.535038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-35eb6d6e-ea62-444b-a32b-87c336057aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e396f296a3114e5aa390a8f59c938c96'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:17.535671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-35eb6d6e-ea62-444b-a32b-87c336057aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e396f296a3114e5aa390a8f59c938c96'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:17.541872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:17.543833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-35eb6d6e-ea62-444b-a32b-87c336057aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e396f296a3114e5aa390a8f59c938c96'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:17.557415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-35eb6d6e-ea62-444b-a32b-87c336057aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e396f296a3114e5aa390a8f59c938c96'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:17.563482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1142/2267] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:59:17 2022] DELETE /identity/v3/users/e396f296a3114e5aa390a8f59c938c96 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:17.568096 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524881ee-9684-4832-8498-9dbcbc2be5d5 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:17.568383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524881ee-9684-4832-8498-9dbcbc2be5d5 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:17.568660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524881ee-9684-4832-8498-9dbcbc2be5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:17.596576 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-524881ee-9684-4832-8498-9dbcbc2be5d5 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:17.597838 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-524881ee-9684-4832-8498-9dbcbc2be5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:17.654021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb6d6e-ea62-444b-a32b-87c336057aab admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:17.655980 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-35eb6d6e-ea62-444b-a32b-87c336057aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:17.672072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1126/2268] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:17.690403 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524881ee-9684-4832-8498-9dbcbc2be5d5 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:17.693487 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-524881ee-9684-4832-8498-9dbcbc2be5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:17.734693 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb6d6e-ea62-444b-a32b-87c336057aab admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:17.739226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a17cc-ac7b-4d0b-a463-ad91b35522dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:17.739878 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a17cc-ac7b-4d0b-a463-ad91b35522dd service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:17.740165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a17cc-ac7b-4d0b-a463-ad91b35522dd service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:17.740430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a17cc-ac7b-4d0b-a463-ad91b35522dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:17.742418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-756a17cc-ac7b-4d0b-a463-ad91b35522dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:17.753775 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a17cc-ac7b-4d0b-a463-ad91b35522dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:17.755219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a17cc-ac7b-4d0b-a463-ad91b35522dd service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:17.763856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524881ee-9684-4832-8498-9dbcbc2be5d5 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:17.765152 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1143/2269] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:59:17.768104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8864d8-0f36-4777-b79d-a0fc9061d1a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:17.768830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8864d8-0f36-4777-b79d-a0fc9061d1a6 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:17.769113 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8864d8-0f36-4777-b79d-a0fc9061d1a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:17.769286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8864d8-0f36-4777-b79d-a0fc9061d1a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:17.776573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:17.781628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8864d8-0f36-4777-b79d-a0fc9061d1a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:17.783736 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8864d8-0f36-4777-b79d-a0fc9061d1a6 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:17.794492 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1127/2270] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:18.371147 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a17cc-ac7b-4d0b-a463-ad91b35522dd service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:18.372608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-756a17cc-ac7b-4d0b-a463-ad91b35522dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:18.395912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a17cc-ac7b-4d0b-a463-ad91b35522dd service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:18.406112 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc37593-194c-4109-86a5-7e125674ac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:18.407976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc37593-194c-4109-86a5-7e125674ac49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:18.408662 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc37593-194c-4109-86a5-7e125674ac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:18.409507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc37593-194c-4109-86a5-7e125674ac49 admin admin] PATH_INFO: `/v3/projects/f79cae5432854ea296d785591a240739` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:18.411919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc37593-194c-4109-86a5-7e125674ac49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79cae5432854ea296d785591a240739)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:18.414535 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc37593-194c-4109-86a5-7e125674ac49 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:18.469249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5cc37593-194c-4109-86a5-7e125674ac49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79cae5432854ea296d785591a240739', 'request_id': 'req-5cc37593-194c-4109-86a5-7e125674ac49'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:18.478098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5cc37593-194c-4109-86a5-7e125674ac49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79cae5432854ea296d785591a240739', 'request_id': 'req-5cc37593-194c-4109-86a5-7e125674ac49'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:18.491188 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5cc37593-194c-4109-86a5-7e125674ac49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79cae5432854ea296d785591a240739', 'request_id': 'req-5cc37593-194c-4109-86a5-7e125674ac49'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:18.507348 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5cc37593-194c-4109-86a5-7e125674ac49 admin admin] The token cache is being invalidate because project f79cae5432854ea296d785591a240739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:59:18.507713 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5cc37593-194c-4109-86a5-7e125674ac49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:18.508376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5cc37593-194c-4109-86a5-7e125674ac49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:18.513033 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1144/2271] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:59:18 2022] DELETE /identity/v3/projects/f79cae5432854ea296d785591a240739 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:18.515716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8864d8-0f36-4777-b79d-a0fc9061d1a6 service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:18.526737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8864d8-0f36-4777-b79d-a0fc9061d1a6 service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:18.608053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285f245-727c-4203-a53b-7694cf3b9013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:18.609101 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285f245-727c-4203-a53b-7694cf3b9013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:18.609584 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285f245-727c-4203-a53b-7694cf3b9013 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:18.610333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285f245-727c-4203-a53b-7694cf3b9013 admin admin] PATH_INFO: `/v3/users/b7ac406103ca4ebeb317173a2500cac5` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:18.612298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285f245-727c-4203-a53b-7694cf3b9013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ac406103ca4ebeb317173a2500cac5)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:18.616117 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285f245-727c-4203-a53b-7694cf3b9013 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:18.695309 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a285f245-727c-4203-a53b-7694cf3b9013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ac406103ca4ebeb317173a2500cac5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:18.706886 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a285f245-727c-4203-a53b-7694cf3b9013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ac406103ca4ebeb317173a2500cac5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:18.707513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a285f245-727c-4203-a53b-7694cf3b9013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ac406103ca4ebeb317173a2500cac5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:18.708308 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a285f245-727c-4203-a53b-7694cf3b9013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ac406103ca4ebeb317173a2500cac5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:18.719608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a285f245-727c-4203-a53b-7694cf3b9013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ac406103ca4ebeb317173a2500cac5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:18.739452 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1128/2272] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:59:18 2022] DELETE /identity/v3/users/b7ac406103ca4ebeb317173a2500cac5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:19.243478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc37593-194c-4109-86a5-7e125674ac49 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:19.244775 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-5cc37593-194c-4109-86a5-7e125674ac49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:19.259109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc37593-194c-4109-86a5-7e125674ac49 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:19.319331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9effa96-4dff-4789-8659-6df59b8f0fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:19.319968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9effa96-4dff-4789-8659-6df59b8f0fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:19.320247 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9effa96-4dff-4789-8659-6df59b8f0fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:19.320518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9effa96-4dff-4789-8659-6df59b8f0fbf admin admin] PATH_INFO: `/v3/projects/32476a9ff7004082b21973650e6bd180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:19.321653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9effa96-4dff-4789-8659-6df59b8f0fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=32476a9ff7004082b21973650e6bd180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:19.323557 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9effa96-4dff-4789-8659-6df59b8f0fbf admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:19.329901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:19.373636 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c9effa96-4dff-4789-8659-6df59b8f0fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32476a9ff7004082b21973650e6bd180', 'request_id': 'req-c9effa96-4dff-4789-8659-6df59b8f0fbf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:19.379759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c9effa96-4dff-4789-8659-6df59b8f0fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32476a9ff7004082b21973650e6bd180', 'request_id': 'req-c9effa96-4dff-4789-8659-6df59b8f0fbf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:19.387085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c9effa96-4dff-4789-8659-6df59b8f0fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32476a9ff7004082b21973650e6bd180', 'request_id': 'req-c9effa96-4dff-4789-8659-6df59b8f0fbf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:19.397444 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c9effa96-4dff-4789-8659-6df59b8f0fbf admin admin] The token cache is being invalidate because project 32476a9ff7004082b21973650e6bd180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:59:19.398056 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c9effa96-4dff-4789-8659-6df59b8f0fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:19.400036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c9effa96-4dff-4789-8659-6df59b8f0fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:19.401511 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1145/2273] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:59:19 2022] DELETE /identity/v3/projects/32476a9ff7004082b21973650e6bd180 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:59:19.406983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f609f2d-3b68-48b9-9333-d6ce4a4c9a4f None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:19.406983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f609f2d-3b68-48b9-9333-d6ce4a4c9a4f None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:19.407177 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f609f2d-3b68-48b9-9333-d6ce4a4c9a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:19.427397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-0f609f2d-3b68-48b9-9333-d6ce4a4c9a4f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:19.428604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0f609f2d-3b68-48b9-9333-d6ce4a4c9a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:19.500069 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1129/2274] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:19.507659 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7b62f-9531-4d4b-9dc3-594bb1c3ef68 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:19.507954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7b62f-9531-4d4b-9dc3-594bb1c3ef68 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:19.508237 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7b62f-9531-4d4b-9dc3-594bb1c3ef68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:19.530846 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-a4f7b62f-9531-4d4b-9dc3-594bb1c3ef68 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:19.532197 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a4f7b62f-9531-4d4b-9dc3-594bb1c3ef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:19.540230 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1146/2275] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:59:19.545305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f609f2d-3b68-48b9-9333-d6ce4a4c9a4f None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:19.555555 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f609f2d-3b68-48b9-9333-d6ce4a4c9a4f None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:19.560670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab444dd3-630c-491b-855d-48767ec58cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:19.561320 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444dd3-630c-491b-855d-48767ec58cad admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:19.561632 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444dd3-630c-491b-855d-48767ec58cad admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:19.561914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444dd3-630c-491b-855d-48767ec58cad admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:19.562577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab444dd3-630c-491b-855d-48767ec58cad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:59:19.562892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab444dd3-630c-491b-855d-48767ec58cad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:19.564500 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab444dd3-630c-491b-855d-48767ec58cad admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:19.573926 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:19.591325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1130/2276] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:59:19.594556 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7b62f-9531-4d4b-9dc3-594bb1c3ef68 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:19.606967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7b62f-9531-4d4b-9dc3-594bb1c3ef68 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:19.612680 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cb7a0-cb93-4cdc-a295-29ddebd7aa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:19.613475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cb7a0-cb93-4cdc-a295-29ddebd7aa8e admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:19.613887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cb7a0-cb93-4cdc-a295-29ddebd7aa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:19.614281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cb7a0-cb93-4cdc-a295-29ddebd7aa8e admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:19.615018 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cb7a0-cb93-4cdc-a295-29ddebd7aa8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:19.617202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cb7a0-cb93-4cdc-a295-29ddebd7aa8e admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:19.660256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1147/2277] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:59:19 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:59:19.661760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab444dd3-630c-491b-855d-48767ec58cad admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:19.673132 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab444dd3-630c-491b-855d-48767ec58cad admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:19.763122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b3288-1714-41c6-885b-5844ab15de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:19.764035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b3288-1714-41c6-885b-5844ab15de9a admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:19.764318 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b3288-1714-41c6-885b-5844ab15de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:19.764685 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b3288-1714-41c6-885b-5844ab15de9a admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:19.765244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b3288-1714-41c6-885b-5844ab15de9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:19.767217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b3288-1714-41c6-885b-5844ab15de9a admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:19.804584 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1131/2278] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:59:19 2022] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:59:19.808810 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cb7a0-cb93-4cdc-a295-29ddebd7aa8e admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:19.823915 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cb7a0-cb93-4cdc-a295-29ddebd7aa8e admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:19.832101 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe473c51-ed0a-42f2-a0a8-33a0f21fdb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:19.832719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe473c51-ed0a-42f2-a0a8-33a0f21fdb7d admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:19.833068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe473c51-ed0a-42f2-a0a8-33a0f21fdb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:19.833678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe473c51-ed0a-42f2-a0a8-33a0f21fdb7d admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:19.834117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe473c51-ed0a-42f2-a0a8-33a0f21fdb7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:19.836478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe473c51-ed0a-42f2-a0a8-33a0f21fdb7d admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:19.849188 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1148/2279] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:19.853963 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b3288-1714-41c6-885b-5844ab15de9a admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:19.864041 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b3288-1714-41c6-885b-5844ab15de9a admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:19.869086 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76b875-7342-4d26-807a-eb051e9bf54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:19.869738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76b875-7342-4d26-807a-eb051e9bf54c admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:19.870026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76b875-7342-4d26-807a-eb051e9bf54c admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:19.870305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76b875-7342-4d26-807a-eb051e9bf54c admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:19.870948 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76b875-7342-4d26-807a-eb051e9bf54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:19.872705 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76b875-7342-4d26-807a-eb051e9bf54c admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:19.884273 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1132/2280] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:19.888972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe473c51-ed0a-42f2-a0a8-33a0f21fdb7d admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:19.899610 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe473c51-ed0a-42f2-a0a8-33a0f21fdb7d admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:19.905025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac754f-4e63-4852-8ec1-952497c7e45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:19.905695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac754f-4e63-4852-8ec1-952497c7e45f admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:19.905981 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac754f-4e63-4852-8ec1-952497c7e45f admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:19.906262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac754f-4e63-4852-8ec1-952497c7e45f admin admin] PATH_INFO: `/v3/projects/53569afe5cc74ebc82eb1267d23d8e2f/users/9c573f1dcfb64844971a2b1e79d4f2dd/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:19.922513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac754f-4e63-4852-8ec1-952497c7e45f admin admin] RBAC: Authorizing `identity:create_grant(project_id=53569afe5cc74ebc82eb1267d23d8e2f, user_id=9c573f1dcfb64844971a2b1e79d4f2dd, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:19.925225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac754f-4e63-4852-8ec1-952497c7e45f admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:19.941675 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1149/2281] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:59:19 2022] PUT /identity/v3/projects/53569afe5cc74ebc82eb1267d23d8e2f/users/9c573f1dcfb64844971a2b1e79d4f2dd/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:19.953620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf3ac7-aa27-44d3-877b-8612b42ee4ff None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:19.953918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf3ac7-aa27-44d3-877b-8612b42ee4ff None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:19.954202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf3ac7-aa27-44d3-877b-8612b42ee4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:19.987906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-2ddf3ac7-aa27-44d3-877b-8612b42ee4ff None None] MFA Rules not processed for user `9c573f1dcfb64844971a2b1e79d4f2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:19.989396 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-2ddf3ac7-aa27-44d3-877b-8612b42ee4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:20.086456 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1133/2282] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:20.087229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac754f-4e63-4852-8ec1-952497c7e45f admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:20.166528 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac754f-4e63-4852-8ec1-952497c7e45f admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:20.175670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f581c-50cf-4fc2-8a46-e04dcbd69946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:20.177442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f581c-50cf-4fc2-8a46-e04dcbd69946 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:20.177442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f581c-50cf-4fc2-8a46-e04dcbd69946 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:20.177442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f581c-50cf-4fc2-8a46-e04dcbd69946 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:20.178037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f581c-50cf-4fc2-8a46-e04dcbd69946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:20.182104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f581c-50cf-4fc2-8a46-e04dcbd69946 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:20.238786 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1150/2283] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:59:20 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:59:20.244974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf3ac7-aa27-44d3-877b-8612b42ee4ff None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:20.255186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf3ac7-aa27-44d3-877b-8612b42ee4ff None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:20.329782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855fe1d-d7b0-4fdb-b892-d85a407f7911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:20.330478 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855fe1d-d7b0-4fdb-b892-d85a407f7911 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:20.330775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855fe1d-d7b0-4fdb-b892-d85a407f7911 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:20.331062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855fe1d-d7b0-4fdb-b892-d85a407f7911 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:20.331803 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855fe1d-d7b0-4fdb-b892-d85a407f7911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:20.333792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855fe1d-d7b0-4fdb-b892-d85a407f7911 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:20.351580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:20.359610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1134/2284] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:59:20 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:59:20.363242 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f581c-50cf-4fc2-8a46-e04dcbd69946 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:20.378800 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f581c-50cf-4fc2-8a46-e04dcbd69946 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:20.383480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d27f1-b05c-4b44-8b09-36d4d556b0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:20.384082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d27f1-b05c-4b44-8b09-36d4d556b0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:20.384366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d27f1-b05c-4b44-8b09-36d4d556b0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:20.384645 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d27f1-b05c-4b44-8b09-36d4d556b0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:20.385391 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d27f1-b05c-4b44-8b09-36d4d556b0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:20.387592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d27f1-b05c-4b44-8b09-36d4d556b0c6 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:20.398964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1151/2285] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:20.403144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855fe1d-d7b0-4fdb-b892-d85a407f7911 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:20.413061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855fe1d-d7b0-4fdb-b892-d85a407f7911 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:20.417747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d943474-7cf4-4ff0-bc8a-bebcad73bba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:20.418949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d943474-7cf4-4ff0-bc8a-bebcad73bba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:20.419230 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d943474-7cf4-4ff0-bc8a-bebcad73bba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:20.419503 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d943474-7cf4-4ff0-bc8a-bebcad73bba7 admin admin] PATH_INFO: `/v3/projects/7b67f66921ad401c9a69586e2c03427b/users/735cb25792bf4046a99133a71a01b2f5/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:20.435402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d943474-7cf4-4ff0-bc8a-bebcad73bba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b67f66921ad401c9a69586e2c03427b, user_id=735cb25792bf4046a99133a71a01b2f5, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:20.438104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d943474-7cf4-4ff0-bc8a-bebcad73bba7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:20.453222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1135/2286] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:59:20 2022] PUT /identity/v3/projects/7b67f66921ad401c9a69586e2c03427b/users/735cb25792bf4046a99133a71a01b2f5/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:20.457617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d27f1-b05c-4b44-8b09-36d4d556b0c6 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:20.464593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:20.469899 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d27f1-b05c-4b44-8b09-36d4d556b0c6 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:20.532579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d93d73-a697-414d-9226-bc5e6f4c4582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:20.533244 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93d73-a697-414d-9226-bc5e6f4c4582 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:20.533547 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93d73-a697-414d-9226-bc5e6f4c4582 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:20.533826 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93d73-a697-414d-9226-bc5e6f4c4582 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:20.535172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d93d73-a697-414d-9226-bc5e6f4c4582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:20.538905 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d93d73-a697-414d-9226-bc5e6f4c4582 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:20.555025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1152/2287] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:20.556772 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d943474-7cf4-4ff0-bc8a-bebcad73bba7 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:20.568245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d943474-7cf4-4ff0-bc8a-bebcad73bba7 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:20.575903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb3691-b7dc-4276-9fb7-3144016b0e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:20.576750 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb3691-b7dc-4276-9fb7-3144016b0e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:20.577289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb3691-b7dc-4276-9fb7-3144016b0e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:20.577580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb3691-b7dc-4276-9fb7-3144016b0e1c admin admin] PATH_INFO: `/v3/projects/7b67f66921ad401c9a69586e2c03427b/users/735cb25792bf4046a99133a71a01b2f5/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:20.579856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb3691-b7dc-4276-9fb7-3144016b0e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b67f66921ad401c9a69586e2c03427b, user_id=735cb25792bf4046a99133a71a01b2f5, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:20.582794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb3691-b7dc-4276-9fb7-3144016b0e1c admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:20.595115 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1136/2288] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:59:20 2022] PUT /identity/v3/projects/7b67f66921ad401c9a69586e2c03427b/users/735cb25792bf4046a99133a71a01b2f5/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:20.606331 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93056385-c2d7-4c30-af2b-db55ebaf3e8c None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:20.606732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93056385-c2d7-4c30-af2b-db55ebaf3e8c None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:20.607191 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93056385-c2d7-4c30-af2b-db55ebaf3e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:20.644505 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-93056385-c2d7-4c30-af2b-db55ebaf3e8c None None] MFA Rules not processed for user `735cb25792bf4046a99133a71a01b2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:20.646110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-93056385-c2d7-4c30-af2b-db55ebaf3e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:20.720152 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1153/2289] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:59:20.731979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb3691-b7dc-4276-9fb7-3144016b0e1c admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:20.733745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-6ebb3691-b7dc-4276-9fb7-3144016b0e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:20.791845 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb3691-b7dc-4276-9fb7-3144016b0e1c admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:20.796226 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6e05a-b2e5-48ce-a015-d539fafc2d54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:20.796974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6e05a-b2e5-48ce-a015-d539fafc2d54 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:20.797285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6e05a-b2e5-48ce-a015-d539fafc2d54 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:20.797563 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6e05a-b2e5-48ce-a015-d539fafc2d54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:20.806765 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6e05a-b2e5-48ce-a015-d539fafc2d54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:20.808190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6e05a-b2e5-48ce-a015-d539fafc2d54 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:20.818422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1137/2290] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:20.895465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93056385-c2d7-4c30-af2b-db55ebaf3e8c None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:20.905703 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93056385-c2d7-4c30-af2b-db55ebaf3e8c None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:20.909619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9f8ee-5da1-4e96-877e-bd98a4a6ba37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:20.910241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f8ee-5da1-4e96-877e-bd98a4a6ba37 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:20.910529 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f8ee-5da1-4e96-877e-bd98a4a6ba37 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:20.910804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f8ee-5da1-4e96-877e-bd98a4a6ba37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:20.975137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9f8ee-5da1-4e96-877e-bd98a4a6ba37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:20.976605 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9f8ee-5da1-4e96-877e-bd98a4a6ba37 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:20.987117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1154/2291] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:22.766431 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6e05a-b2e5-48ce-a015-d539fafc2d54 service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:22.767809 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c3c6e05a-b2e5-48ce-a015-d539fafc2d54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:22.840312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6e05a-b2e5-48ce-a015-d539fafc2d54 service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:22.846053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f6dc7-a254-4a3d-9d82-6cb86e6c7d0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:22.846659 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f6dc7-a254-4a3d-9d82-6cb86e6c7d0a service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:22.846940 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f6dc7-a254-4a3d-9d82-6cb86e6c7d0a service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:22.847214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f6dc7-a254-4a3d-9d82-6cb86e6c7d0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:22.848927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-457f6dc7-a254-4a3d-9d82-6cb86e6c7d0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:22.907122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f6dc7-a254-4a3d-9d82-6cb86e6c7d0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:22.908902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f6dc7-a254-4a3d-9d82-6cb86e6c7d0a service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:22.913724 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:22.919477 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1138/2292] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:26.546354 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebd8ef-3ef4-4849-8a30-d6a34e3022d1 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:26.546866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebd8ef-3ef4-4849-8a30-d6a34e3022d1 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:26.546973 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebd8ef-3ef4-4849-8a30-d6a34e3022d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:26.565890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-d9ebd8ef-3ef4-4849-8a30-d6a34e3022d1 None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:26.567110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d9ebd8ef-3ef4-4849-8a30-d6a34e3022d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:26.599683 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:26.639345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1155/2293] 10.222.0.76 () {58 vars in 967 bytes} [Fri Aug 26 08:59:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:26.699040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f6dc7-a254-4a3d-9d82-6cb86e6c7d0a service nova] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:26.701081 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-457f6dc7-a254-4a3d-9d82-6cb86e6c7d0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:26.783258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f6dc7-a254-4a3d-9d82-6cb86e6c7d0a service nova] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:26.789279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd234c-c354-46ed-8994-5f05aa42042c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:26.789892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd234c-c354-46ed-8994-5f05aa42042c service swift] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:26.790707 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd234c-c354-46ed-8994-5f05aa42042c service swift] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:26.790707 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd234c-c354-46ed-8994-5f05aa42042c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:26.799211 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd234c-c354-46ed-8994-5f05aa42042c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:26.800824 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd234c-c354-46ed-8994-5f05aa42042c service swift] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:26.809953 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1139/2294] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 08:59:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 08:59:27.246887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebd8ef-3ef4-4849-8a30-d6a34e3022d1 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:27.249073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d9ebd8ef-3ef4-4849-8a30-d6a34e3022d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:27.314748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebd8ef-3ef4-4849-8a30-d6a34e3022d1 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:27.318631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20873a56-da6d-4016-a05a-847aaff2de5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:27.319545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20873a56-da6d-4016-a05a-847aaff2de5b service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:27.319653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20873a56-da6d-4016-a05a-847aaff2de5b service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:27.319843 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20873a56-da6d-4016-a05a-847aaff2de5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:27.321624 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-20873a56-da6d-4016-a05a-847aaff2de5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:27.390584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20873a56-da6d-4016-a05a-847aaff2de5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:27.391980 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20873a56-da6d-4016-a05a-847aaff2de5b service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:27.401894 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1156/2295] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:28.299842 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd234c-c354-46ed-8994-5f05aa42042c service swift] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:28.312187 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd234c-c354-46ed-8994-5f05aa42042c service swift] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:28.318820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138754f-8fa6-4929-b54c-02d8123de7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:28.320590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138754f-8fa6-4929-b54c-02d8123de7b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:28.320880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138754f-8fa6-4929-b54c-02d8123de7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:28.321193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138754f-8fa6-4929-b54c-02d8123de7b7 admin admin] PATH_INFO: `/v3/users/9c573f1dcfb64844971a2b1e79d4f2dd` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:28.325816 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138754f-8fa6-4929-b54c-02d8123de7b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c573f1dcfb64844971a2b1e79d4f2dd)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:28.328363 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138754f-8fa6-4929-b54c-02d8123de7b7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:28.385851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c138754f-8fa6-4929-b54c-02d8123de7b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c573f1dcfb64844971a2b1e79d4f2dd'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:28.398241 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c138754f-8fa6-4929-b54c-02d8123de7b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c573f1dcfb64844971a2b1e79d4f2dd'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:28.399242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c138754f-8fa6-4929-b54c-02d8123de7b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c573f1dcfb64844971a2b1e79d4f2dd'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:28.399886 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c138754f-8fa6-4929-b54c-02d8123de7b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c573f1dcfb64844971a2b1e79d4f2dd'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:28.416261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c138754f-8fa6-4929-b54c-02d8123de7b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c573f1dcfb64844971a2b1e79d4f2dd'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:28.441200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1140/2296] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:59:28 2022] DELETE /identity/v3/users/9c573f1dcfb64844971a2b1e79d4f2dd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:28.445581 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcccfce-12dd-4d59-be83-b4a67ed77698 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:28.446093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcccfce-12dd-4d59-be83-b4a67ed77698 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:28.446265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcccfce-12dd-4d59-be83-b4a67ed77698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:28.469302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-4bcccfce-12dd-4d59-be83-b4a67ed77698 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:28.471161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4bcccfce-12dd-4d59-be83-b4a67ed77698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:28.546822 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1157/2297] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:59:28.559200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138754f-8fa6-4929-b54c-02d8123de7b7 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:28.560657 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c138754f-8fa6-4929-b54c-02d8123de7b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:28.639344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138754f-8fa6-4929-b54c-02d8123de7b7 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:28.642966 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad168b7-ae11-4971-8b97-4e4009d6de66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:28.643568 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad168b7-ae11-4971-8b97-4e4009d6de66 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:28.643852 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad168b7-ae11-4971-8b97-4e4009d6de66 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:28.644118 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad168b7-ae11-4971-8b97-4e4009d6de66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:28.654190 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad168b7-ae11-4971-8b97-4e4009d6de66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:28.655614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad168b7-ae11-4971-8b97-4e4009d6de66 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:28.673891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1141/2298] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:28.974306 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcccfce-12dd-4d59-be83-b4a67ed77698 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:28.975835 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4bcccfce-12dd-4d59-be83-b4a67ed77698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:28.999795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcccfce-12dd-4d59-be83-b4a67ed77698 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:29.014869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55583676-599a-4cc1-974a-918c394a598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:29.015526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55583676-599a-4cc1-974a-918c394a598f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:29.015811 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55583676-599a-4cc1-974a-918c394a598f admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:29.016086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55583676-599a-4cc1-974a-918c394a598f admin admin] PATH_INFO: `/v3/projects/53569afe5cc74ebc82eb1267d23d8e2f` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:29.017285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55583676-599a-4cc1-974a-918c394a598f admin admin] RBAC: Authorizing `identity:delete_project(project_id=53569afe5cc74ebc82eb1267d23d8e2f)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:29.019208 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55583676-599a-4cc1-974a-918c394a598f admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:29.036477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:29.074322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-55583676-599a-4cc1-974a-918c394a598f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53569afe5cc74ebc82eb1267d23d8e2f', 'request_id': 'req-55583676-599a-4cc1-974a-918c394a598f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:29.081726 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-55583676-599a-4cc1-974a-918c394a598f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53569afe5cc74ebc82eb1267d23d8e2f', 'request_id': 'req-55583676-599a-4cc1-974a-918c394a598f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:29.090474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-55583676-599a-4cc1-974a-918c394a598f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53569afe5cc74ebc82eb1267d23d8e2f', 'request_id': 'req-55583676-599a-4cc1-974a-918c394a598f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:29.103243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-55583676-599a-4cc1-974a-918c394a598f admin admin] The token cache is being invalidate because project 53569afe5cc74ebc82eb1267d23d8e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:59:29.104290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-55583676-599a-4cc1-974a-918c394a598f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:29.105326 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-55583676-599a-4cc1-974a-918c394a598f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:29.107620 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1158/2299] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:59:28 2022] DELETE /identity/v3/projects/53569afe5cc74ebc82eb1267d23d8e2f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:29.111313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad168b7-ae11-4971-8b97-4e4009d6de66 service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:29.117674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:29.122170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad168b7-ae11-4971-8b97-4e4009d6de66 service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:29.179907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de69f2f-82d8-4655-a6c2-02d29661dc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:29.180539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de69f2f-82d8-4655-a6c2-02d29661dc5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:29.180823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de69f2f-82d8-4655-a6c2-02d29661dc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:29.181137 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de69f2f-82d8-4655-a6c2-02d29661dc5d admin admin] PATH_INFO: `/v3/users/735cb25792bf4046a99133a71a01b2f5` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:29.182262 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de69f2f-82d8-4655-a6c2-02d29661dc5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=735cb25792bf4046a99133a71a01b2f5)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:29.184741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de69f2f-82d8-4655-a6c2-02d29661dc5d admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:29.253957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5de69f2f-82d8-4655-a6c2-02d29661dc5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '735cb25792bf4046a99133a71a01b2f5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:29.264843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5de69f2f-82d8-4655-a6c2-02d29661dc5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '735cb25792bf4046a99133a71a01b2f5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:29.265659 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5de69f2f-82d8-4655-a6c2-02d29661dc5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '735cb25792bf4046a99133a71a01b2f5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:29.266352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5de69f2f-82d8-4655-a6c2-02d29661dc5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '735cb25792bf4046a99133a71a01b2f5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:29.276700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5de69f2f-82d8-4655-a6c2-02d29661dc5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '735cb25792bf4046a99133a71a01b2f5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:29.297537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1142/2300] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:59:29 2022] DELETE /identity/v3/users/735cb25792bf4046a99133a71a01b2f5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:59:29.669997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55583676-599a-4cc1-974a-918c394a598f admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:29.669997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-55583676-599a-4cc1-974a-918c394a598f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:29.687563 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55583676-599a-4cc1-974a-918c394a598f admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:29.782269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120e5ce-d017-47ae-bc0b-964d065343c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:29.782944 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120e5ce-d017-47ae-bc0b-964d065343c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:29.784542 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120e5ce-d017-47ae-bc0b-964d065343c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:29.784864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120e5ce-d017-47ae-bc0b-964d065343c6 admin admin] PATH_INFO: `/v3/projects/7b67f66921ad401c9a69586e2c03427b` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:29.786325 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120e5ce-d017-47ae-bc0b-964d065343c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b67f66921ad401c9a69586e2c03427b)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:29.788314 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120e5ce-d017-47ae-bc0b-964d065343c6 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:29.848436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8120e5ce-d017-47ae-bc0b-964d065343c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b67f66921ad401c9a69586e2c03427b', 'request_id': 'req-8120e5ce-d017-47ae-bc0b-964d065343c6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:29.857044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8120e5ce-d017-47ae-bc0b-964d065343c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b67f66921ad401c9a69586e2c03427b', 'request_id': 'req-8120e5ce-d017-47ae-bc0b-964d065343c6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:29.873243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8120e5ce-d017-47ae-bc0b-964d065343c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b67f66921ad401c9a69586e2c03427b', 'request_id': 'req-8120e5ce-d017-47ae-bc0b-964d065343c6'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:29.889472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8120e5ce-d017-47ae-bc0b-964d065343c6 admin admin] The token cache is being invalidate because project 7b67f66921ad401c9a69586e2c03427b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:59:29.889853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8120e5ce-d017-47ae-bc0b-964d065343c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:29.890550 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-8120e5ce-d017-47ae-bc0b-964d065343c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:29.893168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1159/2301] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:59:29 2022] DELETE /identity/v3/projects/7b67f66921ad401c9a69586e2c03427b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:29.899283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666d8d0-36ad-42d1-b244-711ee54d3a79 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:29.899787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666d8d0-36ad-42d1-b244-711ee54d3a79 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:29.899899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666d8d0-36ad-42d1-b244-711ee54d3a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:29.937481 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-4666d8d0-36ad-42d1-b244-711ee54d3a79 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:29.940104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-4666d8d0-36ad-42d1-b244-711ee54d3a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:30.009736 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1143/2302] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:59:30.018755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c990ec2-de1f-46cc-b784-cf6eb3943962 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:30.019177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c990ec2-de1f-46cc-b784-cf6eb3943962 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:30.019647 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c990ec2-de1f-46cc-b784-cf6eb3943962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:30.042146 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-2c990ec2-de1f-46cc-b784-cf6eb3943962 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:30.043260 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-2c990ec2-de1f-46cc-b784-cf6eb3943962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:30.052953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1160/2303] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:30.061569 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666d8d0-36ad-42d1-b244-711ee54d3a79 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:30.072224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666d8d0-36ad-42d1-b244-711ee54d3a79 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:30.078283 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ce611-d8a6-4b4a-9499-323d24da7e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:30.079309 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ce611-d8a6-4b4a-9499-323d24da7e3a admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:30.079930 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ce611-d8a6-4b4a-9499-323d24da7e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:30.080707 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ce611-d8a6-4b4a-9499-323d24da7e3a admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:30.081652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ce611-d8a6-4b4a-9499-323d24da7e3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:59:30.082188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ce611-d8a6-4b4a-9499-323d24da7e3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:30.084017 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ce611-d8a6-4b4a-9499-323d24da7e3a admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:30.099321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1144/2304] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:59:30.103411 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c990ec2-de1f-46cc-b784-cf6eb3943962 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:30.115035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c990ec2-de1f-46cc-b784-cf6eb3943962 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:30.124611 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7eabb2-7461-4a66-a971-78c61af7e995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:30.125545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eabb2-7461-4a66-a971-78c61af7e995 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:30.125997 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eabb2-7461-4a66-a971-78c61af7e995 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:30.126369 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eabb2-7461-4a66-a971-78c61af7e995 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:30.127064 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7eabb2-7461-4a66-a971-78c61af7e995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:30.129201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7eabb2-7461-4a66-a971-78c61af7e995 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:30.178376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1161/2305] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:59:30 2022] POST /identity/v3/projects => generated 401 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:59:30.181658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ce611-d8a6-4b4a-9499-323d24da7e3a admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:30.197422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ce611-d8a6-4b4a-9499-323d24da7e3a admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:30.209856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:30.366132 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7fa87-e64f-43db-aa9e-2264e79f3066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:30.367188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7fa87-e64f-43db-aa9e-2264e79f3066 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:30.367657 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7fa87-e64f-43db-aa9e-2264e79f3066 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:30.368244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7fa87-e64f-43db-aa9e-2264e79f3066 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:30.370445 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7fa87-e64f-43db-aa9e-2264e79f3066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:30.373763 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7fa87-e64f-43db-aa9e-2264e79f3066 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:30.409631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1145/2306] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:59:30 2022] POST /identity/v3/users => generated 301 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:59:30.411432 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7eabb2-7461-4a66-a971-78c61af7e995 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:30.433962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:30.439262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7eabb2-7461-4a66-a971-78c61af7e995 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:30.446371 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959d9bb-c5f4-4dbd-b285-1ca27a282aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:30.447603 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959d9bb-c5f4-4dbd-b285-1ca27a282aed admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:30.448135 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959d9bb-c5f4-4dbd-b285-1ca27a282aed admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:30.448872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959d9bb-c5f4-4dbd-b285-1ca27a282aed admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:30.451216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959d9bb-c5f4-4dbd-b285-1ca27a282aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:30.454059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959d9bb-c5f4-4dbd-b285-1ca27a282aed admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:30.469623 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1162/2307] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:59:30.474302 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7fa87-e64f-43db-aa9e-2264e79f3066 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:30.489226 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7fa87-e64f-43db-aa9e-2264e79f3066 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:30.496722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b1267-6439-4321-bd2d-15191ee5bf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:30.497425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b1267-6439-4321-bd2d-15191ee5bf9d admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:30.497713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b1267-6439-4321-bd2d-15191ee5bf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:30.497991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b1267-6439-4321-bd2d-15191ee5bf9d admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:30.498651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b1267-6439-4321-bd2d-15191ee5bf9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:30.500315 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b1267-6439-4321-bd2d-15191ee5bf9d admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:30.514830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1146/2308] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:30.519284 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959d9bb-c5f4-4dbd-b285-1ca27a282aed admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:30.535781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959d9bb-c5f4-4dbd-b285-1ca27a282aed admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:30.542262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766bc25-d7dc-4f4c-baad-5b9e552ff2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:30.544384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766bc25-d7dc-4f4c-baad-5b9e552ff2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:30.544976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766bc25-d7dc-4f4c-baad-5b9e552ff2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:30.545281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766bc25-d7dc-4f4c-baad-5b9e552ff2e4 admin admin] PATH_INFO: `/v3/projects/78aed102737b4265ba73d6b3335f91eb/users/09363546f9414eb998eb2194cfbd6653/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:30.578929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766bc25-d7dc-4f4c-baad-5b9e552ff2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78aed102737b4265ba73d6b3335f91eb, user_id=09363546f9414eb998eb2194cfbd6653, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:30.583712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766bc25-d7dc-4f4c-baad-5b9e552ff2e4 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:30.608285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1163/2309] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:59:30 2022] PUT /identity/v3/projects/78aed102737b4265ba73d6b3335f91eb/users/09363546f9414eb998eb2194cfbd6653/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:30.621665 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eb074-4ca8-4ec4-9065-98467094b036 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:30.622315 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eb074-4ca8-4ec4-9065-98467094b036 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:30.622677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eb074-4ca8-4ec4-9065-98467094b036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:30.665357 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-cd2eb074-4ca8-4ec4-9065-98467094b036 None None] MFA Rules not processed for user `09363546f9414eb998eb2194cfbd6653`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:30.666585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-cd2eb074-4ca8-4ec4-9065-98467094b036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:30.802804 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1147/2310] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:30 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:30.804151 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766bc25-d7dc-4f4c-baad-5b9e552ff2e4 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:30.917367 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766bc25-d7dc-4f4c-baad-5b9e552ff2e4 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:30.924695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70025a57-5063-4833-9d3d-c5c6ccfaf574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:30.925858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70025a57-5063-4833-9d3d-c5c6ccfaf574 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:30.926344 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70025a57-5063-4833-9d3d-c5c6ccfaf574 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:30.926792 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70025a57-5063-4833-9d3d-c5c6ccfaf574 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:30.927442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70025a57-5063-4833-9d3d-c5c6ccfaf574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:30.929506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70025a57-5063-4833-9d3d-c5c6ccfaf574 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:30.979190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1164/2311] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:59:30 2022] POST /identity/v3/projects => generated 399 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:59:30.981246 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2eb074-4ca8-4ec4-9065-98467094b036 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:30.997133 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2eb074-4ca8-4ec4-9065-98467094b036 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:31.090807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320d92e-bd26-4528-84be-e06f1c955f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:31.091465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320d92e-bd26-4528-84be-e06f1c955f01 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:31.091741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320d92e-bd26-4528-84be-e06f1c955f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:31.092016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320d92e-bd26-4528-84be-e06f1c955f01 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:31.092728 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320d92e-bd26-4528-84be-e06f1c955f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:31.095033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320d92e-bd26-4528-84be-e06f1c955f01 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:31.130374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1148/2312] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:59:30 2022] POST /identity/v3/users => generated 306 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:59:31.134629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70025a57-5063-4833-9d3d-c5c6ccfaf574 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:31.153212 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70025a57-5063-4833-9d3d-c5c6ccfaf574 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:31.159856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df96f7a-0d74-484d-aaa1-9485519948fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:31.160579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df96f7a-0d74-484d-aaa1-9485519948fa admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:31.160936 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df96f7a-0d74-484d-aaa1-9485519948fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:31.161552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df96f7a-0d74-484d-aaa1-9485519948fa admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:31.162643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df96f7a-0d74-484d-aaa1-9485519948fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:31.164539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df96f7a-0d74-484d-aaa1-9485519948fa admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:31.178793 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1165/2313] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:59:31.182838 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320d92e-bd26-4528-84be-e06f1c955f01 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:31.197117 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320d92e-bd26-4528-84be-e06f1c955f01 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:31.206413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabae829-9233-4883-abd2-9f560aeb32e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:31.207104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabae829-9233-4883-abd2-9f560aeb32e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:31.207465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabae829-9233-4883-abd2-9f560aeb32e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:31.207751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabae829-9233-4883-abd2-9f560aeb32e1 admin admin] PATH_INFO: `/v3/projects/5c750d71d07b4001ae5277d7eeee8c86/users/8cd057d2c20e48d2b708f755f835749c/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:31.215945 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:31.241120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabae829-9233-4883-abd2-9f560aeb32e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c750d71d07b4001ae5277d7eeee8c86, user_id=8cd057d2c20e48d2b708f755f835749c, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:31.244678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabae829-9233-4883-abd2-9f560aeb32e1 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:31.274272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1149/2314] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:59:31 2022] PUT /identity/v3/projects/5c750d71d07b4001ae5277d7eeee8c86/users/8cd057d2c20e48d2b708f755f835749c/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:31.279159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df96f7a-0d74-484d-aaa1-9485519948fa admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:31.301044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df96f7a-0d74-484d-aaa1-9485519948fa admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:31.382037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028dd11-d0a7-4298-9924-711f41920001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:31.382655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028dd11-d0a7-4298-9924-711f41920001 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:31.382942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028dd11-d0a7-4298-9924-711f41920001 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:31.383220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028dd11-d0a7-4298-9924-711f41920001 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:31.383880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028dd11-d0a7-4298-9924-711f41920001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:31.385629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028dd11-d0a7-4298-9924-711f41920001 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:31.397039 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1166/2315] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:31.400233 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabae829-9233-4883-abd2-9f560aeb32e1 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:31.413882 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabae829-9233-4883-abd2-9f560aeb32e1 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:31.420069 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c6685-b81b-44c5-8986-6b233eac3d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:31.420739 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c6685-b81b-44c5-8986-6b233eac3d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:31.421164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c6685-b81b-44c5-8986-6b233eac3d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:31.421657 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c6685-b81b-44c5-8986-6b233eac3d94 admin admin] PATH_INFO: `/v3/projects/5c750d71d07b4001ae5277d7eeee8c86/users/8cd057d2c20e48d2b708f755f835749c/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:31.423253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c6685-b81b-44c5-8986-6b233eac3d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c750d71d07b4001ae5277d7eeee8c86, user_id=8cd057d2c20e48d2b708f755f835749c, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:31.426089 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c6685-b81b-44c5-8986-6b233eac3d94 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:31.455385 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1150/2316] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:59:31 2022] PUT /identity/v3/projects/5c750d71d07b4001ae5277d7eeee8c86/users/8cd057d2c20e48d2b708f755f835749c/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:59:31.457830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c9f68-53c9-47a1-8f85-ecf13ad780a4 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:31.458149 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c9f68-53c9-47a1-8f85-ecf13ad780a4 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:31.458431 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c9f68-53c9-47a1-8f85-ecf13ad780a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:31.486451 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078a56c-be21-4f67-a2b0-be8363ef4cc5 None None] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:31.486844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078a56c-be21-4f67-a2b0-be8363ef4cc5 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:31.487312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078a56c-be21-4f67-a2b0-be8363ef4cc5 None None] PATH_INFO: `/` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:31.491759 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1151/2317] 10.222.0.76 () {54 vars in 921 bytes} [Fri Aug 26 08:59:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 08:59:31.503933 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-9a1c9f68-53c9-47a1-8f85-ecf13ad780a4 None None] MFA Rules not processed for user `8cd057d2c20e48d2b708f755f835749c`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:31.505290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9a1c9f68-53c9-47a1-8f85-ecf13ad780a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:31.523961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ccca4-1d75-4f70-a25e-33876d793528 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:31.524261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ccca4-1d75-4f70-a25e-33876d793528 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:31.524539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ccca4-1d75-4f70-a25e-33876d793528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:31.543592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:31.566572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-d40ccca4-1d75-4f70-a25e-33876d793528 None None] MFA Rules not processed for user `95abbd88e549427abbf5699efed0451a`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:31.567851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d40ccca4-1d75-4f70-a25e-33876d793528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:31.654161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1167/2318] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:31 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:31.666569 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c9f68-53c9-47a1-8f85-ecf13ad780a4 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:31.668712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9a1c9f68-53c9-47a1-8f85-ecf13ad780a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:31.721122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1152/2319] 10.222.0.76 () {58 vars in 1018 bytes} [Fri Aug 26 08:59:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:59:31.740163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ccca4-1d75-4f70-a25e-33876d793528 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:31.741659 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d40ccca4-1d75-4f70-a25e-33876d793528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:31.757677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ccca4-1d75-4f70-a25e-33876d793528 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:31.764513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a8daa-d1d1-4a94-b1e6-179c4a5d7e6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95abbd88e549427abbf5699efed0451a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:31.765160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a8daa-d1d1-4a94-b1e6-179c4a5d7e6b service placement] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:31.765462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a8daa-d1d1-4a94-b1e6-179c4a5d7e6b service placement] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:31.765733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a8daa-d1d1-4a94-b1e6-179c4a5d7e6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:31.767177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c9f68-53c9-47a1-8f85-ecf13ad780a4 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:31.771601 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52ccee-e14e-4811-ba55-4bede6e2610f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:31.772563 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52ccee-e14e-4811-ba55-4bede6e2610f service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:31.773099 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52ccee-e14e-4811-ba55-4bede6e2610f service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:31.773630 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52ccee-e14e-4811-ba55-4bede6e2610f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:31.774806 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a8daa-d1d1-4a94-b1e6-179c4a5d7e6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:31.776387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a8daa-d1d1-4a94-b1e6-179c4a5d7e6b service placement] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:31.784583 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52ccee-e14e-4811-ba55-4bede6e2610f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:31.786228 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52ccee-e14e-4811-ba55-4bede6e2610f service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:31.788666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1153/2320] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:31.810048 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1168/2321] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:31 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:59:31.895232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a8daa-d1d1-4a94-b1e6-179c4a5d7e6b service placement] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:31.904770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a8daa-d1d1-4a94-b1e6-179c4a5d7e6b service placement] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:31.908933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b3b18-3529-4a5c-bee9-c9f7f57bbd4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:31.909698 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b3b18-3529-4a5c-bee9-c9f7f57bbd4c service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:31.910039 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b3b18-3529-4a5c-bee9-c9f7f57bbd4c service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:31.910394 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b3b18-3529-4a5c-bee9-c9f7f57bbd4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:31.982174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b3b18-3529-4a5c-bee9-c9f7f57bbd4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:31.983639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b3b18-3529-4a5c-bee9-c9f7f57bbd4c service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:31.992840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1154/2322] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:31 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:33.152136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd395-71f3-4719-9954-5c60d70a6749 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:33.152696 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd395-71f3-4719-9954-5c60d70a6749 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:33.152696 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd395-71f3-4719-9954-5c60d70a6749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:33.174011 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-901fd395-71f3-4719-9954-5c60d70a6749 None None] MFA Rules not processed for user `e031367406df4a3d95f2ed9e2eb8efae`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:33.175246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-901fd395-71f3-4719-9954-5c60d70a6749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:33.231894 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1169/2323] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:36.449901 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b3b18-3529-4a5c-bee9-c9f7f57bbd4c service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:36.555881 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:36.579288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b3b18-3529-4a5c-bee9-c9f7f57bbd4c service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:36.603149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c75f51-c697-4e9e-a7de-c89b0700a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:36.604295 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c75f51-c697-4e9e-a7de-c89b0700a522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:36.604809 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c75f51-c697-4e9e-a7de-c89b0700a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:36.610439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c75f51-c697-4e9e-a7de-c89b0700a522 admin admin] PATH_INFO: `/v3/users/09363546f9414eb998eb2194cfbd6653` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:36.613271 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c75f51-c697-4e9e-a7de-c89b0700a522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09363546f9414eb998eb2194cfbd6653)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:36.628013 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c75f51-c697-4e9e-a7de-c89b0700a522 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:36.672235 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fd395-71f3-4719-9954-5c60d70a6749 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:36.681767 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-901fd395-71f3-4719-9954-5c60d70a6749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:36.704671 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fd395-71f3-4719-9954-5c60d70a6749 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:36.706356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-68c75f51-c697-4e9e-a7de-c89b0700a522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09363546f9414eb998eb2194cfbd6653'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:36.723921 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189036c9-dd29-4cbe-984f-e275728ff02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:36.724761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189036c9-dd29-4cbe-984f-e275728ff02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:36.725314 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189036c9-dd29-4cbe-984f-e275728ff02d admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:36.725855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189036c9-dd29-4cbe-984f-e275728ff02d admin admin] PATH_INFO: `/v3/users/410920eca8e246c7bdd9da55ff27eee7` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:36.727334 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189036c9-dd29-4cbe-984f-e275728ff02d admin admin] RBAC: Authorizing `identity:delete_user(user_id=410920eca8e246c7bdd9da55ff27eee7)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:36.729545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189036c9-dd29-4cbe-984f-e275728ff02d admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:36.733034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-68c75f51-c697-4e9e-a7de-c89b0700a522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09363546f9414eb998eb2194cfbd6653'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:36.733733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-68c75f51-c697-4e9e-a7de-c89b0700a522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09363546f9414eb998eb2194cfbd6653'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:36.734977 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-68c75f51-c697-4e9e-a7de-c89b0700a522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09363546f9414eb998eb2194cfbd6653'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:36.751910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-68c75f51-c697-4e9e-a7de-c89b0700a522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09363546f9414eb998eb2194cfbd6653'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:36.797740 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1155/2324] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:59:36 2022] DELETE /identity/v3/users/09363546f9414eb998eb2194cfbd6653 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:36.802729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef015506-d1fd-4094-90fb-fe79207ec3fa None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:36.802729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef015506-d1fd-4094-90fb-fe79207ec3fa None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:36.802978 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef015506-d1fd-4094-90fb-fe79207ec3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:36.807983 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-189036c9-dd29-4cbe-984f-e275728ff02d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410920eca8e246c7bdd9da55ff27eee7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:36.824655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-189036c9-dd29-4cbe-984f-e275728ff02d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410920eca8e246c7bdd9da55ff27eee7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:36.826035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-189036c9-dd29-4cbe-984f-e275728ff02d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410920eca8e246c7bdd9da55ff27eee7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:36.835105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ef015506-d1fd-4094-90fb-fe79207ec3fa None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:36.837333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ef015506-d1fd-4094-90fb-fe79207ec3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:36.842658 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-189036c9-dd29-4cbe-984f-e275728ff02d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410920eca8e246c7bdd9da55ff27eee7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:36.855813 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:36.872337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-189036c9-dd29-4cbe-984f-e275728ff02d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410920eca8e246c7bdd9da55ff27eee7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:36.884853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1170/2325] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:59:36 2022] DELETE /identity/v3/users/410920eca8e246c7bdd9da55ff27eee7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:36.936827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1156/2326] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:59:36.955735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189036c9-dd29-4cbe-984f-e275728ff02d admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:36.958167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-189036c9-dd29-4cbe-984f-e275728ff02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:37.055169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189036c9-dd29-4cbe-984f-e275728ff02d admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:37.060201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d5ffb-865e-4b2c-bf04-cd2252953c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:37.061546 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d5ffb-865e-4b2c-bf04-cd2252953c4e service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:37.062312 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d5ffb-865e-4b2c-bf04-cd2252953c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:37.062312 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d5ffb-865e-4b2c-bf04-cd2252953c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:37.143990 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d5ffb-865e-4b2c-bf04-cd2252953c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:37.146015 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d5ffb-865e-4b2c-bf04-cd2252953c4e service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:37.158794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1171/2327] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:37.295341 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef015506-d1fd-4094-90fb-fe79207ec3fa None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:37.298094 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ef015506-d1fd-4094-90fb-fe79207ec3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:37.320089 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef015506-d1fd-4094-90fb-fe79207ec3fa None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:37.329708 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:37.338166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:37.339077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:37.339516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf admin admin] PATH_INFO: `/v3/projects/be3effe1c7174488beea7800cf28999f` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:37.342393 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=be3effe1c7174488beea7800cf28999f)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:37.344954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:37.414091 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be3effe1c7174488beea7800cf28999f', 'request_id': 'req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:37.422316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be3effe1c7174488beea7800cf28999f', 'request_id': 'req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:37.431928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be3effe1c7174488beea7800cf28999f', 'request_id': 'req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:37.438917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:37.449166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf admin admin] The token cache is being invalidate because project be3effe1c7174488beea7800cf28999f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:59:37.449849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:37.451202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:37.454441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1157/2328] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:59:37 2022] DELETE /identity/v3/projects/be3effe1c7174488beea7800cf28999f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:37.458152 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d5ffb-865e-4b2c-bf04-cd2252953c4e service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:37.485273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d5ffb-865e-4b2c-bf04-cd2252953c4e service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:37.617026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b35652-786e-4a87-8316-6da8d0aabfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:37.617026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b35652-786e-4a87-8316-6da8d0aabfe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:37.617026 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b35652-786e-4a87-8316-6da8d0aabfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:37.617508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b35652-786e-4a87-8316-6da8d0aabfe4 admin admin] PATH_INFO: `/v3/users/0907af6794a84571840e855dc7150ba2` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:37.624941 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b35652-786e-4a87-8316-6da8d0aabfe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0907af6794a84571840e855dc7150ba2)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:37.626942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b35652-786e-4a87-8316-6da8d0aabfe4 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:37.687696 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:37.706150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-93b35652-786e-4a87-8316-6da8d0aabfe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0907af6794a84571840e855dc7150ba2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:37.719778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-93b35652-786e-4a87-8316-6da8d0aabfe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0907af6794a84571840e855dc7150ba2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:37.720863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-93b35652-786e-4a87-8316-6da8d0aabfe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0907af6794a84571840e855dc7150ba2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:37.732582 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-93b35652-786e-4a87-8316-6da8d0aabfe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0907af6794a84571840e855dc7150ba2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:37.750855 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-93b35652-786e-4a87-8316-6da8d0aabfe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0907af6794a84571840e855dc7150ba2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:37.761440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1172/2329] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:59:37 2022] DELETE /identity/v3/users/0907af6794a84571840e855dc7150ba2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:59:38.191565 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:38.193385 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:38.219781 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4427d8e-5a2b-4fe1-be85-4610a4cc4dbf admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:38.261123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b35652-786e-4a87-8316-6da8d0aabfe4 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:38.265136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-93b35652-786e-4a87-8316-6da8d0aabfe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:38.302993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a664f5-119d-462f-9487-88995a675ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:38.304077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a664f5-119d-462f-9487-88995a675ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:38.304370 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a664f5-119d-462f-9487-88995a675ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:38.304633 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a664f5-119d-462f-9487-88995a675ee5 admin admin] PATH_INFO: `/v3/projects/c2f3a961f0d84281ab2a0adce42cfdab` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:38.306404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a664f5-119d-462f-9487-88995a675ee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2f3a961f0d84281ab2a0adce42cfdab)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:38.308958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a664f5-119d-462f-9487-88995a675ee5 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:38.374101 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c8a664f5-119d-462f-9487-88995a675ee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f3a961f0d84281ab2a0adce42cfdab', 'request_id': 'req-c8a664f5-119d-462f-9487-88995a675ee5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:38.377747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b35652-786e-4a87-8316-6da8d0aabfe4 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:38.381230 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c8a664f5-119d-462f-9487-88995a675ee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f3a961f0d84281ab2a0adce42cfdab', 'request_id': 'req-c8a664f5-119d-462f-9487-88995a675ee5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:38.390745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c8a664f5-119d-462f-9487-88995a675ee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f3a961f0d84281ab2a0adce42cfdab', 'request_id': 'req-c8a664f5-119d-462f-9487-88995a675ee5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:38.404028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c8a664f5-119d-462f-9487-88995a675ee5 admin admin] The token cache is being invalidate because project c2f3a961f0d84281ab2a0adce42cfdab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:59:38.404704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c8a664f5-119d-462f-9487-88995a675ee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:38.405465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c8a664f5-119d-462f-9487-88995a675ee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:38.409081 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1158/2330] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:59:38 2022] DELETE /identity/v3/projects/c2f3a961f0d84281ab2a0adce42cfdab => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:38.450002 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286bed1-d09f-4f51-981f-af7e20dfb118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:38.450665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286bed1-d09f-4f51-981f-af7e20dfb118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:38.450954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286bed1-d09f-4f51-981f-af7e20dfb118 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:38.451233 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286bed1-d09f-4f51-981f-af7e20dfb118 admin admin] PATH_INFO: `/v3/projects/78aed102737b4265ba73d6b3335f91eb` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:38.452433 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286bed1-d09f-4f51-981f-af7e20dfb118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78aed102737b4265ba73d6b3335f91eb)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:38.454457 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286bed1-d09f-4f51-981f-af7e20dfb118 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:38.513345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e286bed1-d09f-4f51-981f-af7e20dfb118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78aed102737b4265ba73d6b3335f91eb', 'request_id': 'req-e286bed1-d09f-4f51-981f-af7e20dfb118'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:38.521226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e286bed1-d09f-4f51-981f-af7e20dfb118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78aed102737b4265ba73d6b3335f91eb', 'request_id': 'req-e286bed1-d09f-4f51-981f-af7e20dfb118'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:38.530151 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e286bed1-d09f-4f51-981f-af7e20dfb118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78aed102737b4265ba73d6b3335f91eb', 'request_id': 'req-e286bed1-d09f-4f51-981f-af7e20dfb118'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:38.532593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:38.547326 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e286bed1-d09f-4f51-981f-af7e20dfb118 admin admin] The token cache is being invalidate because project 78aed102737b4265ba73d6b3335f91eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:59:38.547700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e286bed1-d09f-4f51-981f-af7e20dfb118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:38.548375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e286bed1-d09f-4f51-981f-af7e20dfb118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:38.550405 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1173/2331] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:59:38 2022] DELETE /identity/v3/projects/78aed102737b4265ba73d6b3335f91eb => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:38.554415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a664f5-119d-462f-9487-88995a675ee5 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:38.557128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c8a664f5-119d-462f-9487-88995a675ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:38.579196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a664f5-119d-462f-9487-88995a675ee5 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:38.661476 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad86ce-994a-4dde-ac82-545c35fa0990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:38.662429 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad86ce-994a-4dde-ac82-545c35fa0990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:38.662873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad86ce-994a-4dde-ac82-545c35fa0990 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:38.663306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad86ce-994a-4dde-ac82-545c35fa0990 admin admin] PATH_INFO: `/v3/users/8cd057d2c20e48d2b708f755f835749c` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:38.664803 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad86ce-994a-4dde-ac82-545c35fa0990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cd057d2c20e48d2b708f755f835749c)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:38.667218 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad86ce-994a-4dde-ac82-545c35fa0990 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:38.701068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:38.722770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-acad86ce-994a-4dde-ac82-545c35fa0990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cd057d2c20e48d2b708f755f835749c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:38.732267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-acad86ce-994a-4dde-ac82-545c35fa0990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cd057d2c20e48d2b708f755f835749c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:38.733073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-acad86ce-994a-4dde-ac82-545c35fa0990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cd057d2c20e48d2b708f755f835749c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:38.733847 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-acad86ce-994a-4dde-ac82-545c35fa0990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cd057d2c20e48d2b708f755f835749c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:38.741585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-acad86ce-994a-4dde-ac82-545c35fa0990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cd057d2c20e48d2b708f755f835749c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:38.765657 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1159/2332] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:59:38 2022] DELETE /identity/v3/users/8cd057d2c20e48d2b708f755f835749c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:39.115013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286bed1-d09f-4f51-981f-af7e20dfb118 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:39.117958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e286bed1-d09f-4f51-981f-af7e20dfb118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:39.133945 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286bed1-d09f-4f51-981f-af7e20dfb118 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:39.207993 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96f9c0-2bd1-4f4a-9377-0dddd6e15a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:39.208665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96f9c0-2bd1-4f4a-9377-0dddd6e15a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:39.208951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96f9c0-2bd1-4f4a-9377-0dddd6e15a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:39.209261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96f9c0-2bd1-4f4a-9377-0dddd6e15a6f admin admin] PATH_INFO: `/v3/projects/5c750d71d07b4001ae5277d7eeee8c86` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:39.210429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96f9c0-2bd1-4f4a-9377-0dddd6e15a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c750d71d07b4001ae5277d7eeee8c86)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:39.212356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96f9c0-2bd1-4f4a-9377-0dddd6e15a6f admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:39.264360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6d96f9c0-2bd1-4f4a-9377-0dddd6e15a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c750d71d07b4001ae5277d7eeee8c86', 'request_id': 'req-6d96f9c0-2bd1-4f4a-9377-0dddd6e15a6f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:39.270576 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6d96f9c0-2bd1-4f4a-9377-0dddd6e15a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c750d71d07b4001ae5277d7eeee8c86', 'request_id': 'req-6d96f9c0-2bd1-4f4a-9377-0dddd6e15a6f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:39.278741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6d96f9c0-2bd1-4f4a-9377-0dddd6e15a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c750d71d07b4001ae5277d7eeee8c86', 'request_id': 'req-6d96f9c0-2bd1-4f4a-9377-0dddd6e15a6f'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:39.291349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6d96f9c0-2bd1-4f4a-9377-0dddd6e15a6f admin admin] The token cache is being invalidate because project 5c750d71d07b4001ae5277d7eeee8c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:59:39.291766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6d96f9c0-2bd1-4f4a-9377-0dddd6e15a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:39.292576 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6d96f9c0-2bd1-4f4a-9377-0dddd6e15a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:39.294258 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1174/2333] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:59:39 2022] DELETE /identity/v3/projects/5c750d71d07b4001ae5277d7eeee8c86 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:39.299425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87009e3d-e511-4c87-bf65-4b12292b4a8b None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:39.300019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87009e3d-e511-4c87-bf65-4b12292b4a8b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:39.300390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87009e3d-e511-4c87-bf65-4b12292b4a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:39.325075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-87009e3d-e511-4c87-bf65-4b12292b4a8b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:39.326329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-87009e3d-e511-4c87-bf65-4b12292b4a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:39.397059 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1160/2334] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:39.406045 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22bf9d-a493-432d-aa8f-addaf8c43e57 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:39.406335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22bf9d-a493-432d-aa8f-addaf8c43e57 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:39.406611 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22bf9d-a493-432d-aa8f-addaf8c43e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:39.428530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-cf22bf9d-a493-432d-aa8f-addaf8c43e57 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:39.429711 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-cf22bf9d-a493-432d-aa8f-addaf8c43e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:39.438429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1175/2335] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:39.442629 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87009e3d-e511-4c87-bf65-4b12292b4a8b None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:39.452220 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87009e3d-e511-4c87-bf65-4b12292b4a8b None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:39.456776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e2dc3-eb79-40f5-b891-bd27c5794e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:39.457412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e2dc3-eb79-40f5-b891-bd27c5794e11 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:39.457706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e2dc3-eb79-40f5-b891-bd27c5794e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:39.457959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e2dc3-eb79-40f5-b891-bd27c5794e11 admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:39.458599 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e2dc3-eb79-40f5-b891-bd27c5794e11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:59:39.458899 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e2dc3-eb79-40f5-b891-bd27c5794e11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:39.460498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e2dc3-eb79-40f5-b891-bd27c5794e11 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:39.472581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1161/2336] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:59:39.476970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22bf9d-a493-432d-aa8f-addaf8c43e57 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:39.487003 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22bf9d-a493-432d-aa8f-addaf8c43e57 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:39.491861 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472865d-76de-4528-8a25-08d5e79363ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:39.492459 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472865d-76de-4528-8a25-08d5e79363ff admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:39.492766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472865d-76de-4528-8a25-08d5e79363ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:39.493082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472865d-76de-4528-8a25-08d5e79363ff admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:39.493834 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472865d-76de-4528-8a25-08d5e79363ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:39.495990 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472865d-76de-4528-8a25-08d5e79363ff admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:39.523132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1176/2337] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:59:39 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:59:39.527891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e2dc3-eb79-40f5-b891-bd27c5794e11 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:39.538074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e2dc3-eb79-40f5-b891-bd27c5794e11 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:39.596279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729038d1-ee22-4453-95f6-9c8e2e9dfd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:39.596910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729038d1-ee22-4453-95f6-9c8e2e9dfd90 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:39.597227 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729038d1-ee22-4453-95f6-9c8e2e9dfd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:39.597498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729038d1-ee22-4453-95f6-9c8e2e9dfd90 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:39.598141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729038d1-ee22-4453-95f6-9c8e2e9dfd90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:39.600159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729038d1-ee22-4453-95f6-9c8e2e9dfd90 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:39.620743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1162/2338] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:59:39 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:59:39.624961 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472865d-76de-4528-8a25-08d5e79363ff admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:39.635216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472865d-76de-4528-8a25-08d5e79363ff admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:39.639840 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7625ee4-3730-4898-91b6-c7a8c52dd5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:39.640431 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7625ee4-3730-4898-91b6-c7a8c52dd5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:39.640714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7625ee4-3730-4898-91b6-c7a8c52dd5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:39.640986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7625ee4-3730-4898-91b6-c7a8c52dd5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:39.641646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7625ee4-3730-4898-91b6-c7a8c52dd5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:39.643260 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7625ee4-3730-4898-91b6-c7a8c52dd5e8 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:39.654094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1177/2339] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:39.657852 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729038d1-ee22-4453-95f6-9c8e2e9dfd90 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:39.668626 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729038d1-ee22-4453-95f6-9c8e2e9dfd90 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:39.673382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f19133-b710-4201-924f-b285326319b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:39.673983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f19133-b710-4201-924f-b285326319b2 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:39.674270 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f19133-b710-4201-924f-b285326319b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:39.674548 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f19133-b710-4201-924f-b285326319b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:39.675193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f19133-b710-4201-924f-b285326319b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:39.676794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f19133-b710-4201-924f-b285326319b2 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:39.688531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1163/2340] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:59:39.692958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7625ee4-3730-4898-91b6-c7a8c52dd5e8 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:39.703106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7625ee4-3730-4898-91b6-c7a8c52dd5e8 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:39.707875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754187c-ec70-4d38-aa03-adf5fb0f2d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:39.708519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754187c-ec70-4d38-aa03-adf5fb0f2d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:39.708805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754187c-ec70-4d38-aa03-adf5fb0f2d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:39.709116 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754187c-ec70-4d38-aa03-adf5fb0f2d3d admin admin] PATH_INFO: `/v3/projects/ae9148ea2c0146949e241cb1e2c6cbca/users/40825ffd801c437b8a1e2752d1d1ae90/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:39.724719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754187c-ec70-4d38-aa03-adf5fb0f2d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9148ea2c0146949e241cb1e2c6cbca, user_id=40825ffd801c437b8a1e2752d1d1ae90, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:39.727402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754187c-ec70-4d38-aa03-adf5fb0f2d3d admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:39.746572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1178/2341] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:59:39 2022] PUT /identity/v3/projects/ae9148ea2c0146949e241cb1e2c6cbca/users/40825ffd801c437b8a1e2752d1d1ae90/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:39.756848 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b7a18-0edf-4d72-906c-411d9f64e780 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:39.757185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b7a18-0edf-4d72-906c-411d9f64e780 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:39.757463 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b7a18-0edf-4d72-906c-411d9f64e780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:39.778408 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:39.786971 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-5b2b7a18-0edf-4d72-906c-411d9f64e780 None None] MFA Rules not processed for user `40825ffd801c437b8a1e2752d1d1ae90`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:39.788873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5b2b7a18-0edf-4d72-906c-411d9f64e780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:39.861475 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1164/2342] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:39.865950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754187c-ec70-4d38-aa03-adf5fb0f2d3d admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:39.891270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:39.938174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754187c-ec70-4d38-aa03-adf5fb0f2d3d admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:39.943153 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed091c9-4052-4559-a3dd-79ed703ec47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:39.943675 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed091c9-4052-4559-a3dd-79ed703ec47a admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:39.943960 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed091c9-4052-4559-a3dd-79ed703ec47a admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:39.944237 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed091c9-4052-4559-a3dd-79ed703ec47a admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:39.944854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed091c9-4052-4559-a3dd-79ed703ec47a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:39.947033 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed091c9-4052-4559-a3dd-79ed703ec47a admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:39.975973 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1179/2343] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:59:39 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:59:39.980098 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b7a18-0edf-4d72-906c-411d9f64e780 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:39.991057 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b7a18-0edf-4d72-906c-411d9f64e780 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:40.054640 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e005928-6302-4838-adea-4240ad59bc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:40.055298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e005928-6302-4838-adea-4240ad59bc3a admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:40.055639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e005928-6302-4838-adea-4240ad59bc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:40.055917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e005928-6302-4838-adea-4240ad59bc3a admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:40.056557 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e005928-6302-4838-adea-4240ad59bc3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:40.058565 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e005928-6302-4838-adea-4240ad59bc3a admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:40.080784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1165/2344] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:59:39 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:59:40.084838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed091c9-4052-4559-a3dd-79ed703ec47a admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:40.096068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed091c9-4052-4559-a3dd-79ed703ec47a admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:40.101482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bf513-543f-49af-a3ec-41f513b6c21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:40.102288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bf513-543f-49af-a3ec-41f513b6c21d admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:40.102702 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bf513-543f-49af-a3ec-41f513b6c21d admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:40.103021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bf513-543f-49af-a3ec-41f513b6c21d admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:40.103941 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bf513-543f-49af-a3ec-41f513b6c21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:40.105648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bf513-543f-49af-a3ec-41f513b6c21d admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:40.116482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1180/2345] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:40.121101 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e005928-6302-4838-adea-4240ad59bc3a admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:40.131044 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e005928-6302-4838-adea-4240ad59bc3a admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:40.135936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b3502-f98f-46e0-99dd-60bff0dcef4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:40.137299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b3502-f98f-46e0-99dd-60bff0dcef4f admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:40.137712 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b3502-f98f-46e0-99dd-60bff0dcef4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:40.138139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b3502-f98f-46e0-99dd-60bff0dcef4f admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:40.139126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b3502-f98f-46e0-99dd-60bff0dcef4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:40.141695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b3502-f98f-46e0-99dd-60bff0dcef4f admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:40.152782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1166/2346] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:40.156904 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bf513-543f-49af-a3ec-41f513b6c21d admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:40.166804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bf513-543f-49af-a3ec-41f513b6c21d admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:40.172489 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c293d-d1c7-41c3-81e6-3f3909a7ebb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:40.173507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c293d-d1c7-41c3-81e6-3f3909a7ebb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:40.173944 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c293d-d1c7-41c3-81e6-3f3909a7ebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:40.174327 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c293d-d1c7-41c3-81e6-3f3909a7ebb1 admin admin] PATH_INFO: `/v3/projects/cee39eaf4a4145d6b7360cc3089364ed/users/840fb36be6f3414eb90fde096b7287b7/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:40.190036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c293d-d1c7-41c3-81e6-3f3909a7ebb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee39eaf4a4145d6b7360cc3089364ed, user_id=840fb36be6f3414eb90fde096b7287b7, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:40.192740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c293d-d1c7-41c3-81e6-3f3909a7ebb1 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:40.208885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1181/2347] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:59:40 2022] PUT /identity/v3/projects/cee39eaf4a4145d6b7360cc3089364ed/users/840fb36be6f3414eb90fde096b7287b7/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:59:40.221350 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15050c1b-60c6-4fe3-b757-bd680e49f6b2 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:40.221646 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15050c1b-60c6-4fe3-b757-bd680e49f6b2 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:40.221927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15050c1b-60c6-4fe3-b757-bd680e49f6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:40.251617 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-15050c1b-60c6-4fe3-b757-bd680e49f6b2 None None] MFA Rules not processed for user `840fb36be6f3414eb90fde096b7287b7`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:40.252842 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-15050c1b-60c6-4fe3-b757-bd680e49f6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:40.319228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1167/2348] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:40.323966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c293d-d1c7-41c3-81e6-3f3909a7ebb1 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:40.387000 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c293d-d1c7-41c3-81e6-3f3909a7ebb1 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:40.391791 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68afdc-955d-4a2d-b78f-0fc4ff40ffee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:40.392388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68afdc-955d-4a2d-b78f-0fc4ff40ffee admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:40.392687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68afdc-955d-4a2d-b78f-0fc4ff40ffee admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:40.392949 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68afdc-955d-4a2d-b78f-0fc4ff40ffee admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:40.393600 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68afdc-955d-4a2d-b78f-0fc4ff40ffee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:40.395492 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68afdc-955d-4a2d-b78f-0fc4ff40ffee admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:40.422523 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1182/2349] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:59:40 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:59:40.426640 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15050c1b-60c6-4fe3-b757-bd680e49f6b2 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:40.438090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15050c1b-60c6-4fe3-b757-bd680e49f6b2 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:40.442604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:40.499038 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a2c95-77f1-433e-bb8c-4fa53e572fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:40.499557 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a2c95-77f1-433e-bb8c-4fa53e572fcb admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:40.499834 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a2c95-77f1-433e-bb8c-4fa53e572fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:40.500104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a2c95-77f1-433e-bb8c-4fa53e572fcb admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:40.500722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a2c95-77f1-433e-bb8c-4fa53e572fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:40.502654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a2c95-77f1-433e-bb8c-4fa53e572fcb admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:40.524508 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1168/2350] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:59:40 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:59:40.529320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68afdc-955d-4a2d-b78f-0fc4ff40ffee admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:40.540342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68afdc-955d-4a2d-b78f-0fc4ff40ffee admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:40.545531 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a83822-3eef-41be-b293-f0cb65dbe8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:40.546121 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a83822-3eef-41be-b293-f0cb65dbe8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:40.546401 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a83822-3eef-41be-b293-f0cb65dbe8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:40.546672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a83822-3eef-41be-b293-f0cb65dbe8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:40.547301 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a83822-3eef-41be-b293-f0cb65dbe8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:40.548873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a83822-3eef-41be-b293-f0cb65dbe8a9 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:40.561070 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1183/2351] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:40.565322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a2c95-77f1-433e-bb8c-4fa53e572fcb admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:40.575393 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a2c95-77f1-433e-bb8c-4fa53e572fcb admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:40.580052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9649109-c7bf-45a7-a37e-ae638d34c540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:40.580704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9649109-c7bf-45a7-a37e-ae638d34c540 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:40.580986 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9649109-c7bf-45a7-a37e-ae638d34c540 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:40.581297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9649109-c7bf-45a7-a37e-ae638d34c540 admin admin] PATH_INFO: `/v3/projects/a474774cdca44e84a89ab01be3d0211f/users/36587fe93b324525ad9e581b9c7f0231/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:40.597101 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9649109-c7bf-45a7-a37e-ae638d34c540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a474774cdca44e84a89ab01be3d0211f, user_id=36587fe93b324525ad9e581b9c7f0231, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:40.599765 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9649109-c7bf-45a7-a37e-ae638d34c540 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:40.613823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1169/2352] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:59:40 2022] PUT /identity/v3/projects/a474774cdca44e84a89ab01be3d0211f/users/36587fe93b324525ad9e581b9c7f0231/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:40.618112 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a83822-3eef-41be-b293-f0cb65dbe8a9 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:40.628123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a83822-3eef-41be-b293-f0cb65dbe8a9 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:40.667854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:40.687218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4fff3-bb51-4a73-b25c-56085837eeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:40.687846 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4fff3-bb51-4a73-b25c-56085837eeca admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:40.688126 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4fff3-bb51-4a73-b25c-56085837eeca admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:40.688399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4fff3-bb51-4a73-b25c-56085837eeca admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:40.689071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4fff3-bb51-4a73-b25c-56085837eeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:40.690666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4fff3-bb51-4a73-b25c-56085837eeca admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:40.703033 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1184/2353] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:40.707062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9649109-c7bf-45a7-a37e-ae638d34c540 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:40.718689 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9649109-c7bf-45a7-a37e-ae638d34c540 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:40.723439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20735333-5806-4345-80e1-62589d122808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:40.724109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20735333-5806-4345-80e1-62589d122808 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:40.724402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20735333-5806-4345-80e1-62589d122808 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:40.724681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20735333-5806-4345-80e1-62589d122808 admin admin] PATH_INFO: `/v3/projects/a474774cdca44e84a89ab01be3d0211f/users/36587fe93b324525ad9e581b9c7f0231/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:40.726868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20735333-5806-4345-80e1-62589d122808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a474774cdca44e84a89ab01be3d0211f, user_id=36587fe93b324525ad9e581b9c7f0231, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:40.729569 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20735333-5806-4345-80e1-62589d122808 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:40.740544 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1170/2354] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:59:40 2022] PUT /identity/v3/projects/a474774cdca44e84a89ab01be3d0211f/users/36587fe93b324525ad9e581b9c7f0231/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:59:40.751769 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e3c02-73ea-4b7f-a6f9-463f0543d9cc None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:40.751984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e3c02-73ea-4b7f-a6f9-463f0543d9cc None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:40.752256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e3c02-73ea-4b7f-a6f9-463f0543d9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:40.781865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-cf3e3c02-73ea-4b7f-a6f9-463f0543d9cc None None] MFA Rules not processed for user `36587fe93b324525ad9e581b9c7f0231`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:40.783079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-cf3e3c02-73ea-4b7f-a6f9-463f0543d9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:40.851974 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1185/2355] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:40.863272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20735333-5806-4345-80e1-62589d122808 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:40.865294 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-20735333-5806-4345-80e1-62589d122808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:40.927613 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20735333-5806-4345-80e1-62589d122808 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:40.931152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86550e89-ec60-427a-8a21-8f5bd2907e05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:40.931757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86550e89-ec60-427a-8a21-8f5bd2907e05 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:40.932035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86550e89-ec60-427a-8a21-8f5bd2907e05 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:40.932309 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86550e89-ec60-427a-8a21-8f5bd2907e05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:40.990043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86550e89-ec60-427a-8a21-8f5bd2907e05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:40.991480 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86550e89-ec60-427a-8a21-8f5bd2907e05 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:41.001301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1171/2356] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:42.534923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e3c02-73ea-4b7f-a6f9-463f0543d9cc None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:42.536343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-cf3e3c02-73ea-4b7f-a6f9-463f0543d9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:42.548646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e3c02-73ea-4b7f-a6f9-463f0543d9cc None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:42.552373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742178b-8db3-433a-ae83-c44148cadb8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:42.552977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742178b-8db3-433a-ae83-c44148cadb8b service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:42.553293 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742178b-8db3-433a-ae83-c44148cadb8b service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:42.553572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742178b-8db3-433a-ae83-c44148cadb8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:42.623579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742178b-8db3-433a-ae83-c44148cadb8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:42.625211 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742178b-8db3-433a-ae83-c44148cadb8b service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:42.634361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1186/2357] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:43.315974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86550e89-ec60-427a-8a21-8f5bd2907e05 service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:43.325968 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86550e89-ec60-427a-8a21-8f5bd2907e05 service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:43.334376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13152b3-5aaa-4e7e-ae4b-c478cf486b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:43.335333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13152b3-5aaa-4e7e-ae4b-c478cf486b58 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:43.335792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13152b3-5aaa-4e7e-ae4b-c478cf486b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:43.336260 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13152b3-5aaa-4e7e-ae4b-c478cf486b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:43.351769 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13152b3-5aaa-4e7e-ae4b-c478cf486b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:43.354363 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13152b3-5aaa-4e7e-ae4b-c478cf486b58 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:43.371390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1172/2358] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:47.278073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742178b-8db3-433a-ae83-c44148cadb8b service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:47.350593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742178b-8db3-433a-ae83-c44148cadb8b service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:47.355797 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d54271-6966-47a2-9023-02eca4c3d556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:47.356426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d54271-6966-47a2-9023-02eca4c3d556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:47.356708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d54271-6966-47a2-9023-02eca4c3d556 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:47.356979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d54271-6966-47a2-9023-02eca4c3d556 admin admin] PATH_INFO: `/v3/users/40825ffd801c437b8a1e2752d1d1ae90` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:47.358130 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d54271-6966-47a2-9023-02eca4c3d556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40825ffd801c437b8a1e2752d1d1ae90)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:47.360090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d54271-6966-47a2-9023-02eca4c3d556 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:47.362692 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:47.413297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b6d54271-6966-47a2-9023-02eca4c3d556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40825ffd801c437b8a1e2752d1d1ae90'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:47.421620 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b6d54271-6966-47a2-9023-02eca4c3d556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40825ffd801c437b8a1e2752d1d1ae90'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:47.422270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b6d54271-6966-47a2-9023-02eca4c3d556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40825ffd801c437b8a1e2752d1d1ae90'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:47.430170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b6d54271-6966-47a2-9023-02eca4c3d556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40825ffd801c437b8a1e2752d1d1ae90'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:47.449132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b6d54271-6966-47a2-9023-02eca4c3d556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40825ffd801c437b8a1e2752d1d1ae90'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:47.455866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1187/2359] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:59:47 2022] DELETE /identity/v3/users/40825ffd801c437b8a1e2752d1d1ae90 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:47.460460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6592d7-1fcd-4d0e-adcb-72d836b23064 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:47.460968 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6592d7-1fcd-4d0e-adcb-72d836b23064 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:47.461147 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6592d7-1fcd-4d0e-adcb-72d836b23064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:47.469256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:47.491843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ef6592d7-1fcd-4d0e-adcb-72d836b23064 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:47.493080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ef6592d7-1fcd-4d0e-adcb-72d836b23064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:47.553588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1173/2360] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:47.563442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d54271-6966-47a2-9023-02eca4c3d556 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:47.564911 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b6d54271-6966-47a2-9023-02eca4c3d556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:47.631869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d54271-6966-47a2-9023-02eca4c3d556 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:47.637347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfad50-c7c9-4bf1-8c0c-476add27246c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:47.639281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfad50-c7c9-4bf1-8c0c-476add27246c service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:47.639281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfad50-c7c9-4bf1-8c0c-476add27246c service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:47.639281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfad50-c7c9-4bf1-8c0c-476add27246c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:47.649341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfad50-c7c9-4bf1-8c0c-476add27246c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:47.650797 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfad50-c7c9-4bf1-8c0c-476add27246c service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:47.661768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1188/2361] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:47.943495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6592d7-1fcd-4d0e-adcb-72d836b23064 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:47.946936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ef6592d7-1fcd-4d0e-adcb-72d836b23064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:47.962702 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6592d7-1fcd-4d0e-adcb-72d836b23064 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:47.970897 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95160b60-eaf7-410f-81d5-b986c9cccb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:47.971573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95160b60-eaf7-410f-81d5-b986c9cccb11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:47.971873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95160b60-eaf7-410f-81d5-b986c9cccb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:47.972156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95160b60-eaf7-410f-81d5-b986c9cccb11 admin admin] PATH_INFO: `/v3/projects/ae9148ea2c0146949e241cb1e2c6cbca` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:47.973374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95160b60-eaf7-410f-81d5-b986c9cccb11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9148ea2c0146949e241cb1e2c6cbca)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:47.975508 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95160b60-eaf7-410f-81d5-b986c9cccb11 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:48.028345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-95160b60-eaf7-410f-81d5-b986c9cccb11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9148ea2c0146949e241cb1e2c6cbca', 'request_id': 'req-95160b60-eaf7-410f-81d5-b986c9cccb11'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:48.034492 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-95160b60-eaf7-410f-81d5-b986c9cccb11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9148ea2c0146949e241cb1e2c6cbca', 'request_id': 'req-95160b60-eaf7-410f-81d5-b986c9cccb11'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:48.043684 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-95160b60-eaf7-410f-81d5-b986c9cccb11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9148ea2c0146949e241cb1e2c6cbca', 'request_id': 'req-95160b60-eaf7-410f-81d5-b986c9cccb11'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:48.054509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-95160b60-eaf7-410f-81d5-b986c9cccb11 admin admin] The token cache is being invalidate because project ae9148ea2c0146949e241cb1e2c6cbca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:59:48.054814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-95160b60-eaf7-410f-81d5-b986c9cccb11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:48.055453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-95160b60-eaf7-410f-81d5-b986c9cccb11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:48.056950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1174/2362] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:59:47 2022] DELETE /identity/v3/projects/ae9148ea2c0146949e241cb1e2c6cbca => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:48.061091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfad50-c7c9-4bf1-8c0c-476add27246c service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:48.072699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfad50-c7c9-4bf1-8c0c-476add27246c service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:48.139847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5d9ee-a5d0-4dbd-a23d-cfb7381ae4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:48.140486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5d9ee-a5d0-4dbd-a23d-cfb7381ae4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:48.140772 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5d9ee-a5d0-4dbd-a23d-cfb7381ae4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:48.141086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5d9ee-a5d0-4dbd-a23d-cfb7381ae4e8 admin admin] PATH_INFO: `/v3/users/840fb36be6f3414eb90fde096b7287b7` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:48.142217 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5d9ee-a5d0-4dbd-a23d-cfb7381ae4e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=840fb36be6f3414eb90fde096b7287b7)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:48.144168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5d9ee-a5d0-4dbd-a23d-cfb7381ae4e8 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:48.178362 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:48.201712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1ad5d9ee-a5d0-4dbd-a23d-cfb7381ae4e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840fb36be6f3414eb90fde096b7287b7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:48.210685 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1ad5d9ee-a5d0-4dbd-a23d-cfb7381ae4e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840fb36be6f3414eb90fde096b7287b7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:48.211339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1ad5d9ee-a5d0-4dbd-a23d-cfb7381ae4e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840fb36be6f3414eb90fde096b7287b7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:48.219807 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1ad5d9ee-a5d0-4dbd-a23d-cfb7381ae4e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840fb36be6f3414eb90fde096b7287b7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:48.232213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1ad5d9ee-a5d0-4dbd-a23d-cfb7381ae4e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840fb36be6f3414eb90fde096b7287b7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:48.238934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1189/2363] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:59:48 2022] DELETE /identity/v3/users/840fb36be6f3414eb90fde096b7287b7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:48.643413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95160b60-eaf7-410f-81d5-b986c9cccb11 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:48.645064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-95160b60-eaf7-410f-81d5-b986c9cccb11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:48.662461 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95160b60-eaf7-410f-81d5-b986c9cccb11 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:48.728611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad018517-b07c-4c39-a2bb-3dfcd217640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:48.729277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad018517-b07c-4c39-a2bb-3dfcd217640e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:48.729557 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad018517-b07c-4c39-a2bb-3dfcd217640e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:48.729858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad018517-b07c-4c39-a2bb-3dfcd217640e admin admin] PATH_INFO: `/v3/projects/cee39eaf4a4145d6b7360cc3089364ed` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:48.730980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad018517-b07c-4c39-a2bb-3dfcd217640e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee39eaf4a4145d6b7360cc3089364ed)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:48.732885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad018517-b07c-4c39-a2bb-3dfcd217640e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:48.779077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:48.799298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ad018517-b07c-4c39-a2bb-3dfcd217640e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee39eaf4a4145d6b7360cc3089364ed', 'request_id': 'req-ad018517-b07c-4c39-a2bb-3dfcd217640e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:48.807264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ad018517-b07c-4c39-a2bb-3dfcd217640e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee39eaf4a4145d6b7360cc3089364ed', 'request_id': 'req-ad018517-b07c-4c39-a2bb-3dfcd217640e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:48.816511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ad018517-b07c-4c39-a2bb-3dfcd217640e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee39eaf4a4145d6b7360cc3089364ed', 'request_id': 'req-ad018517-b07c-4c39-a2bb-3dfcd217640e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:48.831363 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ad018517-b07c-4c39-a2bb-3dfcd217640e admin admin] The token cache is being invalidate because project cee39eaf4a4145d6b7360cc3089364ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:59:48.831908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ad018517-b07c-4c39-a2bb-3dfcd217640e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:48.832652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ad018517-b07c-4c39-a2bb-3dfcd217640e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:48.834460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1175/2364] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:59:48 2022] DELETE /identity/v3/projects/cee39eaf4a4145d6b7360cc3089364ed => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:59:48.839170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5d9ee-a5d0-4dbd-a23d-cfb7381ae4e8 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:48.841463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1ad5d9ee-a5d0-4dbd-a23d-cfb7381ae4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:48.865520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5d9ee-a5d0-4dbd-a23d-cfb7381ae4e8 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:48.975646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c41a6-0c5a-4351-b8ea-dd39789df0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:48.977681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c41a6-0c5a-4351-b8ea-dd39789df0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:48.978201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c41a6-0c5a-4351-b8ea-dd39789df0be admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:48.978850 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c41a6-0c5a-4351-b8ea-dd39789df0be admin admin] PATH_INFO: `/v3/users/36587fe93b324525ad9e581b9c7f0231` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:48.983607 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c41a6-0c5a-4351-b8ea-dd39789df0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=36587fe93b324525ad9e581b9c7f0231)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:48.988332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c41a6-0c5a-4351-b8ea-dd39789df0be admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:49.053890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-988c41a6-0c5a-4351-b8ea-dd39789df0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36587fe93b324525ad9e581b9c7f0231'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:49.062834 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-988c41a6-0c5a-4351-b8ea-dd39789df0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36587fe93b324525ad9e581b9c7f0231'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:49.063521 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-988c41a6-0c5a-4351-b8ea-dd39789df0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36587fe93b324525ad9e581b9c7f0231'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:49.071291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-988c41a6-0c5a-4351-b8ea-dd39789df0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36587fe93b324525ad9e581b9c7f0231'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:49.086372 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-988c41a6-0c5a-4351-b8ea-dd39789df0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36587fe93b324525ad9e581b9c7f0231'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:49.098099 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1190/2365] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 08:59:48 2022] DELETE /identity/v3/users/36587fe93b324525ad9e581b9c7f0231 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:59:49.399872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad018517-b07c-4c39-a2bb-3dfcd217640e admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:49.402390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ad018517-b07c-4c39-a2bb-3dfcd217640e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:49.494664 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad018517-b07c-4c39-a2bb-3dfcd217640e admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:49.553225 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd637de-eca4-40c5-800f-b692b34521e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:49.553862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd637de-eca4-40c5-800f-b692b34521e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:49.554140 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd637de-eca4-40c5-800f-b692b34521e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:49.554414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd637de-eca4-40c5-800f-b692b34521e1 admin admin] PATH_INFO: `/v3/projects/a474774cdca44e84a89ab01be3d0211f` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:49.555536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd637de-eca4-40c5-800f-b692b34521e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a474774cdca44e84a89ab01be3d0211f)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:49.557499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd637de-eca4-40c5-800f-b692b34521e1 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:49.613467 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8cd637de-eca4-40c5-800f-b692b34521e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a474774cdca44e84a89ab01be3d0211f', 'request_id': 'req-8cd637de-eca4-40c5-800f-b692b34521e1'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:49.619745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8cd637de-eca4-40c5-800f-b692b34521e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a474774cdca44e84a89ab01be3d0211f', 'request_id': 'req-8cd637de-eca4-40c5-800f-b692b34521e1'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:49.622394 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:49.629273 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8cd637de-eca4-40c5-800f-b692b34521e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a474774cdca44e84a89ab01be3d0211f', 'request_id': 'req-8cd637de-eca4-40c5-800f-b692b34521e1'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:49.641679 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8cd637de-eca4-40c5-800f-b692b34521e1 admin admin] The token cache is being invalidate because project a474774cdca44e84a89ab01be3d0211f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:59:49.642036 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8cd637de-eca4-40c5-800f-b692b34521e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:49.642643 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8cd637de-eca4-40c5-800f-b692b34521e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:59:49.644193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1176/2366] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 08:59:49 2022] DELETE /identity/v3/projects/a474774cdca44e84a89ab01be3d0211f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:49.649145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b0fd8-6083-4778-96f9-22900b70243a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:49.649475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b0fd8-6083-4778-96f9-22900b70243a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:49.649760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b0fd8-6083-4778-96f9-22900b70243a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:49.680516 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:49.715253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-748b0fd8-6083-4778-96f9-22900b70243a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:49.716728 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-748b0fd8-6083-4778-96f9-22900b70243a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:49.780337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1191/2367] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:49.788292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f1721-f793-445f-86fd-9dc560320a99 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:49.788793 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f1721-f793-445f-86fd-9dc560320a99 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:49.789153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f1721-f793-445f-86fd-9dc560320a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:49.810806 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-506f1721-f793-445f-86fd-9dc560320a99 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:49.812041 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-506f1721-f793-445f-86fd-9dc560320a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:49.820495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1177/2368] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:49.824674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b0fd8-6083-4778-96f9-22900b70243a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:49.834546 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b0fd8-6083-4778-96f9-22900b70243a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:49.839205 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5153cb-1833-48bc-bcf5-8ddbca234c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:49.839813 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5153cb-1833-48bc-bcf5-8ddbca234c14 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:49.840082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5153cb-1833-48bc-bcf5-8ddbca234c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:49.840363 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5153cb-1833-48bc-bcf5-8ddbca234c14 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:49.841030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5153cb-1833-48bc-bcf5-8ddbca234c14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:59:49.841348 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5153cb-1833-48bc-bcf5-8ddbca234c14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:49.842969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5153cb-1833-48bc-bcf5-8ddbca234c14 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:49.855941 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1192/2369] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 08:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:59:49.860443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f1721-f793-445f-86fd-9dc560320a99 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:49.871095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f1721-f793-445f-86fd-9dc560320a99 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:49.875967 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a706b5-96bb-4859-a07f-da06ecaf4b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:49.876624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a706b5-96bb-4859-a07f-da06ecaf4b18 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:49.876892 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a706b5-96bb-4859-a07f-da06ecaf4b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:49.877210 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a706b5-96bb-4859-a07f-da06ecaf4b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:49.877855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a706b5-96bb-4859-a07f-da06ecaf4b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:49.879741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a706b5-96bb-4859-a07f-da06ecaf4b18 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:49.907389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1178/2370] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 08:59:49 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:59:49.911549 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5153cb-1833-48bc-bcf5-8ddbca234c14 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:49.922266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5153cb-1833-48bc-bcf5-8ddbca234c14 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:49.984585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81afec-b46c-4aec-bf51-4875bc65535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:49.985222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81afec-b46c-4aec-bf51-4875bc65535b admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:49.985503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81afec-b46c-4aec-bf51-4875bc65535b admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:49.985773 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81afec-b46c-4aec-bf51-4875bc65535b admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:49.986399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81afec-b46c-4aec-bf51-4875bc65535b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:49.988330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81afec-b46c-4aec-bf51-4875bc65535b admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:50.010824 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1193/2371] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 08:59:49 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:59:50.014926 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a706b5-96bb-4859-a07f-da06ecaf4b18 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:50.025185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a706b5-96bb-4859-a07f-da06ecaf4b18 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:50.030356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8eaa96-2599-4d9b-a48b-d21d0f6b7116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:50.030951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8eaa96-2599-4d9b-a48b-d21d0f6b7116 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:50.031234 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8eaa96-2599-4d9b-a48b-d21d0f6b7116 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:50.031509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8eaa96-2599-4d9b-a48b-d21d0f6b7116 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:50.032155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8eaa96-2599-4d9b-a48b-d21d0f6b7116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:50.033783 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8eaa96-2599-4d9b-a48b-d21d0f6b7116 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:50.044403 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1179/2372] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:50.048456 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81afec-b46c-4aec-bf51-4875bc65535b admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:50.058596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81afec-b46c-4aec-bf51-4875bc65535b admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:50.063256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e164db2-10f1-4bb0-8213-6f6d529dcd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:50.063848 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e164db2-10f1-4bb0-8213-6f6d529dcd45 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:50.064129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e164db2-10f1-4bb0-8213-6f6d529dcd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:50.064400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e164db2-10f1-4bb0-8213-6f6d529dcd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:50.065077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e164db2-10f1-4bb0-8213-6f6d529dcd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:50.066655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e164db2-10f1-4bb0-8213-6f6d529dcd45 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:50.077320 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1194/2373] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 08:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:59:50.081533 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8eaa96-2599-4d9b-a48b-d21d0f6b7116 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:50.091993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8eaa96-2599-4d9b-a48b-d21d0f6b7116 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:50.097817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519bc5a-0a7a-4d3e-8b93-2fc62e0cb13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:50.098462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519bc5a-0a7a-4d3e-8b93-2fc62e0cb13e admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:50.098743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519bc5a-0a7a-4d3e-8b93-2fc62e0cb13e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:50.099018 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519bc5a-0a7a-4d3e-8b93-2fc62e0cb13e admin admin] PATH_INFO: `/v3/projects/fe5e6a7328b54b58997b148bc7cd36bc/users/18ab7a5d851e45c9a437b55cd58e35e4/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:50.115832 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519bc5a-0a7a-4d3e-8b93-2fc62e0cb13e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5e6a7328b54b58997b148bc7cd36bc, user_id=18ab7a5d851e45c9a437b55cd58e35e4, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:50.118558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519bc5a-0a7a-4d3e-8b93-2fc62e0cb13e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:50.131598 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1180/2374] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 08:59:50 2022] PUT /identity/v3/projects/fe5e6a7328b54b58997b148bc7cd36bc/users/18ab7a5d851e45c9a437b55cd58e35e4/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:59:50.136766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e669d6-e65a-4324-ad1b-e2b940e530b3 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:50.137073 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e669d6-e65a-4324-ad1b-e2b940e530b3 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:50.137373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e669d6-e65a-4324-ad1b-e2b940e530b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:50.157564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-59e669d6-e65a-4324-ad1b-e2b940e530b3 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:50.158688 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-59e669d6-e65a-4324-ad1b-e2b940e530b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:50.207507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:50.218590 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1195/2375] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:50.228302 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519bc5a-0a7a-4d3e-8b93-2fc62e0cb13e admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:50.230599 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-6519bc5a-0a7a-4d3e-8b93-2fc62e0cb13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:50.302694 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519bc5a-0a7a-4d3e-8b93-2fc62e0cb13e admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:50.306420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd581e4-515d-4285-a3fd-9aff982435bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:50.307028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd581e4-515d-4285-a3fd-9aff982435bb service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:50.307315 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd581e4-515d-4285-a3fd-9aff982435bb service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:50.307594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd581e4-515d-4285-a3fd-9aff982435bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:50.316797 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd581e4-515d-4285-a3fd-9aff982435bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:50.318257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd581e4-515d-4285-a3fd-9aff982435bb service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:50.327886 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1181/2376] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:51.056660 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d4cc3-5d52-4f8b-bb77-28815c11033d None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:51.057261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d4cc3-5d52-4f8b-bb77-28815c11033d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:51.057261 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d4cc3-5d52-4f8b-bb77-28815c11033d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:51.086581 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-282d4cc3-5d52-4f8b-bb77-28815c11033d None None] MFA Rules not processed for user `18ab7a5d851e45c9a437b55cd58e35e4`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:51.087821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-282d4cc3-5d52-4f8b-bb77-28815c11033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:51.157788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1196/2377] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:59:51.168461 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd581e4-515d-4285-a3fd-9aff982435bb service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:59:51.169877 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-9fd581e4-515d-4285-a3fd-9aff982435bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:51.227881 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd581e4-515d-4285-a3fd-9aff982435bb service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:59:51.231432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deecd4b-0856-48b8-97eb-2bf61c95c135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:59:51.232039 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deecd4b-0856-48b8-97eb-2bf61c95c135 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:51.232321 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deecd4b-0856-48b8-97eb-2bf61c95c135 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:51.232595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deecd4b-0856-48b8-97eb-2bf61c95c135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:51.240939 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deecd4b-0856-48b8-97eb-2bf61c95c135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:59:51.242427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deecd4b-0856-48b8-97eb-2bf61c95c135 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:59:51.251301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1182/2378] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 08:59:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:59:52.614818 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acd12f-3b0e-4933-8755-ea41d3d55e0e None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:59:52.615378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acd12f-3b0e-4933-8755-ea41d3d55e0e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:59:52.615378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acd12f-3b0e-4933-8755-ea41d3d55e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:59:52.635588 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-94acd12f-3b0e-4933-8755-ea41d3d55e0e None None] MFA Rules not processed for user `18ab7a5d851e45c9a437b55cd58e35e4`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:59:52.637354 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-94acd12f-3b0e-4933-8755-ea41d3d55e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:59:52.644954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1197/2379] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 08:59:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:00:01.247179 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:DELETE=3,keystone:SELECT=90,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:02.629597 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=36 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:03.115768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deecd4b-0856-48b8-97eb-2bf61c95c135 service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:03.117259 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-9deecd4b-0856-48b8-97eb-2bf61c95c135 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:00:03.216251 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deecd4b-0856-48b8-97eb-2bf61c95c135 service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:03.222110 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548236a-5abb-47a4-8d84-10c22566a07e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95abbd88e549427abbf5699efed0451a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:03.222674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548236a-5abb-47a4-8d84-10c22566a07e service placement] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:03.222957 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548236a-5abb-47a4-8d84-10c22566a07e service placement] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:03.223231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548236a-5abb-47a4-8d84-10c22566a07e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:03.225035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-4548236a-5abb-47a4-8d84-10c22566a07e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:00:03.239421 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548236a-5abb-47a4-8d84-10c22566a07e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:03.241034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548236a-5abb-47a4-8d84-10c22566a07e service placement] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:03.253236 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1183/2380] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:00:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:00:07.813557 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a8cd7-d584-48d7-8a9e-4a3763d5b013 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:07.814137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a8cd7-d584-48d7-8a9e-4a3763d5b013 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:07.814137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a8cd7-d584-48d7-8a9e-4a3763d5b013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:07.837788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-df9a8cd7-d584-48d7-8a9e-4a3763d5b013 None None] MFA Rules not processed for user `798c692df3b141849d5a4427b3cd1e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:00:07.839623 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-df9a8cd7-d584-48d7-8a9e-4a3763d5b013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:00:07.911503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1198/2381] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:00:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:00:11.879904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca482750-e46c-4f84-904a-d7f27465a9d7 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:11.880393 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca482750-e46c-4f84-904a-d7f27465a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:11.880490 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca482750-e46c-4f84-904a-d7f27465a9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:11.899452 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ca482750-e46c-4f84-904a-d7f27465a9d7 None None] MFA Rules not processed for user `18ab7a5d851e45c9a437b55cd58e35e4`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:00:11.900672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ca482750-e46c-4f84-904a-d7f27465a9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:00:11.908299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1184/2382] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:00:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:00:17.898594 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=25 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:21.894156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=44 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:33.631366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8895f4-986b-4ab2-a37b-574f84b28103 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:33.631840 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8895f4-986b-4ab2-a37b-574f84b28103 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:33.631945 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8895f4-986b-4ab2-a37b-574f84b28103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:33.662742 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-1d8895f4-986b-4ab2-a37b-574f84b28103 None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:00:33.663954 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1d8895f4-986b-4ab2-a37b-574f84b28103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:00:33.735219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1199/2383] 10.222.0.76 () {58 vars in 1009 bytes} [Fri Aug 26 09:00:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:00:33.782594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca482750-e46c-4f84-904a-d7f27465a9d7 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:33.784040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ca482750-e46c-4f84-904a-d7f27465a9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:00:33.861857 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca482750-e46c-4f84-904a-d7f27465a9d7 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:33.866913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb7bab-17a8-49df-83d1-985a4b2d0b10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:33.867528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb7bab-17a8-49df-83d1-985a4b2d0b10 service swift] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:33.867815 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb7bab-17a8-49df-83d1-985a4b2d0b10 service swift] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:33.868092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb7bab-17a8-49df-83d1-985a4b2d0b10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:33.876332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb7bab-17a8-49df-83d1-985a4b2d0b10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:33.877979 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb7bab-17a8-49df-83d1-985a4b2d0b10 service swift] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:33.886754 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1185/2384] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 09:00:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 09:00:43.729174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=32 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:43.882887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=32 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:49.209410 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183095fc-df51-4ea1-8776-c77c77325e45 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:49.209875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183095fc-df51-4ea1-8776-c77c77325e45 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:49.209975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183095fc-df51-4ea1-8776-c77c77325e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:49.230051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-183095fc-df51-4ea1-8776-c77c77325e45 None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:00:49.231844 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-183095fc-df51-4ea1-8776-c77c77325e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:00:49.239033 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1200/2385] 10.222.0.76 () {58 vars in 967 bytes} [Fri Aug 26 09:00:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:00:49.252212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb7bab-17a8-49df-83d1-985a4b2d0b10 service swift] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:49.266123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb7bab-17a8-49df-83d1-985a4b2d0b10 service swift] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:49.271245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2a2eb-41c5-411f-abe7-68e0e77b0df3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:49.271852 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2a2eb-41c5-411f-abe7-68e0e77b0df3 service swift] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:49.272136 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2a2eb-41c5-411f-abe7-68e0e77b0df3 service swift] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:49.272412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2a2eb-41c5-411f-abe7-68e0e77b0df3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:49.281837 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2a2eb-41c5-411f-abe7-68e0e77b0df3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:49.283426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2a2eb-41c5-411f-abe7-68e0e77b0df3 service swift] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:49.291952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1186/2386] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 09:00:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 09:00:51.300136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183095fc-df51-4ea1-8776-c77c77325e45 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:51.313165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183095fc-df51-4ea1-8776-c77c77325e45 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:51.317924 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068823d0-e84f-4787-a5b1-a817db9b442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:51.318599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068823d0-e84f-4787-a5b1-a817db9b442c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:51.318887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068823d0-e84f-4787-a5b1-a817db9b442c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:51.319167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068823d0-e84f-4787-a5b1-a817db9b442c admin admin] PATH_INFO: `/v3/users/18ab7a5d851e45c9a437b55cd58e35e4` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:51.320302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068823d0-e84f-4787-a5b1-a817db9b442c admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ab7a5d851e45c9a437b55cd58e35e4)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:51.322266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068823d0-e84f-4787-a5b1-a817db9b442c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:51.379245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-068823d0-e84f-4787-a5b1-a817db9b442c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ab7a5d851e45c9a437b55cd58e35e4'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:00:51.389695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-068823d0-e84f-4787-a5b1-a817db9b442c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ab7a5d851e45c9a437b55cd58e35e4'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:00:51.390525 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-068823d0-e84f-4787-a5b1-a817db9b442c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ab7a5d851e45c9a437b55cd58e35e4'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:00:51.400064 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-068823d0-e84f-4787-a5b1-a817db9b442c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ab7a5d851e45c9a437b55cd58e35e4'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:00:51.414260 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-068823d0-e84f-4787-a5b1-a817db9b442c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ab7a5d851e45c9a437b55cd58e35e4'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:00:51.420282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1201/2387] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:00:51 2022] DELETE /identity/v3/users/18ab7a5d851e45c9a437b55cd58e35e4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:00:51.633864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2a2eb-41c5-411f-abe7-68e0e77b0df3 service swift] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:51.646047 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2a2eb-41c5-411f-abe7-68e0e77b0df3 service swift] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:51.713536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacbba4-f7c9-4282-8a97-fe2f066ce77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:51.714171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacbba4-f7c9-4282-8a97-fe2f066ce77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:51.714457 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacbba4-f7c9-4282-8a97-fe2f066ce77e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:51.714738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacbba4-f7c9-4282-8a97-fe2f066ce77e admin admin] PATH_INFO: `/v3/projects/fe5e6a7328b54b58997b148bc7cd36bc` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:51.715864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacbba4-f7c9-4282-8a97-fe2f066ce77e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe5e6a7328b54b58997b148bc7cd36bc)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:51.717879 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacbba4-f7c9-4282-8a97-fe2f066ce77e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:51.772554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-0dacbba4-f7c9-4282-8a97-fe2f066ce77e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe5e6a7328b54b58997b148bc7cd36bc', 'request_id': 'req-0dacbba4-f7c9-4282-8a97-fe2f066ce77e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:00:51.778897 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-0dacbba4-f7c9-4282-8a97-fe2f066ce77e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe5e6a7328b54b58997b148bc7cd36bc', 'request_id': 'req-0dacbba4-f7c9-4282-8a97-fe2f066ce77e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:00:51.786622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-0dacbba4-f7c9-4282-8a97-fe2f066ce77e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe5e6a7328b54b58997b148bc7cd36bc', 'request_id': 'req-0dacbba4-f7c9-4282-8a97-fe2f066ce77e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:00:51.798971 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-0dacbba4-f7c9-4282-8a97-fe2f066ce77e admin admin] The token cache is being invalidate because project fe5e6a7328b54b58997b148bc7cd36bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:00:51.799334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-0dacbba4-f7c9-4282-8a97-fe2f066ce77e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:00:51.800100 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-0dacbba4-f7c9-4282-8a97-fe2f066ce77e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:00:51.801951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1187/2388] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:00:51 2022] DELETE /identity/v3/projects/fe5e6a7328b54b58997b148bc7cd36bc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:00:51.807171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9f7be-e59a-4980-8ddb-21b71de62bfe None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:51.807468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9f7be-e59a-4980-8ddb-21b71de62bfe None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:51.807755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9f7be-e59a-4980-8ddb-21b71de62bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:51.830871 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0df9f7be-e59a-4980-8ddb-21b71de62bfe None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:00:51.832306 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0df9f7be-e59a-4980-8ddb-21b71de62bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:00:51.901107 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1202/2389] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:00:51.910781 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe7aa8-07bc-4847-a640-a1efa386c543 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:51.911073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe7aa8-07bc-4847-a640-a1efa386c543 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:51.911355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe7aa8-07bc-4847-a640-a1efa386c543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:51.931679 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ecbe7aa8-07bc-4847-a640-a1efa386c543 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:00:51.933013 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ecbe7aa8-07bc-4847-a640-a1efa386c543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:00:51.944025 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1188/2390] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:00:51.948593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9f7be-e59a-4980-8ddb-21b71de62bfe None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:51.960066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9f7be-e59a-4980-8ddb-21b71de62bfe None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:51.964829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc209a1-07d3-4015-a93d-0583140d5674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:51.965555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc209a1-07d3-4015-a93d-0583140d5674 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:51.965840 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc209a1-07d3-4015-a93d-0583140d5674 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:51.966113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc209a1-07d3-4015-a93d-0583140d5674 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:51.966767 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc209a1-07d3-4015-a93d-0583140d5674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:00:51.967070 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc209a1-07d3-4015-a93d-0583140d5674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:51.969586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc209a1-07d3-4015-a93d-0583140d5674 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:51.984188 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1203/2391] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 09:00:51.988650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe7aa8-07bc-4847-a640-a1efa386c543 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:51.999909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe7aa8-07bc-4847-a640-a1efa386c543 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:52.005730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59358235-1299-44a9-b4d9-14da6441cd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:52.006476 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59358235-1299-44a9-b4d9-14da6441cd39 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:52.006810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59358235-1299-44a9-b4d9-14da6441cd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:52.007142 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59358235-1299-44a9-b4d9-14da6441cd39 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:52.007924 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59358235-1299-44a9-b4d9-14da6441cd39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:52.009930 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59358235-1299-44a9-b4d9-14da6441cd39 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:52.042355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1189/2392] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:00:51 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:00:52.044049 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc209a1-07d3-4015-a93d-0583140d5674 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:52.054994 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc209a1-07d3-4015-a93d-0583140d5674 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:52.119540 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:52.133019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041178e-c126-4444-b272-cb545e2cf9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:52.133753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041178e-c126-4444-b272-cb545e2cf9bb admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:52.134092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041178e-c126-4444-b272-cb545e2cf9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:52.134423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041178e-c126-4444-b272-cb545e2cf9bb admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:52.135178 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041178e-c126-4444-b272-cb545e2cf9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:52.137634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041178e-c126-4444-b272-cb545e2cf9bb admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:52.163473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1204/2393] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:00:52 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:00:52.168127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59358235-1299-44a9-b4d9-14da6441cd39 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:52.179448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59358235-1299-44a9-b4d9-14da6441cd39 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:52.184373 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09155c-f785-449f-91a8-8d836340ce07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:52.184914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09155c-f785-449f-91a8-8d836340ce07 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:52.185222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09155c-f785-449f-91a8-8d836340ce07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:52.185502 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09155c-f785-449f-91a8-8d836340ce07 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:52.186848 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09155c-f785-449f-91a8-8d836340ce07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:52.188645 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09155c-f785-449f-91a8-8d836340ce07 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:52.199671 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1190/2394] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:00:52.205138 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041178e-c126-4444-b272-cb545e2cf9bb admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:52.217959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041178e-c126-4444-b272-cb545e2cf9bb admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:52.227730 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e57e51-2027-4983-a2d0-ee33a8ad073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:52.228484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e57e51-2027-4983-a2d0-ee33a8ad073a admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:52.228833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e57e51-2027-4983-a2d0-ee33a8ad073a admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:52.229216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e57e51-2027-4983-a2d0-ee33a8ad073a admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:52.229988 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e57e51-2027-4983-a2d0-ee33a8ad073a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:52.231980 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e57e51-2027-4983-a2d0-ee33a8ad073a admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:52.246957 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1205/2395] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:00:52.253638 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09155c-f785-449f-91a8-8d836340ce07 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:52.267796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09155c-f785-449f-91a8-8d836340ce07 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:52.274273 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea23c4-5d9e-41ca-8ee0-0683b39c4e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:52.275060 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea23c4-5d9e-41ca-8ee0-0683b39c4e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:52.275398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea23c4-5d9e-41ca-8ee0-0683b39c4e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:52.275747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea23c4-5d9e-41ca-8ee0-0683b39c4e87 admin admin] PATH_INFO: `/v3/projects/b8609013640e4cc388196b1cdb48de1b/users/5f57995725994e96b89ef3c242efbe46/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:52.293941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea23c4-5d9e-41ca-8ee0-0683b39c4e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8609013640e4cc388196b1cdb48de1b, user_id=5f57995725994e96b89ef3c242efbe46, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:52.297479 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea23c4-5d9e-41ca-8ee0-0683b39c4e87 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:52.313653 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1191/2396] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:00:52 2022] PUT /identity/v3/projects/b8609013640e4cc388196b1cdb48de1b/users/5f57995725994e96b89ef3c242efbe46/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:00:52.318794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7394e-1d03-40b4-bd2a-f9eae39aec74 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:52.318794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7394e-1d03-40b4-bd2a-f9eae39aec74 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:52.319554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7394e-1d03-40b4-bd2a-f9eae39aec74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:52.343901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-06e7394e-1d03-40b4-bd2a-f9eae39aec74 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:00:52.345534 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-06e7394e-1d03-40b4-bd2a-f9eae39aec74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:00:52.418342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1206/2397] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:00:52.428115 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea23c4-5d9e-41ca-8ee0-0683b39c4e87 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:52.429867 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-84ea23c4-5d9e-41ca-8ee0-0683b39c4e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:00:52.449708 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:52.523510 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea23c4-5d9e-41ca-8ee0-0683b39c4e87 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:52.527665 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce424e00-5f8c-48fc-8b12-c53bfe0011be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:52.528315 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce424e00-5f8c-48fc-8b12-c53bfe0011be service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:52.528660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce424e00-5f8c-48fc-8b12-c53bfe0011be service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:52.528978 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce424e00-5f8c-48fc-8b12-c53bfe0011be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:52.538947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce424e00-5f8c-48fc-8b12-c53bfe0011be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:52.540379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce424e00-5f8c-48fc-8b12-c53bfe0011be service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:52.552668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1192/2398] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:00:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 09:00:57.142771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f146d-61da-4582-bfa3-acae622ab546 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:57.143273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f146d-61da-4582-bfa3-acae622ab546 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:57.143273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f146d-61da-4582-bfa3-acae622ab546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:57.177529 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-d05f146d-61da-4582-bfa3-acae622ab546 None None] MFA Rules not processed for user `5f57995725994e96b89ef3c242efbe46`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:00:57.178777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d05f146d-61da-4582-bfa3-acae622ab546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:00:57.268591 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1207/2399] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:00:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:00:57.272937 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce424e00-5f8c-48fc-8b12-c53bfe0011be service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:57.284782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce424e00-5f8c-48fc-8b12-c53bfe0011be service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:57.290148 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707506c7-6ce7-4eb8-8078-0959034fe20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:57.290980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707506c7-6ce7-4eb8-8078-0959034fe20d admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:57.291297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707506c7-6ce7-4eb8-8078-0959034fe20d admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:57.291869 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707506c7-6ce7-4eb8-8078-0959034fe20d admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:57.292532 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707506c7-6ce7-4eb8-8078-0959034fe20d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:57.294587 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707506c7-6ce7-4eb8-8078-0959034fe20d admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:57.331794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1193/2400] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:00:57 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:00:57.332960 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f146d-61da-4582-bfa3-acae622ab546 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:57.347097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f146d-61da-4582-bfa3-acae622ab546 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:57.409267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc295d-bbc1-4fab-ae10-a6f09e225cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:57.409891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc295d-bbc1-4fab-ae10-a6f09e225cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:57.410170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc295d-bbc1-4fab-ae10-a6f09e225cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:57.410441 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc295d-bbc1-4fab-ae10-a6f09e225cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:57.411253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc295d-bbc1-4fab-ae10-a6f09e225cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:57.412975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc295d-bbc1-4fab-ae10-a6f09e225cf4 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:57.423718 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:57.437419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1208/2401] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:00:57 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:00:57.442013 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707506c7-6ce7-4eb8-8078-0959034fe20d admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:57.452943 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707506c7-6ce7-4eb8-8078-0959034fe20d admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:57.457859 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6fa51-22ba-4ed0-9d1b-b5782e0b436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:57.458513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6fa51-22ba-4ed0-9d1b-b5782e0b436c admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:57.458813 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6fa51-22ba-4ed0-9d1b-b5782e0b436c admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:57.459092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6fa51-22ba-4ed0-9d1b-b5782e0b436c admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:57.459742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6fa51-22ba-4ed0-9d1b-b5782e0b436c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:57.461460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6fa51-22ba-4ed0-9d1b-b5782e0b436c admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:57.473704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1194/2402] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 09:00:57.479947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc295d-bbc1-4fab-ae10-a6f09e225cf4 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:57.492098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc295d-bbc1-4fab-ae10-a6f09e225cf4 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:57.497271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070460bb-1c98-46fa-a752-306b37d37919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:57.498049 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070460bb-1c98-46fa-a752-306b37d37919 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:57.498364 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070460bb-1c98-46fa-a752-306b37d37919 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:57.498708 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070460bb-1c98-46fa-a752-306b37d37919 admin admin] PATH_INFO: `/v3/projects/805cd7d269f44df982854186c8019cee/users/52917b06b1a74763bf43c2bcfdffa8cd/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:57.518735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070460bb-1c98-46fa-a752-306b37d37919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805cd7d269f44df982854186c8019cee, user_id=52917b06b1a74763bf43c2bcfdffa8cd, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:57.521520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070460bb-1c98-46fa-a752-306b37d37919 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:57.540436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1209/2403] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:00:57 2022] PUT /identity/v3/projects/805cd7d269f44df982854186c8019cee/users/52917b06b1a74763bf43c2bcfdffa8cd/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:00:57.544415 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6fa51-22ba-4ed0-9d1b-b5782e0b436c admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:57.556221 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6fa51-22ba-4ed0-9d1b-b5782e0b436c admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:57.646948 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca435f4c-7747-4342-ac06-44a74ecc36eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:57.647843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca435f4c-7747-4342-ac06-44a74ecc36eb admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:57.648520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca435f4c-7747-4342-ac06-44a74ecc36eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:57.648907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca435f4c-7747-4342-ac06-44a74ecc36eb admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:57.649969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca435f4c-7747-4342-ac06-44a74ecc36eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:57.654201 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca435f4c-7747-4342-ac06-44a74ecc36eb admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:57.681256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1195/2404] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:00:57.683565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070460bb-1c98-46fa-a752-306b37d37919 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:00:57.705677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070460bb-1c98-46fa-a752-306b37d37919 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:00:57.710417 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ebf66-0a79-427b-8616-7ae2e416e055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:00:57.711095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ebf66-0a79-427b-8616-7ae2e416e055 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:00:57.711383 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ebf66-0a79-427b-8616-7ae2e416e055 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:00:57.711667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ebf66-0a79-427b-8616-7ae2e416e055 admin admin] PATH_INFO: `/v3/projects/805cd7d269f44df982854186c8019cee/users/52917b06b1a74763bf43c2bcfdffa8cd/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:00:57.713706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ebf66-0a79-427b-8616-7ae2e416e055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805cd7d269f44df982854186c8019cee, user_id=52917b06b1a74763bf43c2bcfdffa8cd, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:00:57.716348 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ebf66-0a79-427b-8616-7ae2e416e055 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:00:57.739665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1210/2405] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:00:57 2022] PUT /identity/v3/projects/805cd7d269f44df982854186c8019cee/users/52917b06b1a74763bf43c2bcfdffa8cd/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:01:01.830569 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf25275-5a1b-40d2-995b-965a0eb1f0a3 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:01.831144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf25275-5a1b-40d2-995b-965a0eb1f0a3 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:01.831144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf25275-5a1b-40d2-995b-965a0eb1f0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:01.861113 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ccf25275-5a1b-40d2-995b-965a0eb1f0a3 None None] MFA Rules not processed for user `52917b06b1a74763bf43c2bcfdffa8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:01:01.862287 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ccf25275-5a1b-40d2-995b-965a0eb1f0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:01.925175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:01.957120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1196/2406] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:01:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:01:01.967182 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ebf66-0a79-427b-8616-7ae2e416e055 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:01.970428 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-350ebf66-0a79-427b-8616-7ae2e416e055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:02.089700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ebf66-0a79-427b-8616-7ae2e416e055 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:02.096469 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb501e47-56d7-4f24-95ed-fc4f82d9f0f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:02.097558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb501e47-56d7-4f24-95ed-fc4f82d9f0f6 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:02.098080 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb501e47-56d7-4f24-95ed-fc4f82d9f0f6 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:02.098666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb501e47-56d7-4f24-95ed-fc4f82d9f0f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:02.176798 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb501e47-56d7-4f24-95ed-fc4f82d9f0f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:02.178615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb501e47-56d7-4f24-95ed-fc4f82d9f0f6 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:02.193112 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1211/2407] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:01:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:01:03.629802 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338cff4-0f2c-4de2-8739-195c0e154627 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:03.630787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338cff4-0f2c-4de2-8739-195c0e154627 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:03.630787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338cff4-0f2c-4de2-8739-195c0e154627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:03.653043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-1338cff4-0f2c-4de2-8739-195c0e154627 None None] MFA Rules not processed for user `5f57995725994e96b89ef3c242efbe46`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:01:03.655464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1338cff4-0f2c-4de2-8739-195c0e154627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:03.662046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1197/2408] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:01:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:01:12.184071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:INSERT=4,keystone:SELECT=82 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:13.647695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=10 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:40.335991 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb501e47-56d7-4f24-95ed-fc4f82d9f0f6 service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:40.338164 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-fb501e47-56d7-4f24-95ed-fc4f82d9f0f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:40.420518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb501e47-56d7-4f24-95ed-fc4f82d9f0f6 service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:40.424687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa53ad8-18d8-4733-8347-5f268b3bf62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:40.425326 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa53ad8-18d8-4733-8347-5f268b3bf62c service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:40.425612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa53ad8-18d8-4733-8347-5f268b3bf62c service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:40.425879 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa53ad8-18d8-4733-8347-5f268b3bf62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:40.435934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa53ad8-18d8-4733-8347-5f268b3bf62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:40.437513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa53ad8-18d8-4733-8347-5f268b3bf62c service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:40.447447 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1212/2409] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:01:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:01:43.246651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f280da0-ed91-4185-b0eb-1ef25bb6177c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:43.246651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f280da0-ed91-4185-b0eb-1ef25bb6177c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:43.246651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f280da0-ed91-4185-b0eb-1ef25bb6177c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:43.271010 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-8f280da0-ed91-4185-b0eb-1ef25bb6177c None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:01:43.272719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-8f280da0-ed91-4185-b0eb-1ef25bb6177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:43.360251 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1198/2410] 10.222.0.76 () {58 vars in 1009 bytes} [Fri Aug 26 09:01:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:01:43.388835 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa53ad8-18d8-4733-8347-5f268b3bf62c service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:43.391291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9aa53ad8-18d8-4733-8347-5f268b3bf62c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:43.493794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa53ad8-18d8-4733-8347-5f268b3bf62c service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:43.503586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779d9e2-69d8-4d36-b35e-d0b31fb28157 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:43.505381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779d9e2-69d8-4d36-b35e-d0b31fb28157 service swift] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:43.506118 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779d9e2-69d8-4d36-b35e-d0b31fb28157 service swift] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:43.506912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779d9e2-69d8-4d36-b35e-d0b31fb28157 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:43.526992 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779d9e2-69d8-4d36-b35e-d0b31fb28157 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:43.528894 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779d9e2-69d8-4d36-b35e-d0b31fb28157 service swift] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:43.554662 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1213/2411] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 09:01:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 09:01:44.559712 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f280da0-ed91-4185-b0eb-1ef25bb6177c None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:44.572753 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f280da0-ed91-4185-b0eb-1ef25bb6177c None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:44.577695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec023434-ff39-42f7-b5bf-da3036ac4470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:44.578819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec023434-ff39-42f7-b5bf-da3036ac4470 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:44.579546 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec023434-ff39-42f7-b5bf-da3036ac4470 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:44.580168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec023434-ff39-42f7-b5bf-da3036ac4470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:44.582978 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ec023434-ff39-42f7-b5bf-da3036ac4470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:44.679214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec023434-ff39-42f7-b5bf-da3036ac4470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:44.680823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec023434-ff39-42f7-b5bf-da3036ac4470 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:44.707482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1199/2412] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:01:49.777070 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779d9e2-69d8-4d36-b35e-d0b31fb28157 service swift] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:49.782197 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a779d9e2-69d8-4d36-b35e-d0b31fb28157 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:49.823572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779d9e2-69d8-4d36-b35e-d0b31fb28157 service swift] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:49.831714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc0264-f581-48ee-adbb-448d82446801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:49.833435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc0264-f581-48ee-adbb-448d82446801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:49.833689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc0264-f581-48ee-adbb-448d82446801 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:49.834128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc0264-f581-48ee-adbb-448d82446801 admin admin] PATH_INFO: `/v3/users/e031367406df4a3d95f2ed9e2eb8efae` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:49.836013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc0264-f581-48ee-adbb-448d82446801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e031367406df4a3d95f2ed9e2eb8efae)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:49.838893 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc0264-f581-48ee-adbb-448d82446801 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:49.930438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-cfcc0264-f581-48ee-adbb-448d82446801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e031367406df4a3d95f2ed9e2eb8efae'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:49.944900 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-cfcc0264-f581-48ee-adbb-448d82446801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e031367406df4a3d95f2ed9e2eb8efae'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:49.946279 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-cfcc0264-f581-48ee-adbb-448d82446801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e031367406df4a3d95f2ed9e2eb8efae'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:49.960254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-cfcc0264-f581-48ee-adbb-448d82446801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e031367406df4a3d95f2ed9e2eb8efae'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:50.011122 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-cfcc0264-f581-48ee-adbb-448d82446801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e031367406df4a3d95f2ed9e2eb8efae'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:50.027108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1214/2413] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:01:49 2022] DELETE /identity/v3/users/e031367406df4a3d95f2ed9e2eb8efae => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:01:50.352734 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec023434-ff39-42f7-b5bf-da3036ac4470 service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:50.377296 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec023434-ff39-42f7-b5bf-da3036ac4470 service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:50.512083 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6703afc-9bd0-47bf-949a-8fb83f09532b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:50.512855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6703afc-9bd0-47bf-949a-8fb83f09532b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:50.513387 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6703afc-9bd0-47bf-949a-8fb83f09532b admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:50.513915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6703afc-9bd0-47bf-949a-8fb83f09532b admin admin] PATH_INFO: `/v3/projects/dea40107e44c4077a0d0a5e396b0f823` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:50.515088 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6703afc-9bd0-47bf-949a-8fb83f09532b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea40107e44c4077a0d0a5e396b0f823)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:50.520521 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6703afc-9bd0-47bf-949a-8fb83f09532b admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:50.628706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:50.636815 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b6703afc-9bd0-47bf-949a-8fb83f09532b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea40107e44c4077a0d0a5e396b0f823', 'request_id': 'req-b6703afc-9bd0-47bf-949a-8fb83f09532b'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:50.645685 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b6703afc-9bd0-47bf-949a-8fb83f09532b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea40107e44c4077a0d0a5e396b0f823', 'request_id': 'req-b6703afc-9bd0-47bf-949a-8fb83f09532b'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:50.661639 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b6703afc-9bd0-47bf-949a-8fb83f09532b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea40107e44c4077a0d0a5e396b0f823', 'request_id': 'req-b6703afc-9bd0-47bf-949a-8fb83f09532b'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:50.676056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b6703afc-9bd0-47bf-949a-8fb83f09532b admin admin] The token cache is being invalidate because project dea40107e44c4077a0d0a5e396b0f823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:01:50.676357 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b6703afc-9bd0-47bf-949a-8fb83f09532b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:50.677174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b6703afc-9bd0-47bf-949a-8fb83f09532b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:50.681054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1200/2414] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:01:50 2022] DELETE /identity/v3/projects/dea40107e44c4077a0d0a5e396b0f823 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:01:50.685038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412e7a8-8c35-4139-9364-d60bc52338d8 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:50.685801 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412e7a8-8c35-4139-9364-d60bc52338d8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:50.686121 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412e7a8-8c35-4139-9364-d60bc52338d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:50.696830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:50.719190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-9412e7a8-8c35-4139-9364-d60bc52338d8 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:01:50.721718 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9412e7a8-8c35-4139-9364-d60bc52338d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:50.821504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1215/2415] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:01:50.840539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2206bc-d4dc-4ddc-92a6-991919d651d5 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:50.840929 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2206bc-d4dc-4ddc-92a6-991919d651d5 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:50.841349 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2206bc-d4dc-4ddc-92a6-991919d651d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:50.864066 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-3d2206bc-d4dc-4ddc-92a6-991919d651d5 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:01:50.865459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3d2206bc-d4dc-4ddc-92a6-991919d651d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:50.875472 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1201/2416] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:01:50.879793 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412e7a8-8c35-4139-9364-d60bc52338d8 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:50.898029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412e7a8-8c35-4139-9364-d60bc52338d8 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:50.904144 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28a458-0e91-45dc-a3fc-4b27e570b72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:50.904877 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28a458-0e91-45dc-a3fc-4b27e570b72c admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:50.905785 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28a458-0e91-45dc-a3fc-4b27e570b72c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:50.906149 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28a458-0e91-45dc-a3fc-4b27e570b72c admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:50.906823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28a458-0e91-45dc-a3fc-4b27e570b72c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:01:50.907124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28a458-0e91-45dc-a3fc-4b27e570b72c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:50.908927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28a458-0e91-45dc-a3fc-4b27e570b72c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:50.932284 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1216/2417] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 09:01:50.937768 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2206bc-d4dc-4ddc-92a6-991919d651d5 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:50.948908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2206bc-d4dc-4ddc-92a6-991919d651d5 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:50.954632 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c7dbf-ebbd-481f-8e12-a3dc2f987294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:50.955339 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c7dbf-ebbd-481f-8e12-a3dc2f987294 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:50.955628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c7dbf-ebbd-481f-8e12-a3dc2f987294 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:50.955907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c7dbf-ebbd-481f-8e12-a3dc2f987294 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:50.956559 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c7dbf-ebbd-481f-8e12-a3dc2f987294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:50.958506 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c7dbf-ebbd-481f-8e12-a3dc2f987294 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:51.017035 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1202/2418] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:01:50 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:01:51.021437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28a458-0e91-45dc-a3fc-4b27e570b72c admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:51.036363 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28a458-0e91-45dc-a3fc-4b27e570b72c admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:51.121281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6525149-3bef-4218-a7d7-81be9791b42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:51.122337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6525149-3bef-4218-a7d7-81be9791b42b admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:51.122787 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6525149-3bef-4218-a7d7-81be9791b42b admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:51.123160 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6525149-3bef-4218-a7d7-81be9791b42b admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:51.124434 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6525149-3bef-4218-a7d7-81be9791b42b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:51.126949 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6525149-3bef-4218-a7d7-81be9791b42b admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:51.157233 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1217/2419] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:01:51 2022] POST /identity/v3/users => generated 286 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:01:51.170796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c7dbf-ebbd-481f-8e12-a3dc2f987294 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:51.183227 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c7dbf-ebbd-481f-8e12-a3dc2f987294 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:51.190096 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1deda-5208-42c2-874c-9338337a5dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:51.191050 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1deda-5208-42c2-874c-9338337a5dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:51.191354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1deda-5208-42c2-874c-9338337a5dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:51.192209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1deda-5208-42c2-874c-9338337a5dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:51.192908 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1deda-5208-42c2-874c-9338337a5dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:51.194714 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1deda-5208-42c2-874c-9338337a5dc3 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:51.208944 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1203/2420] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 09:01:51.215147 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6525149-3bef-4218-a7d7-81be9791b42b admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:51.234985 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6525149-3bef-4218-a7d7-81be9791b42b admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:51.243328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cfce6-328e-4460-8d65-aaaf868440e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:51.244857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cfce6-328e-4460-8d65-aaaf868440e6 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:51.245932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cfce6-328e-4460-8d65-aaaf868440e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:51.246169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cfce6-328e-4460-8d65-aaaf868440e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:51.247083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cfce6-328e-4460-8d65-aaaf868440e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:51.250829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cfce6-328e-4460-8d65-aaaf868440e6 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:51.269666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1218/2421] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:01:51.275058 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1deda-5208-42c2-874c-9338337a5dc3 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:51.297411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1deda-5208-42c2-874c-9338337a5dc3 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:51.305602 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cb90d-a04c-40f9-a7e8-474eef80475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:51.306670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cb90d-a04c-40f9-a7e8-474eef80475c admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:51.307143 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cb90d-a04c-40f9-a7e8-474eef80475c admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:51.307622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cb90d-a04c-40f9-a7e8-474eef80475c admin admin] PATH_INFO: `/v3/projects/8d7c661931574da48221efc0904911bc/users/85e3cf546d44407a9e787145d58afbd5/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:51.340125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cb90d-a04c-40f9-a7e8-474eef80475c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7c661931574da48221efc0904911bc, user_id=85e3cf546d44407a9e787145d58afbd5, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:51.346060 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cb90d-a04c-40f9-a7e8-474eef80475c admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:51.375817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1204/2422] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:01:51 2022] PUT /identity/v3/projects/8d7c661931574da48221efc0904911bc/users/85e3cf546d44407a9e787145d58afbd5/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:01:51.395103 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f0058-7d59-4849-ba8e-41b2ab2e6fea None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:51.395771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f0058-7d59-4849-ba8e-41b2ab2e6fea None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:51.396272 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f0058-7d59-4849-ba8e-41b2ab2e6fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:51.445341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-616f0058-7d59-4849-ba8e-41b2ab2e6fea None None] MFA Rules not processed for user `85e3cf546d44407a9e787145d58afbd5`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:01:51.446633 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-616f0058-7d59-4849-ba8e-41b2ab2e6fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:51.542225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:51.558636 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1219/2423] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:01:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:01:51.566187 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cb90d-a04c-40f9-a7e8-474eef80475c admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:51.567934 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d84cb90d-a04c-40f9-a7e8-474eef80475c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:51.716402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cb90d-a04c-40f9-a7e8-474eef80475c admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:51.727983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901b5c2-092e-4023-af6b-b2d205af0662 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:51.728841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901b5c2-092e-4023-af6b-b2d205af0662 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:51.729266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901b5c2-092e-4023-af6b-b2d205af0662 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:51.729637 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901b5c2-092e-4023-af6b-b2d205af0662 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:51.746449 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901b5c2-092e-4023-af6b-b2d205af0662 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:51.748082 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901b5c2-092e-4023-af6b-b2d205af0662 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:51.759942 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1205/2424] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:01:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:01:54.813835 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f0058-7d59-4849-ba8e-41b2ab2e6fea None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:54.815303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-616f0058-7d59-4849-ba8e-41b2ab2e6fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:54.899864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f0058-7d59-4849-ba8e-41b2ab2e6fea None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:54.903646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3592d44-c875-451c-947d-a64b4b20fdd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:54.904258 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3592d44-c875-451c-947d-a64b4b20fdd2 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:54.904569 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3592d44-c875-451c-947d-a64b4b20fdd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:54.904869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3592d44-c875-451c-947d-a64b4b20fdd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:54.906673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f3592d44-c875-451c-947d-a64b4b20fdd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:54.923770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3592d44-c875-451c-947d-a64b4b20fdd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:54.925254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3592d44-c875-451c-947d-a64b4b20fdd2 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:54.937632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1220/2425] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:01:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:01:54.972122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901b5c2-092e-4023-af6b-b2d205af0662 service nova] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:55.022775 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:55.044533 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901b5c2-092e-4023-af6b-b2d205af0662 service nova] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:55.050607 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ad14a-d976-413d-b70b-08752d329ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:55.051245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ad14a-d976-413d-b70b-08752d329ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:55.051522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ad14a-d976-413d-b70b-08752d329ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:55.051793 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ad14a-d976-413d-b70b-08752d329ddc admin admin] PATH_INFO: `/v3/users/85e3cf546d44407a9e787145d58afbd5` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:55.053164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ad14a-d976-413d-b70b-08752d329ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=85e3cf546d44407a9e787145d58afbd5)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:55.055097 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ad14a-d976-413d-b70b-08752d329ddc admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:55.118235 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d88ad14a-d976-413d-b70b-08752d329ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85e3cf546d44407a9e787145d58afbd5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:55.129399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d88ad14a-d976-413d-b70b-08752d329ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85e3cf546d44407a9e787145d58afbd5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:55.130497 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d88ad14a-d976-413d-b70b-08752d329ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85e3cf546d44407a9e787145d58afbd5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:55.131282 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d88ad14a-d976-413d-b70b-08752d329ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85e3cf546d44407a9e787145d58afbd5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:55.139980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d88ad14a-d976-413d-b70b-08752d329ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85e3cf546d44407a9e787145d58afbd5'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:55.158299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1206/2426] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:01:54 2022] DELETE /identity/v3/users/85e3cf546d44407a9e787145d58afbd5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:01:55.162939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814fd8e-e607-4027-b8f5-f6a73a4bba57 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:55.163231 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814fd8e-e607-4027-b8f5-f6a73a4bba57 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:55.163513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814fd8e-e607-4027-b8f5-f6a73a4bba57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:55.183955 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0814fd8e-e607-4027-b8f5-f6a73a4bba57 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:01:55.185199 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0814fd8e-e607-4027-b8f5-f6a73a4bba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:55.248840 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1221/2427] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:01:55.258993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ad14a-d976-413d-b70b-08752d329ddc admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:55.260541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d88ad14a-d976-413d-b70b-08752d329ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:55.323047 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ad14a-d976-413d-b70b-08752d329ddc admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:55.327560 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ecd8-8756-43be-a5bb-4f8264281ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:55.328302 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ecd8-8756-43be-a5bb-4f8264281ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:55.328616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ecd8-8756-43be-a5bb-4f8264281ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:55.328894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ecd8-8756-43be-a5bb-4f8264281ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:55.340327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3ecd8-8756-43be-a5bb-4f8264281ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:55.341456 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3ecd8-8756-43be-a5bb-4f8264281ca7 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:55.352642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1207/2428] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:01:55.498006 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814fd8e-e607-4027-b8f5-f6a73a4bba57 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:55.510881 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814fd8e-e607-4027-b8f5-f6a73a4bba57 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:55.517185 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0cf4c-65c7-435c-9e0f-e09c6549c387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:55.520644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0cf4c-65c7-435c-9e0f-e09c6549c387 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:55.520644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0cf4c-65c7-435c-9e0f-e09c6549c387 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:55.520644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0cf4c-65c7-435c-9e0f-e09c6549c387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:55.523737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-aac0cf4c-65c7-435c-9e0f-e09c6549c387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:55.620521 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0cf4c-65c7-435c-9e0f-e09c6549c387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:55.622024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0cf4c-65c7-435c-9e0f-e09c6549c387 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:55.636145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1222/2429] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:01:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:01:55.822199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ecd8-8756-43be-a5bb-4f8264281ca7 service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:55.823710 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-58d3ecd8-8756-43be-a5bb-4f8264281ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:55.837831 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ecd8-8756-43be-a5bb-4f8264281ca7 service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:55.842686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e5aef-67c9-40bf-a4aa-f92dc69c1096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:55.843585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e5aef-67c9-40bf-a4aa-f92dc69c1096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:55.843873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e5aef-67c9-40bf-a4aa-f92dc69c1096 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:55.844150 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e5aef-67c9-40bf-a4aa-f92dc69c1096 admin admin] PATH_INFO: `/v3/projects/8d7c661931574da48221efc0904911bc` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:55.845391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e5aef-67c9-40bf-a4aa-f92dc69c1096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7c661931574da48221efc0904911bc)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:55.847405 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e5aef-67c9-40bf-a4aa-f92dc69c1096 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:55.911430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-003e5aef-67c9-40bf-a4aa-f92dc69c1096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7c661931574da48221efc0904911bc', 'request_id': 'req-003e5aef-67c9-40bf-a4aa-f92dc69c1096'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:55.919189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-003e5aef-67c9-40bf-a4aa-f92dc69c1096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7c661931574da48221efc0904911bc', 'request_id': 'req-003e5aef-67c9-40bf-a4aa-f92dc69c1096'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:55.924470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:55.929991 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-003e5aef-67c9-40bf-a4aa-f92dc69c1096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7c661931574da48221efc0904911bc', 'request_id': 'req-003e5aef-67c9-40bf-a4aa-f92dc69c1096'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:55.945077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-003e5aef-67c9-40bf-a4aa-f92dc69c1096 admin admin] The token cache is being invalidate because project 8d7c661931574da48221efc0904911bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:01:55.945396 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-003e5aef-67c9-40bf-a4aa-f92dc69c1096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:55.946045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-003e5aef-67c9-40bf-a4aa-f92dc69c1096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:01:55.947864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1208/2430] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:01:55 2022] DELETE /identity/v3/projects/8d7c661931574da48221efc0904911bc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:01:55.953384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a8a7a-23b6-463f-b300-5919066ce482 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:55.953384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a8a7a-23b6-463f-b300-5919066ce482 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:55.954090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a8a7a-23b6-463f-b300-5919066ce482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:55.976747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-c15a8a7a-23b6-463f-b300-5919066ce482 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:01:55.978024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c15a8a7a-23b6-463f-b300-5919066ce482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:55.983786 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:56.051402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1223/2431] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:01:56.059701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f72f7-b87a-4324-b97a-03fcce5a0939 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:56.060324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f72f7-b87a-4324-b97a-03fcce5a0939 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:56.060324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f72f7-b87a-4324-b97a-03fcce5a0939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:56.085377 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-857f72f7-b87a-4324-b97a-03fcce5a0939 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:01:56.086634 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-857f72f7-b87a-4324-b97a-03fcce5a0939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:56.098269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1209/2432] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:01:56.103186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a8a7a-23b6-463f-b300-5919066ce482 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:56.115464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a8a7a-23b6-463f-b300-5919066ce482 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:56.121442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6710d9-3e85-453f-a3bc-c434f614aa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:56.122681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6710d9-3e85-453f-a3bc-c434f614aa8d admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:56.123468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6710d9-3e85-453f-a3bc-c434f614aa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:56.123468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6710d9-3e85-453f-a3bc-c434f614aa8d admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:56.124444 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6710d9-3e85-453f-a3bc-c434f614aa8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:01:56.124748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6710d9-3e85-453f-a3bc-c434f614aa8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:56.126416 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6710d9-3e85-453f-a3bc-c434f614aa8d admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:56.150200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1224/2433] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:01:56.151200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f72f7-b87a-4324-b97a-03fcce5a0939 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:56.162495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f72f7-b87a-4324-b97a-03fcce5a0939 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:56.168153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6b95c-7206-4d17-b7c7-c507c446384c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:56.169724 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6b95c-7206-4d17-b7c7-c507c446384c admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:56.170146 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6b95c-7206-4d17-b7c7-c507c446384c admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:56.171132 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6b95c-7206-4d17-b7c7-c507c446384c admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:56.171853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6b95c-7206-4d17-b7c7-c507c446384c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:56.173915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6b95c-7206-4d17-b7c7-c507c446384c admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:56.222103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1210/2434] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:01:56 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:01:56.225031 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6710d9-3e85-453f-a3bc-c434f614aa8d admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:56.252851 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6710d9-3e85-453f-a3bc-c434f614aa8d admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:56.332614 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef244fea-ccc3-46e0-a979-84cb147477c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:56.333324 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef244fea-ccc3-46e0-a979-84cb147477c7 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:56.334050 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef244fea-ccc3-46e0-a979-84cb147477c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:56.334050 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef244fea-ccc3-46e0-a979-84cb147477c7 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:56.334500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef244fea-ccc3-46e0-a979-84cb147477c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:56.336450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef244fea-ccc3-46e0-a979-84cb147477c7 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:56.365186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1225/2435] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:01:56 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:01:56.369806 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6b95c-7206-4d17-b7c7-c507c446384c admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:56.382551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6b95c-7206-4d17-b7c7-c507c446384c admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:56.388963 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c38f1-cd4d-4686-bd1a-7f61816847dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:56.391636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c38f1-cd4d-4686-bd1a-7f61816847dd admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:56.392395 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c38f1-cd4d-4686-bd1a-7f61816847dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:56.392395 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c38f1-cd4d-4686-bd1a-7f61816847dd admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:56.393173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c38f1-cd4d-4686-bd1a-7f61816847dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:56.394827 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c38f1-cd4d-4686-bd1a-7f61816847dd admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:56.407113 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1211/2436] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:01:56.411173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef244fea-ccc3-46e0-a979-84cb147477c7 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:56.424158 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef244fea-ccc3-46e0-a979-84cb147477c7 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:56.435929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07500faa-ce1c-4feb-9dce-9f4d0369397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:56.436680 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07500faa-ce1c-4feb-9dce-9f4d0369397c admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:56.437056 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07500faa-ce1c-4feb-9dce-9f4d0369397c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:56.437415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07500faa-ce1c-4feb-9dce-9f4d0369397c admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:56.438125 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07500faa-ce1c-4feb-9dce-9f4d0369397c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:56.440113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07500faa-ce1c-4feb-9dce-9f4d0369397c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:56.451743 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1226/2437] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:01:56.456262 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c38f1-cd4d-4686-bd1a-7f61816847dd admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:56.466656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c38f1-cd4d-4686-bd1a-7f61816847dd admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:56.472280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fae05d-c428-4a62-bd84-50424f5f1076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:56.472943 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fae05d-c428-4a62-bd84-50424f5f1076 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:56.473263 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fae05d-c428-4a62-bd84-50424f5f1076 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:56.473548 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fae05d-c428-4a62-bd84-50424f5f1076 admin admin] PATH_INFO: `/v3/projects/60034ccb062d419786fd8afed31be6db/users/6364c161e9a4469287ce610c949c3835/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:56.489625 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fae05d-c428-4a62-bd84-50424f5f1076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60034ccb062d419786fd8afed31be6db, user_id=6364c161e9a4469287ce610c949c3835, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:56.492300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fae05d-c428-4a62-bd84-50424f5f1076 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:56.505988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1212/2438] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:01:56 2022] PUT /identity/v3/projects/60034ccb062d419786fd8afed31be6db/users/6364c161e9a4469287ce610c949c3835/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:01:56.517714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6e6c4-35cd-4dee-8cb9-f0de4b85856d None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:56.518214 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6e6c4-35cd-4dee-8cb9-f0de4b85856d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:56.518640 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6e6c4-35cd-4dee-8cb9-f0de4b85856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:56.557050 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-eab6e6c4-35cd-4dee-8cb9-f0de4b85856d None None] MFA Rules not processed for user `6364c161e9a4469287ce610c949c3835`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:01:56.558308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-eab6e6c4-35cd-4dee-8cb9-f0de4b85856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:56.636803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1227/2439] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:01:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:01:56.642297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fae05d-c428-4a62-bd84-50424f5f1076 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:56.707590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fae05d-c428-4a62-bd84-50424f5f1076 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:56.712907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9834f-93ef-4826-a5a8-78f13b8349ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:56.713998 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9834f-93ef-4826-a5a8-78f13b8349ff admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:56.714514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9834f-93ef-4826-a5a8-78f13b8349ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:56.715249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9834f-93ef-4826-a5a8-78f13b8349ff admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:56.716062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9834f-93ef-4826-a5a8-78f13b8349ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:56.719310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9834f-93ef-4826-a5a8-78f13b8349ff admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:56.748173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1213/2440] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:01:56 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:01:56.752383 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6e6c4-35cd-4dee-8cb9-f0de4b85856d None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:56.759015 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:56.764774 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6e6c4-35cd-4dee-8cb9-f0de4b85856d None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:56.827483 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0851d-ee82-4a8a-a05b-8bf60ad28545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:56.828163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0851d-ee82-4a8a-a05b-8bf60ad28545 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:56.828451 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0851d-ee82-4a8a-a05b-8bf60ad28545 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:56.828736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0851d-ee82-4a8a-a05b-8bf60ad28545 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:56.829409 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0851d-ee82-4a8a-a05b-8bf60ad28545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:56.831354 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0851d-ee82-4a8a-a05b-8bf60ad28545 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:56.857267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1228/2441] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:01:56 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:01:56.859413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9834f-93ef-4826-a5a8-78f13b8349ff admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:56.878822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9834f-93ef-4826-a5a8-78f13b8349ff admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:56.886616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a658-ddc4-47b1-bca8-d184f743a65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:56.887679 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a658-ddc4-47b1-bca8-d184f743a65e admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:56.888188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a658-ddc4-47b1-bca8-d184f743a65e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:56.888690 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a658-ddc4-47b1-bca8-d184f743a65e admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:56.890508 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6a658-ddc4-47b1-bca8-d184f743a65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:56.893200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6a658-ddc4-47b1-bca8-d184f743a65e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:56.910800 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1214/2442] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:01:56.911243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0851d-ee82-4a8a-a05b-8bf60ad28545 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:56.933061 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0851d-ee82-4a8a-a05b-8bf60ad28545 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:56.939381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febfa98-14bd-4318-bab9-ee9574d4a6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:56.940062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febfa98-14bd-4318-bab9-ee9574d4a6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:56.940339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febfa98-14bd-4318-bab9-ee9574d4a6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:56.940616 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febfa98-14bd-4318-bab9-ee9574d4a6c3 admin admin] PATH_INFO: `/v3/projects/69db8238cb494a8ba760ddad4e75dc5c/users/f3694fc9b88b43c79822c954cf87aa59/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:56.961318 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febfa98-14bd-4318-bab9-ee9574d4a6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69db8238cb494a8ba760ddad4e75dc5c, user_id=f3694fc9b88b43c79822c954cf87aa59, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:56.964777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febfa98-14bd-4318-bab9-ee9574d4a6c3 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:56.981241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1229/2443] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:01:56 2022] PUT /identity/v3/projects/69db8238cb494a8ba760ddad4e75dc5c/users/f3694fc9b88b43c79822c954cf87aa59/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:01:56.986091 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a658-ddc4-47b1-bca8-d184f743a65e admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:57.001480 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a658-ddc4-47b1-bca8-d184f743a65e admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:57.062040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:57.069624 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bf676-8f15-489b-85f9-6b8558c608c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:57.070244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bf676-8f15-489b-85f9-6b8558c608c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:57.070534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bf676-8f15-489b-85f9-6b8558c608c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:57.070809 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bf676-8f15-489b-85f9-6b8558c608c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:57.071478 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bf676-8f15-489b-85f9-6b8558c608c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:57.073665 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bf676-8f15-489b-85f9-6b8558c608c2 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:57.084987 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1215/2444] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:01:57.089260 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febfa98-14bd-4318-bab9-ee9574d4a6c3 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:57.099962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febfa98-14bd-4318-bab9-ee9574d4a6c3 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:57.104777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7240bf-9790-48da-9323-6444fe03d048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:57.105477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7240bf-9790-48da-9323-6444fe03d048 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:57.105760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7240bf-9790-48da-9323-6444fe03d048 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:57.106043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7240bf-9790-48da-9323-6444fe03d048 admin admin] PATH_INFO: `/v3/projects/69db8238cb494a8ba760ddad4e75dc5c/users/f3694fc9b88b43c79822c954cf87aa59/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:57.108029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7240bf-9790-48da-9323-6444fe03d048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69db8238cb494a8ba760ddad4e75dc5c, user_id=f3694fc9b88b43c79822c954cf87aa59, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:57.110736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7240bf-9790-48da-9323-6444fe03d048 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:57.123249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1230/2445] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:01:57 2022] PUT /identity/v3/projects/69db8238cb494a8ba760ddad4e75dc5c/users/f3694fc9b88b43c79822c954cf87aa59/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:01:57.135969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49465ee8-5f0d-48ca-bece-ad026a6847ae None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:57.136261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49465ee8-5f0d-48ca-bece-ad026a6847ae None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:57.136541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49465ee8-5f0d-48ca-bece-ad026a6847ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:57.165947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-49465ee8-5f0d-48ca-bece-ad026a6847ae None None] MFA Rules not processed for user `f3694fc9b88b43c79822c954cf87aa59`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:01:57.167200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-49465ee8-5f0d-48ca-bece-ad026a6847ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:57.253262 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1216/2446] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:01:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:01:57.265339 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7240bf-9790-48da-9323-6444fe03d048 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:57.267094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0d7240bf-9790-48da-9323-6444fe03d048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:01:57.328295 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7240bf-9790-48da-9323-6444fe03d048 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:57.332019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4c1c3-a5bc-42bf-b8e6-0b0a2510e0ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:57.332620 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4c1c3-a5bc-42bf-b8e6-0b0a2510e0ec service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:57.332900 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4c1c3-a5bc-42bf-b8e6-0b0a2510e0ec service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:57.333203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4c1c3-a5bc-42bf-b8e6-0b0a2510e0ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:57.343788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4c1c3-a5bc-42bf-b8e6-0b0a2510e0ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:57.345276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4c1c3-a5bc-42bf-b8e6-0b0a2510e0ec service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:57.355630 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1231/2447] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:01:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:01:57.443749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49465ee8-5f0d-48ca-bece-ad026a6847ae None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:01:57.454701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49465ee8-5f0d-48ca-bece-ad026a6847ae None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:01:57.458471 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53431a2d-cb45-4fcc-81f1-5e89f15061b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:01:57.459087 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53431a2d-cb45-4fcc-81f1-5e89f15061b4 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:01:57.459374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53431a2d-cb45-4fcc-81f1-5e89f15061b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:01:57.459650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53431a2d-cb45-4fcc-81f1-5e89f15061b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:01:57.526799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53431a2d-cb45-4fcc-81f1-5e89f15061b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:01:57.528647 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53431a2d-cb45-4fcc-81f1-5e89f15061b4 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:01:57.539815 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1217/2448] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:01:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 09:02:02.433308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea3688-bace-4888-80d7-f7e68f1324de None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:02.433886 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea3688-bace-4888-80d7-f7e68f1324de None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:02.434001 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea3688-bace-4888-80d7-f7e68f1324de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:02.454628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-17ea3688-bace-4888-80d7-f7e68f1324de None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:02.455158 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-17ea3688-bace-4888-80d7-f7e68f1324de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:02.530452 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1232/2449] 10.222.0.76 () {58 vars in 1009 bytes} [Fri Aug 26 09:02:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:02.542370 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53431a2d-cb45-4fcc-81f1-5e89f15061b4 service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:02.543974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-53431a2d-cb45-4fcc-81f1-5e89f15061b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:02.619490 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53431a2d-cb45-4fcc-81f1-5e89f15061b4 service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:02.624630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f201049-d6c7-4eb5-832e-e185040b1101 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:02.625273 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f201049-d6c7-4eb5-832e-e185040b1101 service swift] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:02.625556 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f201049-d6c7-4eb5-832e-e185040b1101 service swift] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:02.625833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f201049-d6c7-4eb5-832e-e185040b1101 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:02.634126 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f201049-d6c7-4eb5-832e-e185040b1101 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:02.635729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f201049-d6c7-4eb5-832e-e185040b1101 service swift] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:02.644638 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1218/2450] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 09:02:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 09:02:04.649398 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea3688-bace-4888-80d7-f7e68f1324de None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:04.656832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:04.729132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea3688-bace-4888-80d7-f7e68f1324de None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:04.734631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb188b-56c4-47d2-921d-155fa2c784bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:04.735365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb188b-56c4-47d2-921d-155fa2c784bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:04.735722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb188b-56c4-47d2-921d-155fa2c784bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:04.736075 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb188b-56c4-47d2-921d-155fa2c784bb admin admin] PATH_INFO: `/v3/users/6364c161e9a4469287ce610c949c3835` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:04.737350 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb188b-56c4-47d2-921d-155fa2c784bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6364c161e9a4469287ce610c949c3835)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:04.739359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb188b-56c4-47d2-921d-155fa2c784bb admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:04.791132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1afb188b-56c4-47d2-921d-155fa2c784bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6364c161e9a4469287ce610c949c3835'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:04.800798 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1afb188b-56c4-47d2-921d-155fa2c784bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6364c161e9a4469287ce610c949c3835'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:04.801561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1afb188b-56c4-47d2-921d-155fa2c784bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6364c161e9a4469287ce610c949c3835'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:04.815295 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1afb188b-56c4-47d2-921d-155fa2c784bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6364c161e9a4469287ce610c949c3835'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:04.830982 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-1afb188b-56c4-47d2-921d-155fa2c784bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6364c161e9a4469287ce610c949c3835'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:04.838390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1233/2451] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:04 2022] DELETE /identity/v3/users/6364c161e9a4469287ce610c949c3835 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:04.842859 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eb214-b863-4677-b2b5-005d7673ba96 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:04.843856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eb214-b863-4677-b2b5-005d7673ba96 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:04.843856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eb214-b863-4677-b2b5-005d7673ba96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:04.858307 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:04.865341 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-678eb214-b863-4677-b2b5-005d7673ba96 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:04.866583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-678eb214-b863-4677-b2b5-005d7673ba96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:04.927623 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1219/2452] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:02:04.939488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb188b-56c4-47d2-921d-155fa2c784bb admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:04.941061 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1afb188b-56c4-47d2-921d-155fa2c784bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:05.024707 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb188b-56c4-47d2-921d-155fa2c784bb admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:05.033827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265b226-9fee-4a6a-9f6c-6ae0afc9c635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:05.034463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265b226-9fee-4a6a-9f6c-6ae0afc9c635 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:05.046390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265b226-9fee-4a6a-9f6c-6ae0afc9c635 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:05.047139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265b226-9fee-4a6a-9f6c-6ae0afc9c635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:05.058534 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265b226-9fee-4a6a-9f6c-6ae0afc9c635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:05.060018 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265b226-9fee-4a6a-9f6c-6ae0afc9c635 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:05.071500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1234/2453] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:05.493344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678eb214-b863-4677-b2b5-005d7673ba96 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:05.495494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-678eb214-b863-4677-b2b5-005d7673ba96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:05.515760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678eb214-b863-4677-b2b5-005d7673ba96 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:05.531309 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa59ad7-aa39-41b8-b60e-35769a5a9991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:05.532615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa59ad7-aa39-41b8-b60e-35769a5a9991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:05.532910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa59ad7-aa39-41b8-b60e-35769a5a9991 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:05.533229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa59ad7-aa39-41b8-b60e-35769a5a9991 admin admin] PATH_INFO: `/v3/projects/60034ccb062d419786fd8afed31be6db` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:05.534483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa59ad7-aa39-41b8-b60e-35769a5a9991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60034ccb062d419786fd8afed31be6db)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:05.536636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa59ad7-aa39-41b8-b60e-35769a5a9991 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:05.615755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6fa59ad7-aa39-41b8-b60e-35769a5a9991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60034ccb062d419786fd8afed31be6db', 'request_id': 'req-6fa59ad7-aa39-41b8-b60e-35769a5a9991'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:05.623722 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6fa59ad7-aa39-41b8-b60e-35769a5a9991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60034ccb062d419786fd8afed31be6db', 'request_id': 'req-6fa59ad7-aa39-41b8-b60e-35769a5a9991'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:05.632484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6fa59ad7-aa39-41b8-b60e-35769a5a9991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60034ccb062d419786fd8afed31be6db', 'request_id': 'req-6fa59ad7-aa39-41b8-b60e-35769a5a9991'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:05.646060 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6fa59ad7-aa39-41b8-b60e-35769a5a9991 admin admin] The token cache is being invalidate because project 60034ccb062d419786fd8afed31be6db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:05.646351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6fa59ad7-aa39-41b8-b60e-35769a5a9991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:05.647008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6fa59ad7-aa39-41b8-b60e-35769a5a9991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:05.648551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1220/2454] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:05 2022] DELETE /identity/v3/projects/60034ccb062d419786fd8afed31be6db => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:05.652668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265b226-9fee-4a6a-9f6c-6ae0afc9c635 service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:05.664544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265b226-9fee-4a6a-9f6c-6ae0afc9c635 service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:05.696463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:05.734545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37bbfe-07d9-4b59-8552-c102532961bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:05.735182 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37bbfe-07d9-4b59-8552-c102532961bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:05.735465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37bbfe-07d9-4b59-8552-c102532961bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:05.735740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37bbfe-07d9-4b59-8552-c102532961bf admin admin] PATH_INFO: `/v3/users/f3694fc9b88b43c79822c954cf87aa59` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:05.736856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37bbfe-07d9-4b59-8552-c102532961bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3694fc9b88b43c79822c954cf87aa59)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:05.739497 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37bbfe-07d9-4b59-8552-c102532961bf admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:05.798885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ae37bbfe-07d9-4b59-8552-c102532961bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3694fc9b88b43c79822c954cf87aa59'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:05.806468 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ae37bbfe-07d9-4b59-8552-c102532961bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3694fc9b88b43c79822c954cf87aa59'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:05.807152 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ae37bbfe-07d9-4b59-8552-c102532961bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3694fc9b88b43c79822c954cf87aa59'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:05.815377 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ae37bbfe-07d9-4b59-8552-c102532961bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3694fc9b88b43c79822c954cf87aa59'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:05.833369 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ae37bbfe-07d9-4b59-8552-c102532961bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3694fc9b88b43c79822c954cf87aa59'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:05.840425 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1235/2455] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:05 2022] DELETE /identity/v3/users/f3694fc9b88b43c79822c954cf87aa59 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:06.194051 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa59ad7-aa39-41b8-b60e-35769a5a9991 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:06.195610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-6fa59ad7-aa39-41b8-b60e-35769a5a9991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:06.217399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa59ad7-aa39-41b8-b60e-35769a5a9991 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:06.304006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223ab0c-645a-4467-9a3c-5d2a328dd81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:06.305320 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ab0c-645a-4467-9a3c-5d2a328dd81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:06.306037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ab0c-645a-4467-9a3c-5d2a328dd81e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:06.306569 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ab0c-645a-4467-9a3c-5d2a328dd81e admin admin] PATH_INFO: `/v3/projects/69db8238cb494a8ba760ddad4e75dc5c` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:06.308382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223ab0c-645a-4467-9a3c-5d2a328dd81e admin admin] RBAC: Authorizing `identity:delete_project(project_id=69db8238cb494a8ba760ddad4e75dc5c)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:06.311765 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223ab0c-645a-4467-9a3c-5d2a328dd81e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:06.353990 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:06.383614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c223ab0c-645a-4467-9a3c-5d2a328dd81e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69db8238cb494a8ba760ddad4e75dc5c', 'request_id': 'req-c223ab0c-645a-4467-9a3c-5d2a328dd81e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:06.390200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c223ab0c-645a-4467-9a3c-5d2a328dd81e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69db8238cb494a8ba760ddad4e75dc5c', 'request_id': 'req-c223ab0c-645a-4467-9a3c-5d2a328dd81e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:06.400790 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c223ab0c-645a-4467-9a3c-5d2a328dd81e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69db8238cb494a8ba760ddad4e75dc5c', 'request_id': 'req-c223ab0c-645a-4467-9a3c-5d2a328dd81e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:06.413744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c223ab0c-645a-4467-9a3c-5d2a328dd81e admin admin] The token cache is being invalidate because project 69db8238cb494a8ba760ddad4e75dc5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:06.414067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c223ab0c-645a-4467-9a3c-5d2a328dd81e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:06.414703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c223ab0c-645a-4467-9a3c-5d2a328dd81e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:06.416364 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1221/2456] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:06 2022] DELETE /identity/v3/projects/69db8238cb494a8ba760ddad4e75dc5c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:06.423243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27676f-0943-4f9b-bb40-2ed57030d8b8 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:06.423728 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27676f-0943-4f9b-bb40-2ed57030d8b8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:06.424204 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27676f-0943-4f9b-bb40-2ed57030d8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:06.453162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-9a27676f-0943-4f9b-bb40-2ed57030d8b8 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:06.454386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-9a27676f-0943-4f9b-bb40-2ed57030d8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:06.523066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1236/2457] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:06.530713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e042c1-21bf-431f-9e3e-9e41bbf89d36 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:06.531004 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e042c1-21bf-431f-9e3e-9e41bbf89d36 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:06.531286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e042c1-21bf-431f-9e3e-9e41bbf89d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:06.570098 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-65e042c1-21bf-431f-9e3e-9e41bbf89d36 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:06.571642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-65e042c1-21bf-431f-9e3e-9e41bbf89d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:06.581898 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1222/2458] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:02:06.585989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27676f-0943-4f9b-bb40-2ed57030d8b8 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:06.598990 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27676f-0943-4f9b-bb40-2ed57030d8b8 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:06.604685 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07360546-df0a-4981-835a-fcbab4db4f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:06.605310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07360546-df0a-4981-835a-fcbab4db4f5e admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:06.605510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07360546-df0a-4981-835a-fcbab4db4f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:06.605844 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07360546-df0a-4981-835a-fcbab4db4f5e admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:06.606531 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07360546-df0a-4981-835a-fcbab4db4f5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:02:06.606874 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07360546-df0a-4981-835a-fcbab4db4f5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:06.609094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07360546-df0a-4981-835a-fcbab4db4f5e admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:06.634713 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1237/2459] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:02:06.635233 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e042c1-21bf-431f-9e3e-9e41bbf89d36 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:06.647260 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e042c1-21bf-431f-9e3e-9e41bbf89d36 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:06.652951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b988e-e2fb-4627-b70a-c62b726b24b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:06.653883 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b988e-e2fb-4627-b70a-c62b726b24b9 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:06.654235 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b988e-e2fb-4627-b70a-c62b726b24b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:06.656885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b988e-e2fb-4627-b70a-c62b726b24b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:06.656885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b988e-e2fb-4627-b70a-c62b726b24b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:06.658380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b988e-e2fb-4627-b70a-c62b726b24b9 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:06.722051 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1223/2460] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:06 2022] POST /identity/v3/projects => generated 357 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:06.727500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07360546-df0a-4981-835a-fcbab4db4f5e admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:06.757786 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07360546-df0a-4981-835a-fcbab4db4f5e admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:06.815160 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:06.852830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e296b19-01d9-41b0-9bf6-5be2a8b01bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:06.854328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e296b19-01d9-41b0-9bf6-5be2a8b01bbf admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:06.854328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e296b19-01d9-41b0-9bf6-5be2a8b01bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:06.855560 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e296b19-01d9-41b0-9bf6-5be2a8b01bbf admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:06.856690 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e296b19-01d9-41b0-9bf6-5be2a8b01bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:06.860089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e296b19-01d9-41b0-9bf6-5be2a8b01bbf admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:06.890771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1238/2461] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:06 2022] POST /identity/v3/users => generated 279 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:06.892182 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b988e-e2fb-4627-b70a-c62b726b24b9 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:06.904056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b988e-e2fb-4627-b70a-c62b726b24b9 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:06.909652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a641f-10e4-42e3-9ed2-1e8c22094942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:06.910282 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a641f-10e4-42e3-9ed2-1e8c22094942 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:06.910572 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a641f-10e4-42e3-9ed2-1e8c22094942 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:06.910874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a641f-10e4-42e3-9ed2-1e8c22094942 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:06.911528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a641f-10e4-42e3-9ed2-1e8c22094942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:06.913242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a641f-10e4-42e3-9ed2-1e8c22094942 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:06.927828 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1224/2462] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:06.933533 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e296b19-01d9-41b0-9bf6-5be2a8b01bbf admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:06.944986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e296b19-01d9-41b0-9bf6-5be2a8b01bbf admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:06.949837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1e759-ce8a-4f58-9bea-2ebb20697f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:06.950436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1e759-ce8a-4f58-9bea-2ebb20697f10 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:06.950715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1e759-ce8a-4f58-9bea-2ebb20697f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:06.950988 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1e759-ce8a-4f58-9bea-2ebb20697f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:06.951657 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1e759-ce8a-4f58-9bea-2ebb20697f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:06.953287 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1e759-ce8a-4f58-9bea-2ebb20697f10 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:06.966560 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1239/2463] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:06.971857 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a641f-10e4-42e3-9ed2-1e8c22094942 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:06.985947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a641f-10e4-42e3-9ed2-1e8c22094942 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:06.993981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ddb27-cdbb-40ef-ba18-37ab71e6dad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:06.995632 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ddb27-cdbb-40ef-ba18-37ab71e6dad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:06.996397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ddb27-cdbb-40ef-ba18-37ab71e6dad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:06.997504 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ddb27-cdbb-40ef-ba18-37ab71e6dad5 admin admin] PATH_INFO: `/v3/projects/ff7a2a854e0e40528a66d09652df11b6/users/f31643b12de04beebe8299a74757bbcc/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:07.017907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ddb27-cdbb-40ef-ba18-37ab71e6dad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7a2a854e0e40528a66d09652df11b6, user_id=f31643b12de04beebe8299a74757bbcc, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:07.020586 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ddb27-cdbb-40ef-ba18-37ab71e6dad5 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:07.039552 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1225/2464] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:06 2022] PUT /identity/v3/projects/ff7a2a854e0e40528a66d09652df11b6/users/f31643b12de04beebe8299a74757bbcc/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:07.053169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f574deb-7815-406e-b82a-02116ca8d931 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:07.053469 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f574deb-7815-406e-b82a-02116ca8d931 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:07.053755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f574deb-7815-406e-b82a-02116ca8d931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:07.090140 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-8f574deb-7815-406e-b82a-02116ca8d931 None None] MFA Rules not processed for user `f31643b12de04beebe8299a74757bbcc`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:07.091328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-8f574deb-7815-406e-b82a-02116ca8d931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:07.165366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1240/2465] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:07.170165 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ddb27-cdbb-40ef-ba18-37ab71e6dad5 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:07.252091 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ddb27-cdbb-40ef-ba18-37ab71e6dad5 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:07.260177 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e040f2-1076-4c90-893d-443eed4c88c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:07.261351 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e040f2-1076-4c90-893d-443eed4c88c2 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:07.261863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e040f2-1076-4c90-893d-443eed4c88c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:07.262397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e040f2-1076-4c90-893d-443eed4c88c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:07.263442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e040f2-1076-4c90-893d-443eed4c88c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:07.266971 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e040f2-1076-4c90-893d-443eed4c88c2 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:07.299955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1226/2466] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:07 2022] POST /identity/v3/projects => generated 355 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:02:07.304836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f574deb-7815-406e-b82a-02116ca8d931 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:07.317698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f574deb-7815-406e-b82a-02116ca8d931 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:07.400518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de069a78-1f62-49e7-b0d8-09eabd0f25e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:07.401713 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de069a78-1f62-49e7-b0d8-09eabd0f25e5 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:07.402000 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de069a78-1f62-49e7-b0d8-09eabd0f25e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:07.402412 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de069a78-1f62-49e7-b0d8-09eabd0f25e5 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:07.403444 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de069a78-1f62-49e7-b0d8-09eabd0f25e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:07.405859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de069a78-1f62-49e7-b0d8-09eabd0f25e5 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:07.434591 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1241/2467] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:07 2022] POST /identity/v3/users => generated 284 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:07.439591 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e040f2-1076-4c90-893d-443eed4c88c2 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:07.455113 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e040f2-1076-4c90-893d-443eed4c88c2 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:07.461223 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61d25f-3d93-40d1-80d1-90ce0825a76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:07.462222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61d25f-3d93-40d1-80d1-90ce0825a76d admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:07.462708 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61d25f-3d93-40d1-80d1-90ce0825a76d admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:07.463173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61d25f-3d93-40d1-80d1-90ce0825a76d admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:07.464155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61d25f-3d93-40d1-80d1-90ce0825a76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:07.466557 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61d25f-3d93-40d1-80d1-90ce0825a76d admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:07.487443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1227/2468] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:07.492891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de069a78-1f62-49e7-b0d8-09eabd0f25e5 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:07.506086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de069a78-1f62-49e7-b0d8-09eabd0f25e5 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:07.511582 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc86d1-6c09-476d-8d8a-71459e271f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:07.512266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc86d1-6c09-476d-8d8a-71459e271f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:07.512548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc86d1-6c09-476d-8d8a-71459e271f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:07.512823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc86d1-6c09-476d-8d8a-71459e271f31 admin admin] PATH_INFO: `/v3/projects/aea4a71377e24002b3cbfef114f5cf7a/users/75487a8209c24f0ab17fa6294c4c15d4/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:07.538190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc86d1-6c09-476d-8d8a-71459e271f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea4a71377e24002b3cbfef114f5cf7a, user_id=75487a8209c24f0ab17fa6294c4c15d4, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:07.542796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc86d1-6c09-476d-8d8a-71459e271f31 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:07.561904 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1242/2469] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:07 2022] PUT /identity/v3/projects/aea4a71377e24002b3cbfef114f5cf7a/users/75487a8209c24f0ab17fa6294c4c15d4/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:07.566460 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61d25f-3d93-40d1-80d1-90ce0825a76d admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:07.585334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61d25f-3d93-40d1-80d1-90ce0825a76d admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:07.626029 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:07.678249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c032c-722e-414d-af82-6d79f30b647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:07.679306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c032c-722e-414d-af82-6d79f30b647b admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:07.679856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c032c-722e-414d-af82-6d79f30b647b admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:07.680336 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c032c-722e-414d-af82-6d79f30b647b admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:07.681789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c032c-722e-414d-af82-6d79f30b647b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:07.684374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c032c-722e-414d-af82-6d79f30b647b admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:07.702401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1228/2470] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:07.708094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc86d1-6c09-476d-8d8a-71459e271f31 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:07.723864 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc86d1-6c09-476d-8d8a-71459e271f31 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:07.732250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47875fcb-6ae8-4d22-88e0-e1c6d3e7989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:07.733622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47875fcb-6ae8-4d22-88e0-e1c6d3e7989a admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:07.733929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47875fcb-6ae8-4d22-88e0-e1c6d3e7989a admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:07.734406 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47875fcb-6ae8-4d22-88e0-e1c6d3e7989a admin admin] PATH_INFO: `/v3/projects/aea4a71377e24002b3cbfef114f5cf7a/users/75487a8209c24f0ab17fa6294c4c15d4/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:07.736147 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47875fcb-6ae8-4d22-88e0-e1c6d3e7989a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea4a71377e24002b3cbfef114f5cf7a, user_id=75487a8209c24f0ab17fa6294c4c15d4, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:07.738896 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47875fcb-6ae8-4d22-88e0-e1c6d3e7989a admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:07.741594 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:07.758424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1243/2471] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:07 2022] PUT /identity/v3/projects/aea4a71377e24002b3cbfef114f5cf7a/users/75487a8209c24f0ab17fa6294c4c15d4/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:07.776161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203b754-c162-48aa-8f42-b663bbeff5ef None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:07.776672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203b754-c162-48aa-8f42-b663bbeff5ef None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:07.776826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203b754-c162-48aa-8f42-b663bbeff5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:07.819963 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-d203b754-c162-48aa-8f42-b663bbeff5ef None None] MFA Rules not processed for user `75487a8209c24f0ab17fa6294c4c15d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:07.821425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d203b754-c162-48aa-8f42-b663bbeff5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:07.987594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1229/2472] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:08.000206 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47875fcb-6ae8-4d22-88e0-e1c6d3e7989a admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:08.002171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-47875fcb-6ae8-4d22-88e0-e1c6d3e7989a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:08.124724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47875fcb-6ae8-4d22-88e0-e1c6d3e7989a admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:08.157070 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cd7a3-d7ce-452f-9b69-0652c3c24a6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:08.158104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cd7a3-d7ce-452f-9b69-0652c3c24a6e service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:08.158641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cd7a3-d7ce-452f-9b69-0652c3c24a6e service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:08.159016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cd7a3-d7ce-452f-9b69-0652c3c24a6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:08.176181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cd7a3-d7ce-452f-9b69-0652c3c24a6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:08.178395 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cd7a3-d7ce-452f-9b69-0652c3c24a6e service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:08.202869 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1244/2473] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 09:02:08.319152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203b754-c162-48aa-8f42-b663bbeff5ef None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:08.330609 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203b754-c162-48aa-8f42-b663bbeff5ef None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:08.335105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f464c-47da-4053-b4c4-603e68f930ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:08.335879 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f464c-47da-4053-b4c4-603e68f930ee service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:08.336248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f464c-47da-4053-b4c4-603e68f930ee service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:08.336495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f464c-47da-4053-b4c4-603e68f930ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:08.439588 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f464c-47da-4053-b4c4-603e68f930ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:08.441463 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f464c-47da-4053-b4c4-603e68f930ee service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:08.471412 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1230/2474] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:18.188901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:18.451382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=77 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:24.014500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a991955-5612-4a19-a668-75808bb11b16 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:24.014998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a991955-5612-4a19-a668-75808bb11b16 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:24.015092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a991955-5612-4a19-a668-75808bb11b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:24.081771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-6a991955-5612-4a19-a668-75808bb11b16 None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:24.083100 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6a991955-5612-4a19-a668-75808bb11b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:24.164835 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1245/2475] 10.222.0.76 () {58 vars in 967 bytes} [Fri Aug 26 09:02:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:24.179168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f464c-47da-4053-b4c4-603e68f930ee service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:24.180657 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1f4f464c-47da-4053-b4c4-603e68f930ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:24.224055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a991955-5612-4a19-a668-75808bb11b16 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:24.281975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f464c-47da-4053-b4c4-603e68f930ee service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:24.287465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b1fda-d745-4e2f-a6a3-30e86404f394 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:24.288083 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b1fda-d745-4e2f-a6a3-30e86404f394 service swift] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:24.288365 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b1fda-d745-4e2f-a6a3-30e86404f394 service swift] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:24.288646 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b1fda-d745-4e2f-a6a3-30e86404f394 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:24.293521 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a991955-5612-4a19-a668-75808bb11b16 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:24.297954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b1fda-d745-4e2f-a6a3-30e86404f394 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:24.298768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670fde0-b95c-4587-a34d-c3845f7f960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:24.299399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670fde0-b95c-4587-a34d-c3845f7f960b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:24.299538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b1fda-d745-4e2f-a6a3-30e86404f394 service swift] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:24.299683 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670fde0-b95c-4587-a34d-c3845f7f960b admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:24.299961 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670fde0-b95c-4587-a34d-c3845f7f960b admin admin] PATH_INFO: `/v3/users/f31643b12de04beebe8299a74757bbcc` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:24.301128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670fde0-b95c-4587-a34d-c3845f7f960b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31643b12de04beebe8299a74757bbcc)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:24.303079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670fde0-b95c-4587-a34d-c3845f7f960b admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:24.308205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1231/2476] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 09:02:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 09:02:24.352362 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-4670fde0-b95c-4587-a34d-c3845f7f960b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31643b12de04beebe8299a74757bbcc'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:24.361111 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-4670fde0-b95c-4587-a34d-c3845f7f960b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31643b12de04beebe8299a74757bbcc'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:24.361729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-4670fde0-b95c-4587-a34d-c3845f7f960b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31643b12de04beebe8299a74757bbcc'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:24.369971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-4670fde0-b95c-4587-a34d-c3845f7f960b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31643b12de04beebe8299a74757bbcc'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:24.379417 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:24.385120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-4670fde0-b95c-4587-a34d-c3845f7f960b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31643b12de04beebe8299a74757bbcc'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:24.392518 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1246/2477] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:24 2022] DELETE /identity/v3/users/f31643b12de04beebe8299a74757bbcc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:24.397095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06e14a-fb4b-4c4b-a277-fd571e4759cc None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:24.397391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06e14a-fb4b-4c4b-a277-fd571e4759cc None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:24.397705 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06e14a-fb4b-4c4b-a277-fd571e4759cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:24.418858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-fa06e14a-fb4b-4c4b-a277-fd571e4759cc None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:24.420686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-fa06e14a-fb4b-4c4b-a277-fd571e4759cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:24.496112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1232/2478] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:24.503287 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670fde0-b95c-4587-a34d-c3845f7f960b admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:24.504887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4670fde0-b95c-4587-a34d-c3845f7f960b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:24.571995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670fde0-b95c-4587-a34d-c3845f7f960b admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:24.587588 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae48ed-afdd-44a9-9d86-7f9aac236f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:24.587588 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae48ed-afdd-44a9-9d86-7f9aac236f5d service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:24.587588 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae48ed-afdd-44a9-9d86-7f9aac236f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:24.587588 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae48ed-afdd-44a9-9d86-7f9aac236f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:24.602947 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae48ed-afdd-44a9-9d86-7f9aac236f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:24.605541 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae48ed-afdd-44a9-9d86-7f9aac236f5d service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:24.622288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1247/2479] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:24.911587 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06e14a-fb4b-4c4b-a277-fd571e4759cc None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:24.913367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-fa06e14a-fb4b-4c4b-a277-fd571e4759cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:24.927446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06e14a-fb4b-4c4b-a277-fd571e4759cc None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:24.935021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b4375-a6b7-49d2-ac85-863e0e10d411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:24.935825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b4375-a6b7-49d2-ac85-863e0e10d411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:24.936216 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b4375-a6b7-49d2-ac85-863e0e10d411 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:24.936867 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b4375-a6b7-49d2-ac85-863e0e10d411 admin admin] PATH_INFO: `/v3/projects/ff7a2a854e0e40528a66d09652df11b6` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:24.938374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b4375-a6b7-49d2-ac85-863e0e10d411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff7a2a854e0e40528a66d09652df11b6)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:24.940564 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b4375-a6b7-49d2-ac85-863e0e10d411 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:24.993817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-3d0b4375-a6b7-49d2-ac85-863e0e10d411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff7a2a854e0e40528a66d09652df11b6', 'request_id': 'req-3d0b4375-a6b7-49d2-ac85-863e0e10d411'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:25.000551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-3d0b4375-a6b7-49d2-ac85-863e0e10d411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff7a2a854e0e40528a66d09652df11b6', 'request_id': 'req-3d0b4375-a6b7-49d2-ac85-863e0e10d411'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:25.008188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-3d0b4375-a6b7-49d2-ac85-863e0e10d411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff7a2a854e0e40528a66d09652df11b6', 'request_id': 'req-3d0b4375-a6b7-49d2-ac85-863e0e10d411'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:25.012181 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:25.021756 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-3d0b4375-a6b7-49d2-ac85-863e0e10d411 admin admin] The token cache is being invalidate because project ff7a2a854e0e40528a66d09652df11b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:25.022169 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-3d0b4375-a6b7-49d2-ac85-863e0e10d411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:25.022990 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-3d0b4375-a6b7-49d2-ac85-863e0e10d411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:25.024478 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1233/2480] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:24 2022] DELETE /identity/v3/projects/ff7a2a854e0e40528a66d09652df11b6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:25.028756 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae48ed-afdd-44a9-9d86-7f9aac236f5d service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:25.039140 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae48ed-afdd-44a9-9d86-7f9aac236f5d service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:25.099373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399d01b-b38a-4f0a-894e-f48fdb12bafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:25.100002 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399d01b-b38a-4f0a-894e-f48fdb12bafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:25.100281 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399d01b-b38a-4f0a-894e-f48fdb12bafa admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:25.100557 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399d01b-b38a-4f0a-894e-f48fdb12bafa admin admin] PATH_INFO: `/v3/users/75487a8209c24f0ab17fa6294c4c15d4` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:25.101680 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399d01b-b38a-4f0a-894e-f48fdb12bafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=75487a8209c24f0ab17fa6294c4c15d4)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:25.103674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399d01b-b38a-4f0a-894e-f48fdb12bafa admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:25.157103 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5399d01b-b38a-4f0a-894e-f48fdb12bafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75487a8209c24f0ab17fa6294c4c15d4'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:25.165313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5399d01b-b38a-4f0a-894e-f48fdb12bafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75487a8209c24f0ab17fa6294c4c15d4'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:25.165978 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5399d01b-b38a-4f0a-894e-f48fdb12bafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75487a8209c24f0ab17fa6294c4c15d4'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:25.173617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5399d01b-b38a-4f0a-894e-f48fdb12bafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75487a8209c24f0ab17fa6294c4c15d4'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:25.188502 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5399d01b-b38a-4f0a-894e-f48fdb12bafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75487a8209c24f0ab17fa6294c4c15d4'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:25.198221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1248/2481] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:25 2022] DELETE /identity/v3/users/75487a8209c24f0ab17fa6294c4c15d4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:25.535597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b4375-a6b7-49d2-ac85-863e0e10d411 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:25.537773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3d0b4375-a6b7-49d2-ac85-863e0e10d411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:25.556000 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b4375-a6b7-49d2-ac85-863e0e10d411 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:25.628528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a279cf0-8604-4495-a6e7-ff99499c09b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:25.629121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a279cf0-8604-4495-a6e7-ff99499c09b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:25.629406 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a279cf0-8604-4495-a6e7-ff99499c09b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:25.629681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a279cf0-8604-4495-a6e7-ff99499c09b2 admin admin] PATH_INFO: `/v3/projects/aea4a71377e24002b3cbfef114f5cf7a` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:25.630857 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a279cf0-8604-4495-a6e7-ff99499c09b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea4a71377e24002b3cbfef114f5cf7a)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:25.632841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a279cf0-8604-4495-a6e7-ff99499c09b2 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:25.682482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-9a279cf0-8604-4495-a6e7-ff99499c09b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea4a71377e24002b3cbfef114f5cf7a', 'request_id': 'req-9a279cf0-8604-4495-a6e7-ff99499c09b2'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:25.689695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-9a279cf0-8604-4495-a6e7-ff99499c09b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea4a71377e24002b3cbfef114f5cf7a', 'request_id': 'req-9a279cf0-8604-4495-a6e7-ff99499c09b2'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:25.696894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-9a279cf0-8604-4495-a6e7-ff99499c09b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea4a71377e24002b3cbfef114f5cf7a', 'request_id': 'req-9a279cf0-8604-4495-a6e7-ff99499c09b2'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:25.708214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-9a279cf0-8604-4495-a6e7-ff99499c09b2 admin admin] The token cache is being invalidate because project aea4a71377e24002b3cbfef114f5cf7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:25.708504 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-9a279cf0-8604-4495-a6e7-ff99499c09b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:25.709163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-9a279cf0-8604-4495-a6e7-ff99499c09b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:25.710656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1234/2482] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:25 2022] DELETE /identity/v3/projects/aea4a71377e24002b3cbfef114f5cf7a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:25.715667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13859cfa-7adc-40e8-88e6-06f2dc859e92 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:25.715956 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13859cfa-7adc-40e8-88e6-06f2dc859e92 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:25.716232 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13859cfa-7adc-40e8-88e6-06f2dc859e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:25.737759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-13859cfa-7adc-40e8-88e6-06f2dc859e92 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:25.738987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-13859cfa-7adc-40e8-88e6-06f2dc859e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:25.747230 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:25.799403 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1249/2483] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:25.807473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3d6cf-e26d-4ba2-a2a2-c16a6fb3222c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:25.807764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3d6cf-e26d-4ba2-a2a2-c16a6fb3222c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:25.808042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3d6cf-e26d-4ba2-a2a2-c16a6fb3222c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:25.828023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-97e3d6cf-e26d-4ba2-a2a2-c16a6fb3222c None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:25.829286 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-97e3d6cf-e26d-4ba2-a2a2-c16a6fb3222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:25.837440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1235/2484] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:25.841690 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13859cfa-7adc-40e8-88e6-06f2dc859e92 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:25.852352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13859cfa-7adc-40e8-88e6-06f2dc859e92 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:25.857673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6730bfb-602c-441a-bff9-fd9901d4b5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:25.858263 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6730bfb-602c-441a-bff9-fd9901d4b5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:25.858547 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6730bfb-602c-441a-bff9-fd9901d4b5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:25.858836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6730bfb-602c-441a-bff9-fd9901d4b5e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:25.859513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6730bfb-602c-441a-bff9-fd9901d4b5e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:02:25.859819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6730bfb-602c-441a-bff9-fd9901d4b5e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:25.861555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6730bfb-602c-441a-bff9-fd9901d4b5e4 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:25.874025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1250/2485] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:02:25.878374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3d6cf-e26d-4ba2-a2a2-c16a6fb3222c None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:25.887743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3d6cf-e26d-4ba2-a2a2-c16a6fb3222c None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:25.892371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26174d94-2256-4b8d-831f-37e8bb2ab1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:25.892972 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26174d94-2256-4b8d-831f-37e8bb2ab1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:25.893285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26174d94-2256-4b8d-831f-37e8bb2ab1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:25.893562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26174d94-2256-4b8d-831f-37e8bb2ab1c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:25.894195 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26174d94-2256-4b8d-831f-37e8bb2ab1c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:25.896093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26174d94-2256-4b8d-831f-37e8bb2ab1c4 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:25.926933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1236/2486] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:25 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:25.928083 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6730bfb-602c-441a-bff9-fd9901d4b5e4 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:25.938727 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6730bfb-602c-441a-bff9-fd9901d4b5e4 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:25.997539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb63b-0fba-451a-aca4-1e00b2adb5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:25.999089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb63b-0fba-451a-aca4-1e00b2adb5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:25.999534 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb63b-0fba-451a-aca4-1e00b2adb5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:25.999971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb63b-0fba-451a-aca4-1e00b2adb5d1 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:26.000806 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cb63b-0fba-451a-aca4-1e00b2adb5d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:26.003208 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cb63b-0fba-451a-aca4-1e00b2adb5d1 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:26.032219 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1251/2487] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:25 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:02:26.036374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26174d94-2256-4b8d-831f-37e8bb2ab1c4 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:26.047749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26174d94-2256-4b8d-831f-37e8bb2ab1c4 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:26.054448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495b405-683b-4c22-a568-cc5d83d6e4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:26.056079 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495b405-683b-4c22-a568-cc5d83d6e4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:26.056442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495b405-683b-4c22-a568-cc5d83d6e4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:26.056790 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495b405-683b-4c22-a568-cc5d83d6e4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:26.057683 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495b405-683b-4c22-a568-cc5d83d6e4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:26.060784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495b405-683b-4c22-a568-cc5d83d6e4d7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:26.073797 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1237/2488] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:26.077434 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb63b-0fba-451a-aca4-1e00b2adb5d1 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:26.088455 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb63b-0fba-451a-aca4-1e00b2adb5d1 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:26.093680 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62bc0b-7762-41d3-bd89-d6d4dd62435f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:26.094293 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62bc0b-7762-41d3-bd89-d6d4dd62435f admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:26.094577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62bc0b-7762-41d3-bd89-d6d4dd62435f admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:26.095051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62bc0b-7762-41d3-bd89-d6d4dd62435f admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:26.095860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62bc0b-7762-41d3-bd89-d6d4dd62435f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:26.097767 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62bc0b-7762-41d3-bd89-d6d4dd62435f admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:26.112310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1252/2489] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:26.116681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495b405-683b-4c22-a568-cc5d83d6e4d7 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:26.129041 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495b405-683b-4c22-a568-cc5d83d6e4d7 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:26.134785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e26041-7d2e-47c6-977e-29cc9a9fa0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:26.135457 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e26041-7d2e-47c6-977e-29cc9a9fa0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:26.135800 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e26041-7d2e-47c6-977e-29cc9a9fa0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:26.136064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e26041-7d2e-47c6-977e-29cc9a9fa0eb admin admin] PATH_INFO: `/v3/projects/4f2c3fa39d5448e994206838c091c465/users/6abad89335c8419bbb857336dc3ffdf1/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:26.155987 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e26041-7d2e-47c6-977e-29cc9a9fa0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2c3fa39d5448e994206838c091c465, user_id=6abad89335c8419bbb857336dc3ffdf1, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:26.158743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e26041-7d2e-47c6-977e-29cc9a9fa0eb admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:26.175461 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1238/2490] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:26 2022] PUT /identity/v3/projects/4f2c3fa39d5448e994206838c091c465/users/6abad89335c8419bbb857336dc3ffdf1/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:26.188420 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c94d25-243a-471b-8ada-aa6a61598ae0 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:26.188717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c94d25-243a-471b-8ada-aa6a61598ae0 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:26.189050 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c94d25-243a-471b-8ada-aa6a61598ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:26.218981 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-30c94d25-243a-471b-8ada-aa6a61598ae0 None None] MFA Rules not processed for user `6abad89335c8419bbb857336dc3ffdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:26.220435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-30c94d25-243a-471b-8ada-aa6a61598ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:26.287770 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1253/2491] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:26.292333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e26041-7d2e-47c6-977e-29cc9a9fa0eb admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:26.315333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:26.365697 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e26041-7d2e-47c6-977e-29cc9a9fa0eb admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:26.373087 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99c226-5cc3-40e5-a4e2-150a646c8b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:26.374071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99c226-5cc3-40e5-a4e2-150a646c8b04 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:26.374071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99c226-5cc3-40e5-a4e2-150a646c8b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:26.374277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99c226-5cc3-40e5-a4e2-150a646c8b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:26.374821 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99c226-5cc3-40e5-a4e2-150a646c8b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:26.376741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99c226-5cc3-40e5-a4e2-150a646c8b04 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:26.408454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1239/2492] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:26 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:26.412935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c94d25-243a-471b-8ada-aa6a61598ae0 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:26.425605 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c94d25-243a-471b-8ada-aa6a61598ae0 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:26.432865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:26.501638 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aea8d4-951f-469b-83e0-fe16dbcdec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:26.502249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aea8d4-951f-469b-83e0-fe16dbcdec35 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:26.502529 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aea8d4-951f-469b-83e0-fe16dbcdec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:26.502807 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aea8d4-951f-469b-83e0-fe16dbcdec35 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:26.503574 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aea8d4-951f-469b-83e0-fe16dbcdec35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:26.505513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aea8d4-951f-469b-83e0-fe16dbcdec35 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:26.529448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1254/2493] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:26 2022] POST /identity/v3/users => generated 296 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:02:26.533114 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99c226-5cc3-40e5-a4e2-150a646c8b04 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:26.544074 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99c226-5cc3-40e5-a4e2-150a646c8b04 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:26.548823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5c71d-d94d-49b9-af8d-e247bc2f74b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:26.549521 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5c71d-d94d-49b9-af8d-e247bc2f74b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:26.549809 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5c71d-d94d-49b9-af8d-e247bc2f74b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:26.550081 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5c71d-d94d-49b9-af8d-e247bc2f74b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:26.550728 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5c71d-d94d-49b9-af8d-e247bc2f74b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:26.552313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5c71d-d94d-49b9-af8d-e247bc2f74b7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:26.563333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1240/2494] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:26.567530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aea8d4-951f-469b-83e0-fe16dbcdec35 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:26.583771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aea8d4-951f-469b-83e0-fe16dbcdec35 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:26.589621 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae23ce2-4e34-4ce6-b1f1-ec6d65488979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:26.590382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae23ce2-4e34-4ce6-b1f1-ec6d65488979 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:26.590740 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae23ce2-4e34-4ce6-b1f1-ec6d65488979 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:26.591085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae23ce2-4e34-4ce6-b1f1-ec6d65488979 admin admin] PATH_INFO: `/v3/projects/2b6c9dd237d14f018416c6920a71a0b0/users/eda51fdc07084ef1bdcbd9e80e4bd826/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:26.607766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae23ce2-4e34-4ce6-b1f1-ec6d65488979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6c9dd237d14f018416c6920a71a0b0, user_id=eda51fdc07084ef1bdcbd9e80e4bd826, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:26.611146 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae23ce2-4e34-4ce6-b1f1-ec6d65488979 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:26.628234 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1255/2495] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:26 2022] PUT /identity/v3/projects/2b6c9dd237d14f018416c6920a71a0b0/users/eda51fdc07084ef1bdcbd9e80e4bd826/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:26.632205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5c71d-d94d-49b9-af8d-e247bc2f74b7 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:26.646974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5c71d-d94d-49b9-af8d-e247bc2f74b7 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:26.708070 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089d5d8-c90a-4092-8485-46d61c40a9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:26.708720 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089d5d8-c90a-4092-8485-46d61c40a9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:26.709022 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089d5d8-c90a-4092-8485-46d61c40a9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:26.709319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089d5d8-c90a-4092-8485-46d61c40a9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:26.709967 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089d5d8-c90a-4092-8485-46d61c40a9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:26.711620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089d5d8-c90a-4092-8485-46d61c40a9c2 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:26.722925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1241/2496] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:26.727430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae23ce2-4e34-4ce6-b1f1-ec6d65488979 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:26.738854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae23ce2-4e34-4ce6-b1f1-ec6d65488979 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:26.743798 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd57a21-fda2-4115-947b-9a10f93c74c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:26.744585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd57a21-fda2-4115-947b-9a10f93c74c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:26.744873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd57a21-fda2-4115-947b-9a10f93c74c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:26.745190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd57a21-fda2-4115-947b-9a10f93c74c0 admin admin] PATH_INFO: `/v3/projects/2b6c9dd237d14f018416c6920a71a0b0/users/eda51fdc07084ef1bdcbd9e80e4bd826/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:26.747108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd57a21-fda2-4115-947b-9a10f93c74c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6c9dd237d14f018416c6920a71a0b0, user_id=eda51fdc07084ef1bdcbd9e80e4bd826, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:26.749776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd57a21-fda2-4115-947b-9a10f93c74c0 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:26.760291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1256/2497] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:26 2022] PUT /identity/v3/projects/2b6c9dd237d14f018416c6920a71a0b0/users/eda51fdc07084ef1bdcbd9e80e4bd826/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:26.771155 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9d805-78a0-48ad-b555-f5cc7b6e2b6a None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:26.771536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9d805-78a0-48ad-b555-f5cc7b6e2b6a None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:26.771913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9d805-78a0-48ad-b555-f5cc7b6e2b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:26.802274 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-1fd9d805-78a0-48ad-b555-f5cc7b6e2b6a None None] MFA Rules not processed for user `eda51fdc07084ef1bdcbd9e80e4bd826`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:26.803622 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1fd9d805-78a0-48ad-b555-f5cc7b6e2b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:26.895977 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1242/2498] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:26.911747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd57a21-fda2-4115-947b-9a10f93c74c0 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:26.913527 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-8cd57a21-fda2-4115-947b-9a10f93c74c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:27.006276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd57a21-fda2-4115-947b-9a10f93c74c0 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:27.010263 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5885a9-5818-4e94-a903-42075b8122d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:27.010892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5885a9-5818-4e94-a903-42075b8122d0 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:27.011176 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5885a9-5818-4e94-a903-42075b8122d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:27.011452 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5885a9-5818-4e94-a903-42075b8122d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:27.024480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5885a9-5818-4e94-a903-42075b8122d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:27.026814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5885a9-5818-4e94-a903-42075b8122d0 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:27.040520 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1257/2499] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:27.410440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9d805-78a0-48ad-b555-f5cc7b6e2b6a None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:27.427712 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9d805-78a0-48ad-b555-f5cc7b6e2b6a None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:27.432152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd229d7-9eda-42d7-b06b-5ed05c5679d5 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda51fdc07084ef1bdcbd9e80e4bd826', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b6c9dd237d14f018416c6920a71a0b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:27.432891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd229d7-9eda-42d7-b06b-5ed05c5679d5 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:27.433314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd229d7-9eda-42d7-b06b-5ed05c5679d5 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:27.433695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd229d7-9eda-42d7-b06b-5ed05c5679d5 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:27.434462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd229d7-9eda-42d7-b06b-5ed05c5679d5 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:02:27.434841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd229d7-9eda-42d7-b06b-5ed05c5679d5 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:27.436516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd229d7-9eda-42d7-b06b-5ed05c5679d5 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:27.449935 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1243/2500] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:02:27.455955 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5885a9-5818-4e94-a903-42075b8122d0 service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:27.465540 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5885a9-5818-4e94-a903-42075b8122d0 service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:27.471511 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f8dec-29bd-453b-9632-d34893cc8f4b tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda51fdc07084ef1bdcbd9e80e4bd826', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b6c9dd237d14f018416c6920a71a0b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:27.472268 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f8dec-29bd-453b-9632-d34893cc8f4b tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:27.472624 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f8dec-29bd-453b-9632-d34893cc8f4b tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:27.472977 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f8dec-29bd-453b-9632-d34893cc8f4b tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:27.473721 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f8dec-29bd-453b-9632-d34893cc8f4b tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:27.475826 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f8dec-29bd-453b-9632-d34893cc8f4b tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:27.510227 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1258/2501] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:27 2022] POST /identity/v3/projects => generated 355 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:27.514757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd229d7-9eda-42d7-b06b-5ed05c5679d5 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:27.522786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:27.534894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd229d7-9eda-42d7-b06b-5ed05c5679d5 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:27.629904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b512aaf-9578-4a06-a9fb-540be331d882 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda51fdc07084ef1bdcbd9e80e4bd826', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b6c9dd237d14f018416c6920a71a0b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:27.630563 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b512aaf-9578-4a06-a9fb-540be331d882 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:27.630806 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b512aaf-9578-4a06-a9fb-540be331d882 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:27.631104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b512aaf-9578-4a06-a9fb-540be331d882 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:27.632332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b512aaf-9578-4a06-a9fb-540be331d882 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:02:27.632652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b512aaf-9578-4a06-a9fb-540be331d882 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:27.634301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b512aaf-9578-4a06-a9fb-540be331d882 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:27.650132 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1244/2502] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:02:27.688561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f8dec-29bd-453b-9632-d34893cc8f4b tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:27.699360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f8dec-29bd-453b-9632-d34893cc8f4b tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:27.704233 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e41a3-9913-49fa-8518-e66ba4a513fe tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda51fdc07084ef1bdcbd9e80e4bd826', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b6c9dd237d14f018416c6920a71a0b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:27.704865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e41a3-9913-49fa-8518-e66ba4a513fe tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:27.705181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e41a3-9913-49fa-8518-e66ba4a513fe tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:27.705457 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e41a3-9913-49fa-8518-e66ba4a513fe tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] PATH_INFO: `/v3/projects/dcba135c915e4c6fa831b868d333e8c1` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:27.706579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e41a3-9913-49fa-8518-e66ba4a513fe tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dcba135c915e4c6fa831b868d333e8c1)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:27.708506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e41a3-9913-49fa-8518-e66ba4a513fe tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:27.755569 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:27.766975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-433e41a3-9913-49fa-8518-e66ba4a513fe tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcba135c915e4c6fa831b868d333e8c1', 'request_id': 'req-433e41a3-9913-49fa-8518-e66ba4a513fe'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:27.774141 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-433e41a3-9913-49fa-8518-e66ba4a513fe tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcba135c915e4c6fa831b868d333e8c1', 'request_id': 'req-433e41a3-9913-49fa-8518-e66ba4a513fe'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:27.782246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-433e41a3-9913-49fa-8518-e66ba4a513fe tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcba135c915e4c6fa831b868d333e8c1', 'request_id': 'req-433e41a3-9913-49fa-8518-e66ba4a513fe'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:27.796516 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-433e41a3-9913-49fa-8518-e66ba4a513fe tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] The token cache is being invalidate because project dcba135c915e4c6fa831b868d333e8c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:27.796820 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-433e41a3-9913-49fa-8518-e66ba4a513fe tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:27.797555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-433e41a3-9913-49fa-8518-e66ba4a513fe tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:27.799059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1259/2503] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:27 2022] DELETE /identity/v3/projects/dcba135c915e4c6fa831b868d333e8c1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:28.002060 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b512aaf-9578-4a06-a9fb-540be331d882 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:28.003800 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5b512aaf-9578-4a06-a9fb-540be331d882 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:28.078193 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b512aaf-9578-4a06-a9fb-540be331d882 tempest-VolumeQuotaClassesTest-276264265 tempest-VolumeQuotaClassesTest-276264265-project-admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:28.137352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d1d14-eae7-4db8-817d-c4b30d0143e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:28.138675 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d1d14-eae7-4db8-817d-c4b30d0143e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:28.138989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d1d14-eae7-4db8-817d-c4b30d0143e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:28.139261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d1d14-eae7-4db8-817d-c4b30d0143e9 admin admin] PATH_INFO: `/v3/users/6abad89335c8419bbb857336dc3ffdf1` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:28.140382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d1d14-eae7-4db8-817d-c4b30d0143e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6abad89335c8419bbb857336dc3ffdf1)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:28.142329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d1d14-eae7-4db8-817d-c4b30d0143e9 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:28.186670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:28.188189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-934d1d14-eae7-4db8-817d-c4b30d0143e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6abad89335c8419bbb857336dc3ffdf1'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:28.200340 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-934d1d14-eae7-4db8-817d-c4b30d0143e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6abad89335c8419bbb857336dc3ffdf1'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:28.201737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-934d1d14-eae7-4db8-817d-c4b30d0143e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6abad89335c8419bbb857336dc3ffdf1'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:28.202400 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-934d1d14-eae7-4db8-817d-c4b30d0143e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6abad89335c8419bbb857336dc3ffdf1'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:28.209414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-934d1d14-eae7-4db8-817d-c4b30d0143e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6abad89335c8419bbb857336dc3ffdf1'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:28.227023 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1245/2504] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:28 2022] DELETE /identity/v3/users/6abad89335c8419bbb857336dc3ffdf1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:28.231454 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998ae19-dea7-4e9c-a6b2-473da81f3b0a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:28.231951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998ae19-dea7-4e9c-a6b2-473da81f3b0a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:28.232080 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998ae19-dea7-4e9c-a6b2-473da81f3b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:28.251819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-b998ae19-dea7-4e9c-a6b2-473da81f3b0a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:28.253087 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b998ae19-dea7-4e9c-a6b2-473da81f3b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:28.311260 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1260/2505] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:28.320562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d1d14-eae7-4db8-817d-c4b30d0143e9 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:28.322030 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-934d1d14-eae7-4db8-817d-c4b30d0143e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:28.379997 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d1d14-eae7-4db8-817d-c4b30d0143e9 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:28.383629 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f72a2-bb94-434a-8aca-3e1449478c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:28.384225 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f72a2-bb94-434a-8aca-3e1449478c6b service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:28.384509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f72a2-bb94-434a-8aca-3e1449478c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:28.384783 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f72a2-bb94-434a-8aca-3e1449478c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:28.395698 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f72a2-bb94-434a-8aca-3e1449478c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:28.397602 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f72a2-bb94-434a-8aca-3e1449478c6b service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:28.407629 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1246/2506] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:28.674392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998ae19-dea7-4e9c-a6b2-473da81f3b0a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:28.675896 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b998ae19-dea7-4e9c-a6b2-473da81f3b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:28.692108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998ae19-dea7-4e9c-a6b2-473da81f3b0a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:28.703681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74460fab-ac84-4602-886b-31b4d37d0fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:28.704353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74460fab-ac84-4602-886b-31b4d37d0fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:28.704639 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74460fab-ac84-4602-886b-31b4d37d0fed admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:28.704920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74460fab-ac84-4602-886b-31b4d37d0fed admin admin] PATH_INFO: `/v3/projects/4f2c3fa39d5448e994206838c091c465` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:28.706351 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74460fab-ac84-4602-886b-31b4d37d0fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2c3fa39d5448e994206838c091c465)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:28.708356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74460fab-ac84-4602-886b-31b4d37d0fed admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:28.762038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-74460fab-ac84-4602-886b-31b4d37d0fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2c3fa39d5448e994206838c091c465', 'request_id': 'req-74460fab-ac84-4602-886b-31b4d37d0fed'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:28.769090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-74460fab-ac84-4602-886b-31b4d37d0fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2c3fa39d5448e994206838c091c465', 'request_id': 'req-74460fab-ac84-4602-886b-31b4d37d0fed'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:28.777608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-74460fab-ac84-4602-886b-31b4d37d0fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2c3fa39d5448e994206838c091c465', 'request_id': 'req-74460fab-ac84-4602-886b-31b4d37d0fed'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:28.790835 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-74460fab-ac84-4602-886b-31b4d37d0fed admin admin] The token cache is being invalidate because project 4f2c3fa39d5448e994206838c091c465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:28.791201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-74460fab-ac84-4602-886b-31b4d37d0fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:28.791836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-74460fab-ac84-4602-886b-31b4d37d0fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:28.793564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1261/2507] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:28 2022] DELETE /identity/v3/projects/4f2c3fa39d5448e994206838c091c465 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:28.800230 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f72a2-bb94-434a-8aca-3e1449478c6b service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:28.817546 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f72a2-bb94-434a-8aca-3e1449478c6b service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:28.916533 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f1c2f-e8f3-4e0a-b8f5-6541f8a20a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:28.917625 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f1c2f-e8f3-4e0a-b8f5-6541f8a20a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:28.917915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f1c2f-e8f3-4e0a-b8f5-6541f8a20a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:28.918200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f1c2f-e8f3-4e0a-b8f5-6541f8a20a93 admin admin] PATH_INFO: `/v3/users/eda51fdc07084ef1bdcbd9e80e4bd826` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:28.920079 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f1c2f-e8f3-4e0a-b8f5-6541f8a20a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda51fdc07084ef1bdcbd9e80e4bd826)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:28.922128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f1c2f-e8f3-4e0a-b8f5-6541f8a20a93 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:28.982758 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-980f1c2f-e8f3-4e0a-b8f5-6541f8a20a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda51fdc07084ef1bdcbd9e80e4bd826'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:28.993832 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-980f1c2f-e8f3-4e0a-b8f5-6541f8a20a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda51fdc07084ef1bdcbd9e80e4bd826'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:28.994843 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-980f1c2f-e8f3-4e0a-b8f5-6541f8a20a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda51fdc07084ef1bdcbd9e80e4bd826'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:28.995888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-980f1c2f-e8f3-4e0a-b8f5-6541f8a20a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda51fdc07084ef1bdcbd9e80e4bd826'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:29.008840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-980f1c2f-e8f3-4e0a-b8f5-6541f8a20a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda51fdc07084ef1bdcbd9e80e4bd826'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:29.016082 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:29.034181 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1247/2508] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:28 2022] DELETE /identity/v3/users/eda51fdc07084ef1bdcbd9e80e4bd826 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:29.318124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74460fab-ac84-4602-886b-31b4d37d0fed admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:29.319576 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-74460fab-ac84-4602-886b-31b4d37d0fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:29.332572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74460fab-ac84-4602-886b-31b4d37d0fed admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:29.380764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:29.394292 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc51db7-36c5-432e-be1c-18f5b5693014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:29.394827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc51db7-36c5-432e-be1c-18f5b5693014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:29.395188 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc51db7-36c5-432e-be1c-18f5b5693014 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:29.395382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc51db7-36c5-432e-be1c-18f5b5693014 admin admin] PATH_INFO: `/v3/projects/2b6c9dd237d14f018416c6920a71a0b0` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:29.396502 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc51db7-36c5-432e-be1c-18f5b5693014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b6c9dd237d14f018416c6920a71a0b0)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:29.398438 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc51db7-36c5-432e-be1c-18f5b5693014 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:29.456890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2bc51db7-36c5-432e-be1c-18f5b5693014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6c9dd237d14f018416c6920a71a0b0', 'request_id': 'req-2bc51db7-36c5-432e-be1c-18f5b5693014'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:29.463163 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2bc51db7-36c5-432e-be1c-18f5b5693014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6c9dd237d14f018416c6920a71a0b0', 'request_id': 'req-2bc51db7-36c5-432e-be1c-18f5b5693014'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:29.471851 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2bc51db7-36c5-432e-be1c-18f5b5693014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6c9dd237d14f018416c6920a71a0b0', 'request_id': 'req-2bc51db7-36c5-432e-be1c-18f5b5693014'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:29.483199 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2bc51db7-36c5-432e-be1c-18f5b5693014 admin admin] The token cache is being invalidate because project 2b6c9dd237d14f018416c6920a71a0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:29.483487 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2bc51db7-36c5-432e-be1c-18f5b5693014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:29.484126 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-2bc51db7-36c5-432e-be1c-18f5b5693014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:29.485650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1262/2509] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:29 2022] DELETE /identity/v3/projects/2b6c9dd237d14f018416c6920a71a0b0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:29.490485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef89057-28f5-423f-8fe9-011478c1245e None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:29.490784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef89057-28f5-423f-8fe9-011478c1245e None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:29.491090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef89057-28f5-423f-8fe9-011478c1245e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:29.511385 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-eef89057-28f5-423f-8fe9-011478c1245e None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:29.512605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-eef89057-28f5-423f-8fe9-011478c1245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:29.575101 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1248/2510] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:29.583596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b885bd-a132-46df-8560-d7057b4ebd0e None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:29.584048 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b885bd-a132-46df-8560-d7057b4ebd0e None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:29.584352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b885bd-a132-46df-8560-d7057b4ebd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:29.606249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-c6b885bd-a132-46df-8560-d7057b4ebd0e None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:29.607526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c6b885bd-a132-46df-8560-d7057b4ebd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:29.615675 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1263/2511] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:29.619981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef89057-28f5-423f-8fe9-011478c1245e None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:29.629935 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef89057-28f5-423f-8fe9-011478c1245e None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:29.634551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1518c2-f8f0-4624-884c-962277e3a625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:29.635151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1518c2-f8f0-4624-884c-962277e3a625 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:29.635428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1518c2-f8f0-4624-884c-962277e3a625 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:29.635702 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1518c2-f8f0-4624-884c-962277e3a625 admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:29.636344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1518c2-f8f0-4624-884c-962277e3a625 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:02:29.636644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1518c2-f8f0-4624-884c-962277e3a625 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:29.638782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1518c2-f8f0-4624-884c-962277e3a625 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:29.651114 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1249/2512] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:02:29.656315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b885bd-a132-46df-8560-d7057b4ebd0e None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:29.665996 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b885bd-a132-46df-8560-d7057b4ebd0e None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:29.670890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1089b76-38be-46cf-821b-04a12e5b9559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:29.671489 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1089b76-38be-46cf-821b-04a12e5b9559 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:29.671771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1089b76-38be-46cf-821b-04a12e5b9559 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:29.672038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1089b76-38be-46cf-821b-04a12e5b9559 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:29.672662 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1089b76-38be-46cf-821b-04a12e5b9559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:29.674597 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1089b76-38be-46cf-821b-04a12e5b9559 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:29.703641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1264/2513] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:29 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:29.708091 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1518c2-f8f0-4624-884c-962277e3a625 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:29.726849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1518c2-f8f0-4624-884c-962277e3a625 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:29.790171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55f40a-a84e-423b-b7a6-19509f7acd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:29.790795 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55f40a-a84e-423b-b7a6-19509f7acd60 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:29.791079 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55f40a-a84e-423b-b7a6-19509f7acd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:29.791359 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55f40a-a84e-423b-b7a6-19509f7acd60 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:29.791988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55f40a-a84e-423b-b7a6-19509f7acd60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:29.793967 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55f40a-a84e-423b-b7a6-19509f7acd60 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:29.820281 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1250/2514] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:29 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:29.824442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1089b76-38be-46cf-821b-04a12e5b9559 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:29.840271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1089b76-38be-46cf-821b-04a12e5b9559 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:29.846498 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e54c23-e0e7-44db-a24d-748c9bb19964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:29.847262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e54c23-e0e7-44db-a24d-748c9bb19964 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:29.847548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e54c23-e0e7-44db-a24d-748c9bb19964 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:29.847830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e54c23-e0e7-44db-a24d-748c9bb19964 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:29.848489 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e54c23-e0e7-44db-a24d-748c9bb19964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:29.850229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e54c23-e0e7-44db-a24d-748c9bb19964 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:29.861673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1265/2515] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 09:02:29.867039 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55f40a-a84e-423b-b7a6-19509f7acd60 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:29.879808 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55f40a-a84e-423b-b7a6-19509f7acd60 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:29.886044 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a282f0c-2e07-45ff-877a-3221f8441bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:29.886662 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a282f0c-2e07-45ff-877a-3221f8441bfe admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:29.886948 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a282f0c-2e07-45ff-877a-3221f8441bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:29.887274 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a282f0c-2e07-45ff-877a-3221f8441bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:29.888022 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a282f0c-2e07-45ff-877a-3221f8441bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:29.889857 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a282f0c-2e07-45ff-877a-3221f8441bfe admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:29.905059 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1251/2516] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:29.910507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e54c23-e0e7-44db-a24d-748c9bb19964 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:29.921524 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e54c23-e0e7-44db-a24d-748c9bb19964 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:29.926426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86edb6a-8da4-4510-85fc-e55dfe47b928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:29.927122 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86edb6a-8da4-4510-85fc-e55dfe47b928 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:29.927399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86edb6a-8da4-4510-85fc-e55dfe47b928 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:29.927672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86edb6a-8da4-4510-85fc-e55dfe47b928 admin admin] PATH_INFO: `/v3/projects/59328b30bcaf43be9f2f8f533882a02f/users/b0aedc62671e4713bda05b68a39d54c8/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:29.947777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86edb6a-8da4-4510-85fc-e55dfe47b928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59328b30bcaf43be9f2f8f533882a02f, user_id=b0aedc62671e4713bda05b68a39d54c8, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:29.950812 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86edb6a-8da4-4510-85fc-e55dfe47b928 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:29.969108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1266/2517] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:29 2022] PUT /identity/v3/projects/59328b30bcaf43be9f2f8f533882a02f/users/b0aedc62671e4713bda05b68a39d54c8/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:29.980525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741db6f2-ac64-4581-9b49-677bf09c76cd None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:29.980817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741db6f2-ac64-4581-9b49-677bf09c76cd None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:29.981143 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741db6f2-ac64-4581-9b49-677bf09c76cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:30.014717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-741db6f2-ac64-4581-9b49-677bf09c76cd None None] MFA Rules not processed for user `b0aedc62671e4713bda05b68a39d54c8`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:30.015947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-741db6f2-ac64-4581-9b49-677bf09c76cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:30.060737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:30.088715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1252/2518] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:30.097666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86edb6a-8da4-4510-85fc-e55dfe47b928 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:30.189381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86edb6a-8da4-4510-85fc-e55dfe47b928 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:30.197963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a473f92-a009-4771-985a-341f2c6f928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:30.198761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a473f92-a009-4771-985a-341f2c6f928c admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:30.199475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a473f92-a009-4771-985a-341f2c6f928c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:30.199673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a473f92-a009-4771-985a-341f2c6f928c admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:30.200752 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a473f92-a009-4771-985a-341f2c6f928c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:30.204362 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a473f92-a009-4771-985a-341f2c6f928c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:30.232969 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:30.246464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1267/2519] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:30 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:02:30.247580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741db6f2-ac64-4581-9b49-677bf09c76cd None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:30.259877 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741db6f2-ac64-4581-9b49-677bf09c76cd None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:30.337671 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc929f-93ec-40b8-a995-1088ceff86ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:30.338305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc929f-93ec-40b8-a995-1088ceff86ba admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:30.338589 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc929f-93ec-40b8-a995-1088ceff86ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:30.338864 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc929f-93ec-40b8-a995-1088ceff86ba admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:30.339516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc929f-93ec-40b8-a995-1088ceff86ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:30.342258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc929f-93ec-40b8-a995-1088ceff86ba admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:30.371232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1253/2520] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:30 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:30.376981 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a473f92-a009-4771-985a-341f2c6f928c admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:30.388649 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a473f92-a009-4771-985a-341f2c6f928c admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:30.394183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61954e56-ce66-4569-be2b-91e37ee69481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:30.394874 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61954e56-ce66-4569-be2b-91e37ee69481 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:30.395246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61954e56-ce66-4569-be2b-91e37ee69481 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:30.395583 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61954e56-ce66-4569-be2b-91e37ee69481 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:30.396300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61954e56-ce66-4569-be2b-91e37ee69481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:30.397932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61954e56-ce66-4569-be2b-91e37ee69481 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:30.411367 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1268/2521] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:30.418232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc929f-93ec-40b8-a995-1088ceff86ba admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:30.427577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc929f-93ec-40b8-a995-1088ceff86ba admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:30.435075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1f34d-ab94-44fe-b6ae-ef496e3dc81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:30.435714 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1f34d-ab94-44fe-b6ae-ef496e3dc81e admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:30.436083 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1f34d-ab94-44fe-b6ae-ef496e3dc81e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:30.436285 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1f34d-ab94-44fe-b6ae-ef496e3dc81e admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:30.436948 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1f34d-ab94-44fe-b6ae-ef496e3dc81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:30.438563 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1f34d-ab94-44fe-b6ae-ef496e3dc81e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:30.450340 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1254/2522] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:30.455270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61954e56-ce66-4569-be2b-91e37ee69481 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:30.466860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61954e56-ce66-4569-be2b-91e37ee69481 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:30.472402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b804785-6726-4923-9bb4-ca43bf1d0989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:30.473145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b804785-6726-4923-9bb4-ca43bf1d0989 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:30.473433 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b804785-6726-4923-9bb4-ca43bf1d0989 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:30.473709 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b804785-6726-4923-9bb4-ca43bf1d0989 admin admin] PATH_INFO: `/v3/projects/db6358ca6d634d50bd31d2564a4a51c1/users/089e866d3bfd403c919798163fb70a18/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:30.491795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b804785-6726-4923-9bb4-ca43bf1d0989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6358ca6d634d50bd31d2564a4a51c1, user_id=089e866d3bfd403c919798163fb70a18, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:30.494857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b804785-6726-4923-9bb4-ca43bf1d0989 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:30.514420 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1269/2523] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:30 2022] PUT /identity/v3/projects/db6358ca6d634d50bd31d2564a4a51c1/users/089e866d3bfd403c919798163fb70a18/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:30.525688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571d06f-5e4c-422c-97a4-221c739c4c67 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:30.526245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571d06f-5e4c-422c-97a4-221c739c4c67 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:30.526714 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571d06f-5e4c-422c-97a4-221c739c4c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:30.572141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-1571d06f-5e4c-422c-97a4-221c739c4c67 None None] MFA Rules not processed for user `089e866d3bfd403c919798163fb70a18`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:30.574576 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1571d06f-5e4c-422c-97a4-221c739c4c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:30.654072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1255/2524] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:30.658791 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b804785-6726-4923-9bb4-ca43bf1d0989 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:30.727575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b804785-6726-4923-9bb4-ca43bf1d0989 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:30.732413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a91650-9f72-4084-b2b3-e4615a147ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:30.733049 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a91650-9f72-4084-b2b3-e4615a147ede admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:30.733335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a91650-9f72-4084-b2b3-e4615a147ede admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:30.733695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a91650-9f72-4084-b2b3-e4615a147ede admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:30.734909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a91650-9f72-4084-b2b3-e4615a147ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:30.736333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a91650-9f72-4084-b2b3-e4615a147ede admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:30.766874 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1270/2525] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:30 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:30.770884 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571d06f-5e4c-422c-97a4-221c739c4c67 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:30.783657 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571d06f-5e4c-422c-97a4-221c739c4c67 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:30.829456 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:30.842960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a21b3-b1b3-411e-a647-b6bd9d4d5852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:30.843846 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a21b3-b1b3-411e-a647-b6bd9d4d5852 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:30.844131 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a21b3-b1b3-411e-a647-b6bd9d4d5852 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:30.844410 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a21b3-b1b3-411e-a647-b6bd9d4d5852 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:30.845082 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a21b3-b1b3-411e-a647-b6bd9d4d5852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:30.847033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a21b3-b1b3-411e-a647-b6bd9d4d5852 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:30.868793 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1256/2526] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:30 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:30.873502 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a91650-9f72-4084-b2b3-e4615a147ede admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:30.885159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a91650-9f72-4084-b2b3-e4615a147ede admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:30.890800 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ae64e-6365-4b67-899a-ad5678014344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:30.891409 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ae64e-6365-4b67-899a-ad5678014344 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:30.891694 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ae64e-6365-4b67-899a-ad5678014344 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:30.892387 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ae64e-6365-4b67-899a-ad5678014344 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:30.892615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ae64e-6365-4b67-899a-ad5678014344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:30.894267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ae64e-6365-4b67-899a-ad5678014344 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:30.906316 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1271/2527] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:30.910708 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a21b3-b1b3-411e-a647-b6bd9d4d5852 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:30.920780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a21b3-b1b3-411e-a647-b6bd9d4d5852 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:30.925559 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb33bc7-849c-4cc4-b287-3705f7dc6fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:30.926209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb33bc7-849c-4cc4-b287-3705f7dc6fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:30.926487 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb33bc7-849c-4cc4-b287-3705f7dc6fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:30.926763 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb33bc7-849c-4cc4-b287-3705f7dc6fb9 admin admin] PATH_INFO: `/v3/projects/bfae40b89bdc4328815052f011584934/users/796886cee8254486a5d3ef1c957e05a2/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:30.942452 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb33bc7-849c-4cc4-b287-3705f7dc6fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfae40b89bdc4328815052f011584934, user_id=796886cee8254486a5d3ef1c957e05a2, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:30.945170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb33bc7-849c-4cc4-b287-3705f7dc6fb9 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:30.966995 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1257/2528] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:30 2022] PUT /identity/v3/projects/bfae40b89bdc4328815052f011584934/users/796886cee8254486a5d3ef1c957e05a2/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:30.971488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ae64e-6365-4b67-899a-ad5678014344 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:30.982604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ae64e-6365-4b67-899a-ad5678014344 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:31.041650 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f8edd-82fb-4773-a5f2-9f60b1ec961b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:31.042162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f8edd-82fb-4773-a5f2-9f60b1ec961b admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:31.042442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f8edd-82fb-4773-a5f2-9f60b1ec961b admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:31.042710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f8edd-82fb-4773-a5f2-9f60b1ec961b admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:31.043348 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f8edd-82fb-4773-a5f2-9f60b1ec961b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:31.045559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f8edd-82fb-4773-a5f2-9f60b1ec961b admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:31.056909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1272/2529] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:31.062789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb33bc7-849c-4cc4-b287-3705f7dc6fb9 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:31.073697 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb33bc7-849c-4cc4-b287-3705f7dc6fb9 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:31.078631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39848b-1354-4451-b3aa-63bc42e326c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:31.079296 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39848b-1354-4451-b3aa-63bc42e326c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:31.079605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39848b-1354-4451-b3aa-63bc42e326c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:31.079877 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39848b-1354-4451-b3aa-63bc42e326c7 admin admin] PATH_INFO: `/v3/projects/bfae40b89bdc4328815052f011584934/users/796886cee8254486a5d3ef1c957e05a2/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:31.081952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39848b-1354-4451-b3aa-63bc42e326c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfae40b89bdc4328815052f011584934, user_id=796886cee8254486a5d3ef1c957e05a2, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:31.084499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39848b-1354-4451-b3aa-63bc42e326c7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:31.097681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1258/2530] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:31 2022] PUT /identity/v3/projects/bfae40b89bdc4328815052f011584934/users/796886cee8254486a5d3ef1c957e05a2/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:31.110075 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743fdb8-7314-404d-ac78-fbe9d3a66d8a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:31.110364 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743fdb8-7314-404d-ac78-fbe9d3a66d8a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:31.110638 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743fdb8-7314-404d-ac78-fbe9d3a66d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:31.150790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-f743fdb8-7314-404d-ac78-fbe9d3a66d8a None None] MFA Rules not processed for user `796886cee8254486a5d3ef1c957e05a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:31.152037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f743fdb8-7314-404d-ac78-fbe9d3a66d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:31.177224 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:31.232458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1273/2531] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:31.243396 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39848b-1354-4451-b3aa-63bc42e326c7 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:31.245156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0d39848b-1354-4451-b3aa-63bc42e326c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:31.303562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39848b-1354-4451-b3aa-63bc42e326c7 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:31.307308 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e008a-5b9f-4d7f-b93a-2bd878af4869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:31.307925 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e008a-5b9f-4d7f-b93a-2bd878af4869 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:31.308210 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e008a-5b9f-4d7f-b93a-2bd878af4869 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:31.308486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e008a-5b9f-4d7f-b93a-2bd878af4869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:31.318615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e008a-5b9f-4d7f-b93a-2bd878af4869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:31.320081 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e008a-5b9f-4d7f-b93a-2bd878af4869 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:31.329788 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1259/2532] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:31.898745 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743fdb8-7314-404d-ac78-fbe9d3a66d8a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:31.900233 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f743fdb8-7314-404d-ac78-fbe9d3a66d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:31.915269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743fdb8-7314-404d-ac78-fbe9d3a66d8a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:31.920543 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137032d-fbd2-487b-94f9-4912052731af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:31.921614 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137032d-fbd2-487b-94f9-4912052731af service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:31.922109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137032d-fbd2-487b-94f9-4912052731af service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:31.922607 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137032d-fbd2-487b-94f9-4912052731af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:31.985267 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137032d-fbd2-487b-94f9-4912052731af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:31.986733 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137032d-fbd2-487b-94f9-4912052731af service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:31.996236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1274/2533] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:34.156724 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e008a-5b9f-4d7f-b93a-2bd878af4869 service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:34.158247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-539e008a-5b9f-4d7f-b93a-2bd878af4869 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:34.217404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e008a-5b9f-4d7f-b93a-2bd878af4869 service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:34.221339 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87052766-ff9d-4622-84e8-6f023c45190c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:34.221960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87052766-ff9d-4622-84e8-6f023c45190c service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:34.222242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87052766-ff9d-4622-84e8-6f023c45190c service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:34.222517 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87052766-ff9d-4622-84e8-6f023c45190c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:34.224275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-87052766-ff9d-4622-84e8-6f023c45190c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:34.288695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:34.293932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87052766-ff9d-4622-84e8-6f023c45190c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:34.296272 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87052766-ff9d-4622-84e8-6f023c45190c service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:34.307198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1260/2534] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:36.084396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137032d-fbd2-487b-94f9-4912052731af service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:36.095805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137032d-fbd2-487b-94f9-4912052731af service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:36.099970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8aa13c-d498-4323-8ef2-6e3cac79dda0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:36.101178 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8aa13c-d498-4323-8ef2-6e3cac79dda0 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:36.101462 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8aa13c-d498-4323-8ef2-6e3cac79dda0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:36.102011 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8aa13c-d498-4323-8ef2-6e3cac79dda0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:36.178754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8aa13c-d498-4323-8ef2-6e3cac79dda0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:36.180714 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8aa13c-d498-4323-8ef2-6e3cac79dda0 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:36.194513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1275/2535] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:37.735859 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87052766-ff9d-4622-84e8-6f023c45190c service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:37.737288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-87052766-ff9d-4622-84e8-6f023c45190c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:37.759670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87052766-ff9d-4622-84e8-6f023c45190c service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:37.765028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbfa19-3cb0-455d-9f74-d253cbe68ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:37.765814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbfa19-3cb0-455d-9f74-d253cbe68ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:37.766104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbfa19-3cb0-455d-9f74-d253cbe68ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:37.766383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbfa19-3cb0-455d-9f74-d253cbe68ec3 admin admin] PATH_INFO: `/v3/users/798c692df3b141849d5a4427b3cd1e6c` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:37.782644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbfa19-3cb0-455d-9f74-d253cbe68ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=798c692df3b141849d5a4427b3cd1e6c)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:37.785402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbfa19-3cb0-455d-9f74-d253cbe68ec3 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:37.836134 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-09bbfa19-3cb0-455d-9f74-d253cbe68ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '798c692df3b141849d5a4427b3cd1e6c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:37.846365 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-09bbfa19-3cb0-455d-9f74-d253cbe68ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '798c692df3b141849d5a4427b3cd1e6c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:37.850436 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-09bbfa19-3cb0-455d-9f74-d253cbe68ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '798c692df3b141849d5a4427b3cd1e6c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:37.851073 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-09bbfa19-3cb0-455d-9f74-d253cbe68ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '798c692df3b141849d5a4427b3cd1e6c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:37.859408 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-09bbfa19-3cb0-455d-9f74-d253cbe68ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '798c692df3b141849d5a4427b3cd1e6c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:37.877289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1261/2536] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:37 2022] DELETE /identity/v3/users/798c692df3b141849d5a4427b3cd1e6c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:38.051964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8aa13c-d498-4323-8ef2-6e3cac79dda0 service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:38.064004 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8aa13c-d498-4323-8ef2-6e3cac79dda0 service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:38.118768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:38.133535 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef2669-6bdd-4929-9f51-97686c8742e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:38.134655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef2669-6bdd-4929-9f51-97686c8742e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:38.134832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef2669-6bdd-4929-9f51-97686c8742e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:38.135039 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef2669-6bdd-4929-9f51-97686c8742e0 admin admin] PATH_INFO: `/v3/projects/79f37046a1eb42a9baa2825bef421c59` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:38.147652 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef2669-6bdd-4929-9f51-97686c8742e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f37046a1eb42a9baa2825bef421c59)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:38.150018 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef2669-6bdd-4929-9f51-97686c8742e0 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:38.201698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-00ef2669-6bdd-4929-9f51-97686c8742e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f37046a1eb42a9baa2825bef421c59', 'request_id': 'req-00ef2669-6bdd-4929-9f51-97686c8742e0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:38.210222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-00ef2669-6bdd-4929-9f51-97686c8742e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f37046a1eb42a9baa2825bef421c59', 'request_id': 'req-00ef2669-6bdd-4929-9f51-97686c8742e0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:38.219692 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-00ef2669-6bdd-4929-9f51-97686c8742e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f37046a1eb42a9baa2825bef421c59', 'request_id': 'req-00ef2669-6bdd-4929-9f51-97686c8742e0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:38.230956 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-00ef2669-6bdd-4929-9f51-97686c8742e0 admin admin] The token cache is being invalidate because project 79f37046a1eb42a9baa2825bef421c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:38.231269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-00ef2669-6bdd-4929-9f51-97686c8742e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:38.232538 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-00ef2669-6bdd-4929-9f51-97686c8742e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:38.234046 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1276/2537] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:38 2022] DELETE /identity/v3/projects/79f37046a1eb42a9baa2825bef421c59 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:38.239011 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae4df6-d85c-49be-a1a8-7be53fda10df None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:38.239304 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae4df6-d85c-49be-a1a8-7be53fda10df None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:38.239583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae4df6-d85c-49be-a1a8-7be53fda10df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:38.260778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-9dae4df6-d85c-49be-a1a8-7be53fda10df None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:38.262085 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-9dae4df6-d85c-49be-a1a8-7be53fda10df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:38.329292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1262/2538] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:38.337984 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e8c63-a815-4504-8676-ab58ef70ac65 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:38.338283 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e8c63-a815-4504-8676-ab58ef70ac65 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:38.338565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e8c63-a815-4504-8676-ab58ef70ac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:38.361017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-413e8c63-a815-4504-8676-ab58ef70ac65 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:38.362838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-413e8c63-a815-4504-8676-ab58ef70ac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:38.372346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1277/2539] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:38.377338 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae4df6-d85c-49be-a1a8-7be53fda10df None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:38.390197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae4df6-d85c-49be-a1a8-7be53fda10df None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:38.395424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469fbf8-1c26-4347-8a15-4f25536a6a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:38.396032 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469fbf8-1c26-4347-8a15-4f25536a6a02 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:38.396310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469fbf8-1c26-4347-8a15-4f25536a6a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:38.396581 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469fbf8-1c26-4347-8a15-4f25536a6a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:38.397263 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469fbf8-1c26-4347-8a15-4f25536a6a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:02:38.397563 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469fbf8-1c26-4347-8a15-4f25536a6a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:38.399331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469fbf8-1c26-4347-8a15-4f25536a6a02 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:38.415317 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1263/2540] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:02:38.416440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e8c63-a815-4504-8676-ab58ef70ac65 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:38.429497 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e8c63-a815-4504-8676-ab58ef70ac65 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:38.434842 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72071ba6-46f7-45e9-b485-d51832f7f2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:38.435554 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72071ba6-46f7-45e9-b485-d51832f7f2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:38.435840 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72071ba6-46f7-45e9-b485-d51832f7f2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:38.436288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72071ba6-46f7-45e9-b485-d51832f7f2b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:38.436759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72071ba6-46f7-45e9-b485-d51832f7f2b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:38.438779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72071ba6-46f7-45e9-b485-d51832f7f2b8 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:38.474833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469fbf8-1c26-4347-8a15-4f25536a6a02 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:38.476528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-9469fbf8-1c26-4347-8a15-4f25536a6a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:38.479729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1278/2541] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:38 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:02:38.480849 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72071ba6-46f7-45e9-b485-d51832f7f2b8 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:38.490345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469fbf8-1c26-4347-8a15-4f25536a6a02 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:38.532753 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:38.545117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72071ba6-46f7-45e9-b485-d51832f7f2b8 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:38.550072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c8393-1bd9-49ab-b0d3-cda8479f5be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:38.550681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c8393-1bd9-49ab-b0d3-cda8479f5be8 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:38.550966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c8393-1bd9-49ab-b0d3-cda8479f5be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:38.551245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c8393-1bd9-49ab-b0d3-cda8479f5be8 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:38.551637 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437d83d-8e20-4e17-98b5-96687cce9105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:38.551870 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c8393-1bd9-49ab-b0d3-cda8479f5be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:38.552306 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437d83d-8e20-4e17-98b5-96687cce9105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:38.552592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437d83d-8e20-4e17-98b5-96687cce9105 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:38.552870 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437d83d-8e20-4e17-98b5-96687cce9105 admin admin] PATH_INFO: `/v3/users/b0aedc62671e4713bda05b68a39d54c8` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:38.554049 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c8393-1bd9-49ab-b0d3-cda8479f5be8 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:38.554167 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437d83d-8e20-4e17-98b5-96687cce9105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0aedc62671e4713bda05b68a39d54c8)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:38.556112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437d83d-8e20-4e17-98b5-96687cce9105 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:38.583668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1279/2542] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:38 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:38.585047 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c8393-1bd9-49ab-b0d3-cda8479f5be8 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:38.602973 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c8393-1bd9-49ab-b0d3-cda8479f5be8 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:38.607949 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378332d-8319-4374-922d-6ef52f7816d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:38.608555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378332d-8319-4374-922d-6ef52f7816d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:38.608838 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378332d-8319-4374-922d-6ef52f7816d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:38.609168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378332d-8319-4374-922d-6ef52f7816d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:38.609833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378332d-8319-4374-922d-6ef52f7816d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:38.611430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378332d-8319-4374-922d-6ef52f7816d1 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:38.611971 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a437d83d-8e20-4e17-98b5-96687cce9105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0aedc62671e4713bda05b68a39d54c8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:38.619846 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a437d83d-8e20-4e17-98b5-96687cce9105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0aedc62671e4713bda05b68a39d54c8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:38.620496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a437d83d-8e20-4e17-98b5-96687cce9105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0aedc62671e4713bda05b68a39d54c8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:38.621150 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a437d83d-8e20-4e17-98b5-96687cce9105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0aedc62671e4713bda05b68a39d54c8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:38.621861 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1280/2543] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 09:02:38.626054 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378332d-8319-4374-922d-6ef52f7816d1 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:38.628106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f378332d-8319-4374-922d-6ef52f7816d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:38.628500 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a437d83d-8e20-4e17-98b5-96687cce9105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0aedc62671e4713bda05b68a39d54c8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:38.642187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378332d-8319-4374-922d-6ef52f7816d1 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:38.647055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c078c-bdbc-47f6-92f8-05edc418f1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:38.647199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1264/2544] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:38 2022] DELETE /identity/v3/users/b0aedc62671e4713bda05b68a39d54c8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:38.647739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c078c-bdbc-47f6-92f8-05edc418f1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:38.648129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c078c-bdbc-47f6-92f8-05edc418f1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:38.648413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c078c-bdbc-47f6-92f8-05edc418f1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:38.649095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c078c-bdbc-47f6-92f8-05edc418f1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:38.650801 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c078c-bdbc-47f6-92f8-05edc418f1c6 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:38.651398 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936010d-32a1-4859-a378-02f05baf68d0 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:38.651680 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936010d-32a1-4859-a378-02f05baf68d0 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:38.651954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936010d-32a1-4859-a378-02f05baf68d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:38.664059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1281/2545] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 09:02:38.668143 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c078c-bdbc-47f6-92f8-05edc418f1c6 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:38.671755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-5936010d-32a1-4859-a378-02f05baf68d0 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:38.672955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5936010d-32a1-4859-a378-02f05baf68d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:38.677866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c078c-bdbc-47f6-92f8-05edc418f1c6 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:38.690771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:38.736526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1265/2546] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:02:38.739328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96fec4-70b9-4264-9808-b526087a6d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:38.740003 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96fec4-70b9-4264-9808-b526087a6d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:38.740285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96fec4-70b9-4264-9808-b526087a6d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:38.740553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96fec4-70b9-4264-9808-b526087a6d60 admin admin] PATH_INFO: `/v3/projects/f8c5ee440f694e3e994a75f283f0832f/users/983c808b59b44eaa89092e8e786a3321/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:38.746980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936010d-32a1-4859-a378-02f05baf68d0 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:38.748382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5936010d-32a1-4859-a378-02f05baf68d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:38.755839 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96fec4-70b9-4264-9808-b526087a6d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c5ee440f694e3e994a75f283f0832f, user_id=983c808b59b44eaa89092e8e786a3321, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:38.758595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96fec4-70b9-4264-9808-b526087a6d60 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:38.773201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1282/2547] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:38 2022] PUT /identity/v3/projects/f8c5ee440f694e3e994a75f283f0832f/users/983c808b59b44eaa89092e8e786a3321/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:38.784224 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc2a40-c87b-44ff-8df5-63b2859cefce None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:38.784508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc2a40-c87b-44ff-8df5-63b2859cefce None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:38.784781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc2a40-c87b-44ff-8df5-63b2859cefce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:38.809443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936010d-32a1-4859-a378-02f05baf68d0 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:38.812553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0afc2a40-c87b-44ff-8df5-63b2859cefce None None] MFA Rules not processed for user `983c808b59b44eaa89092e8e786a3321`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:38.813808 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0afc2a40-c87b-44ff-8df5-63b2859cefce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:38.821862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:38.862438 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529e57b-fd66-4e70-8e9f-4f65f37c2b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:38.863046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e57b-fd66-4e70-8e9f-4f65f37c2b23 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:38.863332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e57b-fd66-4e70-8e9f-4f65f37c2b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:38.863661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e57b-fd66-4e70-8e9f-4f65f37c2b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:38.878476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1283/2548] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:02:38.883142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc2a40-c87b-44ff-8df5-63b2859cefce None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:38.925807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529e57b-fd66-4e70-8e9f-4f65f37c2b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:38.927236 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529e57b-fd66-4e70-8e9f-4f65f37c2b23 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:38.937515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1266/2549] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 09:02:38.947129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc2a40-c87b-44ff-8df5-63b2859cefce None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:38.952462 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a709a-86af-40ce-a680-4ef5c5f3fdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:38.953104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a709a-86af-40ce-a680-4ef5c5f3fdc9 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:38.953450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a709a-86af-40ce-a680-4ef5c5f3fdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:38.953731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a709a-86af-40ce-a680-4ef5c5f3fdc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:38.954383 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a709a-86af-40ce-a680-4ef5c5f3fdc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:38.956304 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a709a-86af-40ce-a680-4ef5c5f3fdc9 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:38.986291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1284/2550] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:38 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:02:38.990375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529e57b-fd66-4e70-8e9f-4f65f37c2b23 service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:39.000961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529e57b-fd66-4e70-8e9f-4f65f37c2b23 service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:39.062369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dc4e2-5eb4-4de6-98b8-53b8b3aaa0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:39.062989 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dc4e2-5eb4-4de6-98b8-53b8b3aaa0bd admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:39.063277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dc4e2-5eb4-4de6-98b8-53b8b3aaa0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:39.063556 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dc4e2-5eb4-4de6-98b8-53b8b3aaa0bd admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:39.064212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dc4e2-5eb4-4de6-98b8-53b8b3aaa0bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:39.066199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dc4e2-5eb4-4de6-98b8-53b8b3aaa0bd admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:39.095675 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1267/2551] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:38 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:39.099514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a709a-86af-40ce-a680-4ef5c5f3fdc9 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:39.110355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a709a-86af-40ce-a680-4ef5c5f3fdc9 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:39.115101 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2582d-f0c1-4560-918a-5a3f5cbe88a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:39.115711 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2582d-f0c1-4560-918a-5a3f5cbe88a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:39.115996 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2582d-f0c1-4560-918a-5a3f5cbe88a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:39.116276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2582d-f0c1-4560-918a-5a3f5cbe88a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:39.116928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2582d-f0c1-4560-918a-5a3f5cbe88a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:39.118576 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2582d-f0c1-4560-918a-5a3f5cbe88a4 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:39.130978 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1285/2552] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:39.135652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dc4e2-5eb4-4de6-98b8-53b8b3aaa0bd admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:39.146591 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dc4e2-5eb4-4de6-98b8-53b8b3aaa0bd admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:39.151367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d847702-3ded-4f70-9a87-e3def4a54ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:39.152101 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d847702-3ded-4f70-9a87-e3def4a54ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:39.152455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d847702-3ded-4f70-9a87-e3def4a54ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:39.152824 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d847702-3ded-4f70-9a87-e3def4a54ef6 admin admin] PATH_INFO: `/v3/projects/f076746940044dea883be6d4673c6bf3/users/b23d32c97d4542f7bd0fbbf5bea9ae90/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:39.168691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d847702-3ded-4f70-9a87-e3def4a54ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f076746940044dea883be6d4673c6bf3, user_id=b23d32c97d4542f7bd0fbbf5bea9ae90, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:39.171444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d847702-3ded-4f70-9a87-e3def4a54ef6 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:39.186568 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1268/2553] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:39 2022] PUT /identity/v3/projects/f076746940044dea883be6d4673c6bf3/users/b23d32c97d4542f7bd0fbbf5bea9ae90/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:39.190693 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2582d-f0c1-4560-918a-5a3f5cbe88a4 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:39.198117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:39.203118 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2582d-f0c1-4560-918a-5a3f5cbe88a4 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:39.226288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d847702-3ded-4f70-9a87-e3def4a54ef6 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:39.228090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0d847702-3ded-4f70-9a87-e3def4a54ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:39.270333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:39.278705 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84e9e0-7ae0-4b70-9b78-11e69d695116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:39.279322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84e9e0-7ae0-4b70-9b78-11e69d695116 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:39.279613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84e9e0-7ae0-4b70-9b78-11e69d695116 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:39.279889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84e9e0-7ae0-4b70-9b78-11e69d695116 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:39.280539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84e9e0-7ae0-4b70-9b78-11e69d695116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:39.282259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84e9e0-7ae0-4b70-9b78-11e69d695116 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:39.293212 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1286/2554] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:39.298589 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84e9e0-7ae0-4b70-9b78-11e69d695116 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:39.303360 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d847702-3ded-4f70-9a87-e3def4a54ef6 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:39.308057 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75cd81-7011-4c6d-830e-dd043ab25f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:39.308695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75cd81-7011-4c6d-830e-dd043ab25f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:39.308816 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84e9e0-7ae0-4b70-9b78-11e69d695116 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:39.308977 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75cd81-7011-4c6d-830e-dd043ab25f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:39.309292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75cd81-7011-4c6d-830e-dd043ab25f49 admin admin] PATH_INFO: `/v3/projects/59328b30bcaf43be9f2f8f533882a02f` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:39.311002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75cd81-7011-4c6d-830e-dd043ab25f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59328b30bcaf43be9f2f8f533882a02f)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:39.312909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75cd81-7011-4c6d-830e-dd043ab25f49 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:39.314455 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc947fe2-0793-458e-a2f1-ed0b7f289c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:39.315379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc947fe2-0793-458e-a2f1-ed0b7f289c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:39.315670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc947fe2-0793-458e-a2f1-ed0b7f289c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:39.315970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc947fe2-0793-458e-a2f1-ed0b7f289c4f admin admin] PATH_INFO: `/v3/projects/f076746940044dea883be6d4673c6bf3/users/b23d32c97d4542f7bd0fbbf5bea9ae90/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:39.318277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc947fe2-0793-458e-a2f1-ed0b7f289c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f076746940044dea883be6d4673c6bf3, user_id=b23d32c97d4542f7bd0fbbf5bea9ae90, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:39.320909 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc947fe2-0793-458e-a2f1-ed0b7f289c4f admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:39.333378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1287/2555] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:39 2022] PUT /identity/v3/projects/f076746940044dea883be6d4673c6bf3/users/b23d32c97d4542f7bd0fbbf5bea9ae90/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:39.344686 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9040b-ea07-4165-bbe3-0aa0c9972d79 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:39.345016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9040b-ea07-4165-bbe3-0aa0c9972d79 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:39.345319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9040b-ea07-4165-bbe3-0aa0c9972d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:39.362916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ae75cd81-7011-4c6d-830e-dd043ab25f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59328b30bcaf43be9f2f8f533882a02f', 'request_id': 'req-ae75cd81-7011-4c6d-830e-dd043ab25f49'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:39.369147 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ae75cd81-7011-4c6d-830e-dd043ab25f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59328b30bcaf43be9f2f8f533882a02f', 'request_id': 'req-ae75cd81-7011-4c6d-830e-dd043ab25f49'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:39.375426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-c8a9040b-ea07-4165-bbe3-0aa0c9972d79 None None] MFA Rules not processed for user `b23d32c97d4542f7bd0fbbf5bea9ae90`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:39.376670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c8a9040b-ea07-4165-bbe3-0aa0c9972d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:39.378214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ae75cd81-7011-4c6d-830e-dd043ab25f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59328b30bcaf43be9f2f8f533882a02f', 'request_id': 'req-ae75cd81-7011-4c6d-830e-dd043ab25f49'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:39.390136 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ae75cd81-7011-4c6d-830e-dd043ab25f49 admin admin] The token cache is being invalidate because project 59328b30bcaf43be9f2f8f533882a02f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:39.390409 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ae75cd81-7011-4c6d-830e-dd043ab25f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:39.391075 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-ae75cd81-7011-4c6d-830e-dd043ab25f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:39.392577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1269/2556] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:39 2022] DELETE /identity/v3/projects/59328b30bcaf43be9f2f8f533882a02f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:39.396365 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75cd81-7011-4c6d-830e-dd043ab25f49 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:39.397751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ae75cd81-7011-4c6d-830e-dd043ab25f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:39.447856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1288/2557] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:02:39.459501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9040b-ea07-4165-bbe3-0aa0c9972d79 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:39.460852 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c8a9040b-ea07-4165-bbe3-0aa0c9972d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:39.466445 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75cd81-7011-4c6d-830e-dd043ab25f49 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:39.471519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903a81b-ff1d-4938-85fc-66819df30a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:39.472159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903a81b-ff1d-4938-85fc-66819df30a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:39.472444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903a81b-ff1d-4938-85fc-66819df30a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:39.472719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903a81b-ff1d-4938-85fc-66819df30a90 admin admin] PATH_INFO: `/v3/users/089e866d3bfd403c919798163fb70a18` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:39.473917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903a81b-ff1d-4938-85fc-66819df30a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=089e866d3bfd403c919798163fb70a18)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:39.475853 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903a81b-ff1d-4938-85fc-66819df30a90 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:39.520510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9040b-ea07-4165-bbe3-0aa0c9972d79 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:39.524124 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60506ac-36f3-4cf2-bf41-30acf9471e6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:39.524640 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6903a81b-ff1d-4938-85fc-66819df30a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '089e866d3bfd403c919798163fb70a18'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:39.524754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60506ac-36f3-4cf2-bf41-30acf9471e6e service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:39.525022 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60506ac-36f3-4cf2-bf41-30acf9471e6e service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:39.525311 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60506ac-36f3-4cf2-bf41-30acf9471e6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:39.534052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6903a81b-ff1d-4938-85fc-66819df30a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '089e866d3bfd403c919798163fb70a18'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:39.534810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6903a81b-ff1d-4938-85fc-66819df30a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '089e866d3bfd403c919798163fb70a18'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:39.535545 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6903a81b-ff1d-4938-85fc-66819df30a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '089e866d3bfd403c919798163fb70a18'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:39.535672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60506ac-36f3-4cf2-bf41-30acf9471e6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:39.537215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60506ac-36f3-4cf2-bf41-30acf9471e6e service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:39.543439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6903a81b-ff1d-4938-85fc-66819df30a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '089e866d3bfd403c919798163fb70a18'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:39.546021 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:39.547826 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1289/2558] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 09:02:39.566444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1270/2559] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:39 2022] DELETE /identity/v3/users/089e866d3bfd403c919798163fb70a18 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:39.636660 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60506ac-36f3-4cf2-bf41-30acf9471e6e service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:39.647037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60506ac-36f3-4cf2-bf41-30acf9471e6e service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:39.659916 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:39.703024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ed6c9-a7c4-4d6a-aae7-c699139960e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:39.703635 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ed6c9-a7c4-4d6a-aae7-c699139960e5 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:39.703919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ed6c9-a7c4-4d6a-aae7-c699139960e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:39.704192 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ed6c9-a7c4-4d6a-aae7-c699139960e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:39.706035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-db9ed6c9-a7c4-4d6a-aae7-c699139960e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:39.772290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ed6c9-a7c4-4d6a-aae7-c699139960e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:39.773801 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ed6c9-a7c4-4d6a-aae7-c699139960e5 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:39.783514 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1290/2560] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:39.849585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903a81b-ff1d-4938-85fc-66819df30a90 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:39.851696 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-6903a81b-ff1d-4938-85fc-66819df30a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:39.935695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903a81b-ff1d-4938-85fc-66819df30a90 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:39.940468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22442bc-84f8-41ec-9c50-f464162f8ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:39.941139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22442bc-84f8-41ec-9c50-f464162f8ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:39.941425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22442bc-84f8-41ec-9c50-f464162f8ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:39.941703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22442bc-84f8-41ec-9c50-f464162f8ee6 admin admin] PATH_INFO: `/v3/projects/db6358ca6d634d50bd31d2564a4a51c1` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:39.942835 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22442bc-84f8-41ec-9c50-f464162f8ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db6358ca6d634d50bd31d2564a4a51c1)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:39.944906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22442bc-84f8-41ec-9c50-f464162f8ee6 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:39.993463 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e22442bc-84f8-41ec-9c50-f464162f8ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db6358ca6d634d50bd31d2564a4a51c1', 'request_id': 'req-e22442bc-84f8-41ec-9c50-f464162f8ee6'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:39.999650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e22442bc-84f8-41ec-9c50-f464162f8ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db6358ca6d634d50bd31d2564a4a51c1', 'request_id': 'req-e22442bc-84f8-41ec-9c50-f464162f8ee6'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:40.007026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e22442bc-84f8-41ec-9c50-f464162f8ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db6358ca6d634d50bd31d2564a4a51c1', 'request_id': 'req-e22442bc-84f8-41ec-9c50-f464162f8ee6'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:40.018181 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e22442bc-84f8-41ec-9c50-f464162f8ee6 admin admin] The token cache is being invalidate because project db6358ca6d634d50bd31d2564a4a51c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:40.018474 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e22442bc-84f8-41ec-9c50-f464162f8ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:40.019105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e22442bc-84f8-41ec-9c50-f464162f8ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:40.020580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1271/2561] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:39 2022] DELETE /identity/v3/projects/db6358ca6d634d50bd31d2564a4a51c1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:40.024566 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ed6c9-a7c4-4d6a-aae7-c699139960e5 service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:40.035874 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ed6c9-a7c4-4d6a-aae7-c699139960e5 service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:40.090628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a17c7-d452-43a9-a5ad-4ba266178be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:40.091890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a17c7-d452-43a9-a5ad-4ba266178be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:40.092170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a17c7-d452-43a9-a5ad-4ba266178be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:40.092441 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a17c7-d452-43a9-a5ad-4ba266178be5 admin admin] PATH_INFO: `/v3/users/796886cee8254486a5d3ef1c957e05a2` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:40.093840 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a17c7-d452-43a9-a5ad-4ba266178be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=796886cee8254486a5d3ef1c957e05a2)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:40.095768 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a17c7-d452-43a9-a5ad-4ba266178be5 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:40.141251 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6c2a17c7-d452-43a9-a5ad-4ba266178be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796886cee8254486a5d3ef1c957e05a2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:40.148847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6c2a17c7-d452-43a9-a5ad-4ba266178be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796886cee8254486a5d3ef1c957e05a2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:40.149629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6c2a17c7-d452-43a9-a5ad-4ba266178be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796886cee8254486a5d3ef1c957e05a2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:40.157716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6c2a17c7-d452-43a9-a5ad-4ba266178be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796886cee8254486a5d3ef1c957e05a2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:40.164709 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:40.170289 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-6c2a17c7-d452-43a9-a5ad-4ba266178be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796886cee8254486a5d3ef1c957e05a2'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:40.177415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1291/2562] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:40 2022] DELETE /identity/v3/users/796886cee8254486a5d3ef1c957e05a2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:40.467098 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22442bc-84f8-41ec-9c50-f464162f8ee6 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:40.468848 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-e22442bc-84f8-41ec-9c50-f464162f8ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:40.482297 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22442bc-84f8-41ec-9c50-f464162f8ee6 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:40.551995 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20a6b4-1023-46d6-9c5e-6bf9b1be584e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:40.552558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20a6b4-1023-46d6-9c5e-6bf9b1be584e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:40.552844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20a6b4-1023-46d6-9c5e-6bf9b1be584e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:40.553162 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20a6b4-1023-46d6-9c5e-6bf9b1be584e admin admin] PATH_INFO: `/v3/projects/bfae40b89bdc4328815052f011584934` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:40.554457 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20a6b4-1023-46d6-9c5e-6bf9b1be584e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfae40b89bdc4328815052f011584934)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:40.556404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20a6b4-1023-46d6-9c5e-6bf9b1be584e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:40.577655 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:40.610123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7e20a6b4-1023-46d6-9c5e-6bf9b1be584e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfae40b89bdc4328815052f011584934', 'request_id': 'req-7e20a6b4-1023-46d6-9c5e-6bf9b1be584e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:40.618198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7e20a6b4-1023-46d6-9c5e-6bf9b1be584e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfae40b89bdc4328815052f011584934', 'request_id': 'req-7e20a6b4-1023-46d6-9c5e-6bf9b1be584e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:40.627052 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7e20a6b4-1023-46d6-9c5e-6bf9b1be584e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfae40b89bdc4328815052f011584934', 'request_id': 'req-7e20a6b4-1023-46d6-9c5e-6bf9b1be584e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:40.638958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7e20a6b4-1023-46d6-9c5e-6bf9b1be584e admin admin] The token cache is being invalidate because project bfae40b89bdc4328815052f011584934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:40.639247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7e20a6b4-1023-46d6-9c5e-6bf9b1be584e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:40.639916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7e20a6b4-1023-46d6-9c5e-6bf9b1be584e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:40.641464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1272/2563] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:40 2022] DELETE /identity/v3/projects/bfae40b89bdc4328815052f011584934 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:40.647476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de898cf-8cc9-48f0-a39d-1953044fc477 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:40.647772 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de898cf-8cc9-48f0-a39d-1953044fc477 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:40.648053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de898cf-8cc9-48f0-a39d-1953044fc477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:40.668023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-6de898cf-8cc9-48f0-a39d-1953044fc477 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:40.669313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6de898cf-8cc9-48f0-a39d-1953044fc477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:40.730819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1292/2564] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:40.740361 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a993c-cfe7-45a9-bea1-61c3fdbd4edb None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:40.740656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a993c-cfe7-45a9-bea1-61c3fdbd4edb None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:40.740940 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a993c-cfe7-45a9-bea1-61c3fdbd4edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:40.774056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-566a993c-cfe7-45a9-bea1-61c3fdbd4edb None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:40.775300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-566a993c-cfe7-45a9-bea1-61c3fdbd4edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:40.783296 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1273/2565] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:40.787715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de898cf-8cc9-48f0-a39d-1953044fc477 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:40.798439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de898cf-8cc9-48f0-a39d-1953044fc477 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:40.803242 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed088492-b1a5-449b-b272-425a51ae127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:40.803793 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed088492-b1a5-449b-b272-425a51ae127f admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:40.804079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed088492-b1a5-449b-b272-425a51ae127f admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:40.804356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed088492-b1a5-449b-b272-425a51ae127f admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:40.805028 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed088492-b1a5-449b-b272-425a51ae127f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:02:40.805343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed088492-b1a5-449b-b272-425a51ae127f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:40.806939 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed088492-b1a5-449b-b272-425a51ae127f admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:40.819557 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1293/2566] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 09:02:40.824311 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a993c-cfe7-45a9-bea1-61c3fdbd4edb None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:40.834141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a993c-cfe7-45a9-bea1-61c3fdbd4edb None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:40.838966 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171677b0-0750-40b5-8493-7baf771953ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:40.839594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171677b0-0750-40b5-8493-7baf771953ba admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:40.839872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171677b0-0750-40b5-8493-7baf771953ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:40.840139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171677b0-0750-40b5-8493-7baf771953ba admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:40.840806 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171677b0-0750-40b5-8493-7baf771953ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:40.842748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171677b0-0750-40b5-8493-7baf771953ba admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:40.871266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1274/2567] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:40 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:40.876076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed088492-b1a5-449b-b272-425a51ae127f admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:40.886962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed088492-b1a5-449b-b272-425a51ae127f admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:40.945480 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b94d8-dea2-4c04-b465-8d9536bbc5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:40.946186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b94d8-dea2-4c04-b465-8d9536bbc5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:40.946385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b94d8-dea2-4c04-b465-8d9536bbc5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:40.946661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b94d8-dea2-4c04-b465-8d9536bbc5e2 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:40.947296 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b94d8-dea2-4c04-b465-8d9536bbc5e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:40.949662 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b94d8-dea2-4c04-b465-8d9536bbc5e2 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:40.973228 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1294/2568] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:40 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:02:40.977501 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171677b0-0750-40b5-8493-7baf771953ba admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:40.988779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171677b0-0750-40b5-8493-7baf771953ba admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:40.993677 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d98014-4f40-4c75-83ce-9758b2fecc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:40.994253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d98014-4f40-4c75-83ce-9758b2fecc3d admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:40.994531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d98014-4f40-4c75-83ce-9758b2fecc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:40.994803 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d98014-4f40-4c75-83ce-9758b2fecc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:40.995510 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d98014-4f40-4c75-83ce-9758b2fecc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:40.997796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d98014-4f40-4c75-83ce-9758b2fecc3d admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:41.011779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1275/2569] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:41.013054 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b94d8-dea2-4c04-b465-8d9536bbc5e2 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:41.024408 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b94d8-dea2-4c04-b465-8d9536bbc5e2 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:41.029408 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de409959-04ec-4bfc-8661-e4f7fe75fc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:41.030020 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de409959-04ec-4bfc-8661-e4f7fe75fc80 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:41.030318 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de409959-04ec-4bfc-8661-e4f7fe75fc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:41.030565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de409959-04ec-4bfc-8661-e4f7fe75fc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:41.031226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de409959-04ec-4bfc-8661-e4f7fe75fc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:41.032936 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de409959-04ec-4bfc-8661-e4f7fe75fc80 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:41.047866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1295/2570] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:41.050780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d98014-4f40-4c75-83ce-9758b2fecc3d admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:41.061569 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d98014-4f40-4c75-83ce-9758b2fecc3d admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:41.069559 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a3b6a-5440-4082-a8ef-069d804adc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:41.069559 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a3b6a-5440-4082-a8ef-069d804adc56 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:41.069559 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a3b6a-5440-4082-a8ef-069d804adc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:41.069559 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a3b6a-5440-4082-a8ef-069d804adc56 admin admin] PATH_INFO: `/v3/projects/fb93a26e6ab64731ac82ca6a8fd41127/users/9c9d339b6d8d4b6fae3d1716c74433c8/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:41.084976 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a3b6a-5440-4082-a8ef-069d804adc56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb93a26e6ab64731ac82ca6a8fd41127, user_id=9c9d339b6d8d4b6fae3d1716c74433c8, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:41.087668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a3b6a-5440-4082-a8ef-069d804adc56 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:41.101518 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1276/2571] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:41 2022] PUT /identity/v3/projects/fb93a26e6ab64731ac82ca6a8fd41127/users/9c9d339b6d8d4b6fae3d1716c74433c8/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:41.114214 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bde58e-8eeb-436f-85e5-0d2bbfb530d6 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:41.114510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bde58e-8eeb-436f-85e5-0d2bbfb530d6 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:41.114792 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bde58e-8eeb-436f-85e5-0d2bbfb530d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:41.148179 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-86bde58e-8eeb-436f-85e5-0d2bbfb530d6 None None] MFA Rules not processed for user `9c9d339b6d8d4b6fae3d1716c74433c8`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:41.149452 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-86bde58e-8eeb-436f-85e5-0d2bbfb530d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:41.198871 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:41.229337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1296/2572] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:02:41.234447 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a3b6a-5440-4082-a8ef-069d804adc56 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:41.301029 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a3b6a-5440-4082-a8ef-069d804adc56 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:41.305803 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2420a3-8d23-4b0a-83e3-8bd403670c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:41.306379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2420a3-8d23-4b0a-83e3-8bd403670c81 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:41.306666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2420a3-8d23-4b0a-83e3-8bd403670c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:41.306943 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2420a3-8d23-4b0a-83e3-8bd403670c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:41.307580 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2420a3-8d23-4b0a-83e3-8bd403670c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:41.309748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2420a3-8d23-4b0a-83e3-8bd403670c81 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:41.341933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1277/2573] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:41 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:41.343875 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bde58e-8eeb-436f-85e5-0d2bbfb530d6 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:41.355459 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bde58e-8eeb-436f-85e5-0d2bbfb530d6 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:41.427464 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869f826-3614-48a6-b06b-183fa0ff8668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:41.428080 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869f826-3614-48a6-b06b-183fa0ff8668 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:41.428381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869f826-3614-48a6-b06b-183fa0ff8668 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:41.428639 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869f826-3614-48a6-b06b-183fa0ff8668 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:41.429302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869f826-3614-48a6-b06b-183fa0ff8668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:41.431298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869f826-3614-48a6-b06b-183fa0ff8668 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:41.454406 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1297/2574] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:41 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:41.458525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2420a3-8d23-4b0a-83e3-8bd403670c81 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:41.469820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2420a3-8d23-4b0a-83e3-8bd403670c81 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:41.475675 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5c262-8ee5-4dd8-8323-dfa5e303aaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:41.476292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5c262-8ee5-4dd8-8323-dfa5e303aaf7 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:41.476574 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5c262-8ee5-4dd8-8323-dfa5e303aaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:41.476849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5c262-8ee5-4dd8-8323-dfa5e303aaf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:41.477566 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5c262-8ee5-4dd8-8323-dfa5e303aaf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:41.479172 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5c262-8ee5-4dd8-8323-dfa5e303aaf7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:41.492027 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1278/2575] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:41.496279 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869f826-3614-48a6-b06b-183fa0ff8668 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:41.506565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869f826-3614-48a6-b06b-183fa0ff8668 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:41.511356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25a145-ffb0-4219-83ce-2fc9a2d6ba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:41.512035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25a145-ffb0-4219-83ce-2fc9a2d6ba6e admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:41.512317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25a145-ffb0-4219-83ce-2fc9a2d6ba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:41.513159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25a145-ffb0-4219-83ce-2fc9a2d6ba6e admin admin] PATH_INFO: `/v3/projects/7940310964ee4ffa96534083a8b20a80/users/79ab3b99ef294621acf4501b8b1006bc/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:41.529711 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25a145-ffb0-4219-83ce-2fc9a2d6ba6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7940310964ee4ffa96534083a8b20a80, user_id=79ab3b99ef294621acf4501b8b1006bc, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:41.532981 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25a145-ffb0-4219-83ce-2fc9a2d6ba6e admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:41.547396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1298/2576] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:41 2022] PUT /identity/v3/projects/7940310964ee4ffa96534083a8b20a80/users/79ab3b99ef294621acf4501b8b1006bc/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:41.551382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5c262-8ee5-4dd8-8323-dfa5e303aaf7 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:41.561732 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5c262-8ee5-4dd8-8323-dfa5e303aaf7 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:41.579717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:41.628603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09d33d-ddf9-4603-bb0f-340ecf9f75e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:41.629242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09d33d-ddf9-4603-bb0f-340ecf9f75e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:41.629522 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09d33d-ddf9-4603-bb0f-340ecf9f75e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:41.629817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09d33d-ddf9-4603-bb0f-340ecf9f75e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:41.630455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09d33d-ddf9-4603-bb0f-340ecf9f75e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:41.632078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09d33d-ddf9-4603-bb0f-340ecf9f75e2 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:41.642695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1279/2577] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:41.646703 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25a145-ffb0-4219-83ce-2fc9a2d6ba6e admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:41.657668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25a145-ffb0-4219-83ce-2fc9a2d6ba6e admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:41.662286 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb9dc2-cfa1-4962-bb5f-2fc89f4c29de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:41.662948 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb9dc2-cfa1-4962-bb5f-2fc89f4c29de admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:41.663230 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb9dc2-cfa1-4962-bb5f-2fc89f4c29de admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:41.663506 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb9dc2-cfa1-4962-bb5f-2fc89f4c29de admin admin] PATH_INFO: `/v3/projects/7940310964ee4ffa96534083a8b20a80/users/79ab3b99ef294621acf4501b8b1006bc/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:41.665698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb9dc2-cfa1-4962-bb5f-2fc89f4c29de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7940310964ee4ffa96534083a8b20a80, user_id=79ab3b99ef294621acf4501b8b1006bc, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:41.668373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb9dc2-cfa1-4962-bb5f-2fc89f4c29de admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:41.678931 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1299/2578] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:41 2022] PUT /identity/v3/projects/7940310964ee4ffa96534083a8b20a80/users/79ab3b99ef294621acf4501b8b1006bc/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:41.747961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b1217-3950-47db-8806-53a200684921 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:41.748268 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b1217-3950-47db-8806-53a200684921 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:41.748545 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b1217-3950-47db-8806-53a200684921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:41.777960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-063b1217-3950-47db-8806-53a200684921 None None] MFA Rules not processed for user `79ab3b99ef294621acf4501b8b1006bc`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:41.779804 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-063b1217-3950-47db-8806-53a200684921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:41.856894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1280/2579] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:41.868042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb9dc2-cfa1-4962-bb5f-2fc89f4c29de admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:41.869799 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d1eb9dc2-cfa1-4962-bb5f-2fc89f4c29de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:41.929280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb9dc2-cfa1-4962-bb5f-2fc89f4c29de admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:41.933030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e61b65-77c5-4228-a44c-716c244fa498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:41.933654 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e61b65-77c5-4228-a44c-716c244fa498 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:41.933930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e61b65-77c5-4228-a44c-716c244fa498 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:41.934201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e61b65-77c5-4228-a44c-716c244fa498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:41.944673 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e61b65-77c5-4228-a44c-716c244fa498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:41.946174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e61b65-77c5-4228-a44c-716c244fa498 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:41.958289 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1300/2580] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:42.065647 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b1217-3950-47db-8806-53a200684921 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:42.076180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b1217-3950-47db-8806-53a200684921 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:42.080153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f911815-4399-487f-9b18-edb6f474420e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:42.080778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f911815-4399-487f-9b18-edb6f474420e service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:42.081095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f911815-4399-487f-9b18-edb6f474420e service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:42.081378 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f911815-4399-487f-9b18-edb6f474420e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:42.143817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f911815-4399-487f-9b18-edb6f474420e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:42.147036 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f911815-4399-487f-9b18-edb6f474420e service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:42.154358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1281/2581] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:42.569337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e61b65-77c5-4228-a44c-716c244fa498 service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:42.571164 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a5e61b65-77c5-4228-a44c-716c244fa498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:42.619355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:42.651359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e61b65-77c5-4228-a44c-716c244fa498 service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:42.656895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236a62-6f76-45c2-abfc-71b45b606bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:42.657519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236a62-6f76-45c2-abfc-71b45b606bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:42.657778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236a62-6f76-45c2-abfc-71b45b606bce admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:42.658056 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236a62-6f76-45c2-abfc-71b45b606bce admin admin] PATH_INFO: `/v3/users/983c808b59b44eaa89092e8e786a3321` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:42.659343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b236a62-6f76-45c2-abfc-71b45b606bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=983c808b59b44eaa89092e8e786a3321)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:42.661390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b236a62-6f76-45c2-abfc-71b45b606bce admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:42.716277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5b236a62-6f76-45c2-abfc-71b45b606bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '983c808b59b44eaa89092e8e786a3321'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:42.724877 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5b236a62-6f76-45c2-abfc-71b45b606bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '983c808b59b44eaa89092e8e786a3321'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:42.725641 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5b236a62-6f76-45c2-abfc-71b45b606bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '983c808b59b44eaa89092e8e786a3321'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:42.734316 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5b236a62-6f76-45c2-abfc-71b45b606bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '983c808b59b44eaa89092e8e786a3321'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:42.747169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-5b236a62-6f76-45c2-abfc-71b45b606bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '983c808b59b44eaa89092e8e786a3321'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:42.754250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1301/2582] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:42 2022] DELETE /identity/v3/users/983c808b59b44eaa89092e8e786a3321 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:42.758906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e9895-9875-4c39-9e35-a1dc648293d4 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:42.759194 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e9895-9875-4c39-9e35-a1dc648293d4 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:42.759468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e9895-9875-4c39-9e35-a1dc648293d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:42.780906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-7b2e9895-9875-4c39-9e35-a1dc648293d4 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:42.782172 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7b2e9895-9875-4c39-9e35-a1dc648293d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:42.814438 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:42.847329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1282/2583] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:42.858060 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236a62-6f76-45c2-abfc-71b45b606bce admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:42.859572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-5b236a62-6f76-45c2-abfc-71b45b606bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:42.918682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236a62-6f76-45c2-abfc-71b45b606bce admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:42.922965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3e6d6-e174-4172-a81c-29e82f607125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:42.923575 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3e6d6-e174-4172-a81c-29e82f607125 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:42.923856 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3e6d6-e174-4172-a81c-29e82f607125 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:42.924128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3e6d6-e174-4172-a81c-29e82f607125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:42.933866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3e6d6-e174-4172-a81c-29e82f607125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:42.935461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3e6d6-e174-4172-a81c-29e82f607125 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:42.945314 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1302/2584] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:43.230150 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e9895-9875-4c39-9e35-a1dc648293d4 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:43.231742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7b2e9895-9875-4c39-9e35-a1dc648293d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:43.244482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e9895-9875-4c39-9e35-a1dc648293d4 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:43.256158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:43.256911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:43.257553 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:43.257852 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373 admin admin] PATH_INFO: `/v3/projects/f8c5ee440f694e3e994a75f283f0832f` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:43.259056 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c5ee440f694e3e994a75f283f0832f)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:43.260964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:43.313324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c5ee440f694e3e994a75f283f0832f', 'request_id': 'req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:43.326737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c5ee440f694e3e994a75f283f0832f', 'request_id': 'req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:43.335623 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c5ee440f694e3e994a75f283f0832f', 'request_id': 'req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:43.348042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373 admin admin] The token cache is being invalidate because project f8c5ee440f694e3e994a75f283f0832f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:43.348337 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:43.348973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:43.350473 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1283/2585] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:43 2022] DELETE /identity/v3/projects/f8c5ee440f694e3e994a75f283f0832f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:43.354711 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3e6d6-e174-4172-a81c-29e82f607125 service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:43.364410 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3e6d6-e174-4172-a81c-29e82f607125 service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:43.421978 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af7f2c-63e3-4e59-a407-db8194716445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:43.422612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af7f2c-63e3-4e59-a407-db8194716445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:43.422893 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af7f2c-63e3-4e59-a407-db8194716445 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:43.423167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af7f2c-63e3-4e59-a407-db8194716445 admin admin] PATH_INFO: `/v3/users/b23d32c97d4542f7bd0fbbf5bea9ae90` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:43.424369 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af7f2c-63e3-4e59-a407-db8194716445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23d32c97d4542f7bd0fbbf5bea9ae90)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:43.426309 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af7f2c-63e3-4e59-a407-db8194716445 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:43.428828 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:43.483681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-47af7f2c-63e3-4e59-a407-db8194716445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23d32c97d4542f7bd0fbbf5bea9ae90'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:43.494670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-47af7f2c-63e3-4e59-a407-db8194716445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23d32c97d4542f7bd0fbbf5bea9ae90'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:43.495622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-47af7f2c-63e3-4e59-a407-db8194716445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23d32c97d4542f7bd0fbbf5bea9ae90'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:43.505075 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-47af7f2c-63e3-4e59-a407-db8194716445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23d32c97d4542f7bd0fbbf5bea9ae90'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:43.523162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-47af7f2c-63e3-4e59-a407-db8194716445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23d32c97d4542f7bd0fbbf5bea9ae90'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:43.529346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1303/2586] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:43 2022] DELETE /identity/v3/users/b23d32c97d4542f7bd0fbbf5bea9ae90 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:43.831484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:43.833700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:43.850855 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7797c2-4d6e-4fd5-8c01-8abe09fd2373 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:43.916342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe9104-8294-49fa-82f2-d46e2867be79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:43.917026 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe9104-8294-49fa-82f2-d46e2867be79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:43.917313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe9104-8294-49fa-82f2-d46e2867be79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:43.917587 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe9104-8294-49fa-82f2-d46e2867be79 admin admin] PATH_INFO: `/v3/projects/f076746940044dea883be6d4673c6bf3` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:43.919215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe9104-8294-49fa-82f2-d46e2867be79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f076746940044dea883be6d4673c6bf3)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:43.921168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe9104-8294-49fa-82f2-d46e2867be79 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:43.970928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-87fe9104-8294-49fa-82f2-d46e2867be79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f076746940044dea883be6d4673c6bf3', 'request_id': 'req-87fe9104-8294-49fa-82f2-d46e2867be79'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:43.981130 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-87fe9104-8294-49fa-82f2-d46e2867be79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f076746940044dea883be6d4673c6bf3', 'request_id': 'req-87fe9104-8294-49fa-82f2-d46e2867be79'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:43.986095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:43.990277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-87fe9104-8294-49fa-82f2-d46e2867be79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f076746940044dea883be6d4673c6bf3', 'request_id': 'req-87fe9104-8294-49fa-82f2-d46e2867be79'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:44.004443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-87fe9104-8294-49fa-82f2-d46e2867be79 admin admin] The token cache is being invalidate because project f076746940044dea883be6d4673c6bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:44.004740 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-87fe9104-8294-49fa-82f2-d46e2867be79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:44.005430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-87fe9104-8294-49fa-82f2-d46e2867be79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:44.007006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1284/2587] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:43 2022] DELETE /identity/v3/projects/f076746940044dea883be6d4673c6bf3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:44.012074 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d54d0-50f2-4df7-becc-17815e449556 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:44.012647 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d54d0-50f2-4df7-becc-17815e449556 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:44.012647 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d54d0-50f2-4df7-becc-17815e449556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:44.032738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-e94d54d0-50f2-4df7-becc-17815e449556 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:44.034017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e94d54d0-50f2-4df7-becc-17815e449556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:44.097849 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1304/2588] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:44.107085 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57b380-eac2-4958-abe7-ea580c3111b8 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:44.107372 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57b380-eac2-4958-abe7-ea580c3111b8 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:44.107652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57b380-eac2-4958-abe7-ea580c3111b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:44.128752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-5f57b380-eac2-4958-abe7-ea580c3111b8 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:44.130030 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5f57b380-eac2-4958-abe7-ea580c3111b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:44.141952 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1285/2589] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:44.146450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d54d0-50f2-4df7-becc-17815e449556 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:44.157306 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d54d0-50f2-4df7-becc-17815e449556 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:44.162125 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c690312-1048-4c4f-9d24-98e5ad921fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:44.163274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c690312-1048-4c4f-9d24-98e5ad921fae admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:44.163274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c690312-1048-4c4f-9d24-98e5ad921fae admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:44.163274 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c690312-1048-4c4f-9d24-98e5ad921fae admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:44.164302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c690312-1048-4c4f-9d24-98e5ad921fae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:02:44.164302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c690312-1048-4c4f-9d24-98e5ad921fae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:44.165873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c690312-1048-4c4f-9d24-98e5ad921fae admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:44.178611 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1305/2590] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:02:44.183175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57b380-eac2-4958-abe7-ea580c3111b8 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:44.192461 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57b380-eac2-4958-abe7-ea580c3111b8 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:44.197346 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b559b-dd65-4875-9c30-26a000167ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:44.197871 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b559b-dd65-4875-9c30-26a000167ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:44.198161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b559b-dd65-4875-9c30-26a000167ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:44.198498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b559b-dd65-4875-9c30-26a000167ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:44.199168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b559b-dd65-4875-9c30-26a000167ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:44.201164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b559b-dd65-4875-9c30-26a000167ab1 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:44.235302 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1286/2591] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:44 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:02:44.239778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c690312-1048-4c4f-9d24-98e5ad921fae admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:44.250436 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c690312-1048-4c4f-9d24-98e5ad921fae admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:44.309291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636cd60-d6d4-436a-94b9-c3efc2775295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:44.310078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636cd60-d6d4-436a-94b9-c3efc2775295 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:44.310365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636cd60-d6d4-436a-94b9-c3efc2775295 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:44.310716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636cd60-d6d4-436a-94b9-c3efc2775295 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:44.311273 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636cd60-d6d4-436a-94b9-c3efc2775295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:44.313246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636cd60-d6d4-436a-94b9-c3efc2775295 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:44.332363 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:44.339442 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1306/2592] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:44 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:44.344509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b559b-dd65-4875-9c30-26a000167ab1 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:44.356137 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b559b-dd65-4875-9c30-26a000167ab1 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:44.362543 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a2902-1b2c-4401-811e-9e46d7e7bfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:44.363169 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a2902-1b2c-4401-811e-9e46d7e7bfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:44.363482 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a2902-1b2c-4401-811e-9e46d7e7bfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:44.363758 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a2902-1b2c-4401-811e-9e46d7e7bfa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:44.364557 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a2902-1b2c-4401-811e-9e46d7e7bfa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:44.366198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a2902-1b2c-4401-811e-9e46d7e7bfa8 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:44.377886 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1287/2593] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 09:02:44.382143 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636cd60-d6d4-436a-94b9-c3efc2775295 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:44.392499 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636cd60-d6d4-436a-94b9-c3efc2775295 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:44.397280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8629a-6621-49b4-aa39-56077f87a89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:44.397892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8629a-6621-49b4-aa39-56077f87a89d admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:44.398178 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8629a-6621-49b4-aa39-56077f87a89d admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:44.398458 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8629a-6621-49b4-aa39-56077f87a89d admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:44.399107 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8629a-6621-49b4-aa39-56077f87a89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:44.400742 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8629a-6621-49b4-aa39-56077f87a89d admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:44.414635 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1307/2594] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 09:02:44.419478 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a2902-1b2c-4401-811e-9e46d7e7bfa8 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:44.429839 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a2902-1b2c-4401-811e-9e46d7e7bfa8 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:44.434672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74080ec7-c0fb-482b-9612-b610a425d67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:44.435325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74080ec7-c0fb-482b-9612-b610a425d67f admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:44.435610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74080ec7-c0fb-482b-9612-b610a425d67f admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:44.435888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74080ec7-c0fb-482b-9612-b610a425d67f admin admin] PATH_INFO: `/v3/projects/7d2f93fd22d445358a11f59da7060dc6/users/e93859fe58674f7ab071e7116b7b976f/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:44.452260 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74080ec7-c0fb-482b-9612-b610a425d67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2f93fd22d445358a11f59da7060dc6, user_id=e93859fe58674f7ab071e7116b7b976f, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:44.454911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74080ec7-c0fb-482b-9612-b610a425d67f admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:44.470000 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1288/2595] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:44 2022] PUT /identity/v3/projects/7d2f93fd22d445358a11f59da7060dc6/users/e93859fe58674f7ab071e7116b7b976f/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:44.480724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803eac2-d8ec-4bd2-99f2-c1b4bed8f707 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:44.481032 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803eac2-d8ec-4bd2-99f2-c1b4bed8f707 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:44.481936 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803eac2-d8ec-4bd2-99f2-c1b4bed8f707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:44.510208 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-6803eac2-d8ec-4bd2-99f2-c1b4bed8f707 None None] MFA Rules not processed for user `e93859fe58674f7ab071e7116b7b976f`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:44.511437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6803eac2-d8ec-4bd2-99f2-c1b4bed8f707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:44.581766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1308/2596] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:44.586428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74080ec7-c0fb-482b-9612-b610a425d67f admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:44.649484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74080ec7-c0fb-482b-9612-b610a425d67f admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:44.655772 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2f89e-56ad-41a6-9ccb-7f165c897965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:44.656391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2f89e-56ad-41a6-9ccb-7f165c897965 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:44.656675 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2f89e-56ad-41a6-9ccb-7f165c897965 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:44.656951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2f89e-56ad-41a6-9ccb-7f165c897965 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:44.657610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2f89e-56ad-41a6-9ccb-7f165c897965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:44.659509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2f89e-56ad-41a6-9ccb-7f165c897965 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:44.686506 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1289/2597] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:44 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:44.690558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803eac2-d8ec-4bd2-99f2-c1b4bed8f707 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:44.702698 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803eac2-d8ec-4bd2-99f2-c1b4bed8f707 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:44.787397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2f89e-56ad-41a6-9ccb-7f165c897965 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:44.789194 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1da2f89e-56ad-41a6-9ccb-7f165c897965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:44.866854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2f89e-56ad-41a6-9ccb-7f165c897965 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:44.873042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd2c8f-48a4-44c2-afda-375e9fb4c8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:44.873714 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd2c8f-48a4-44c2-afda-375e9fb4c8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:44.873995 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd2c8f-48a4-44c2-afda-375e9fb4c8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:44.874335 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd2c8f-48a4-44c2-afda-375e9fb4c8e7 admin admin] PATH_INFO: `/v3/users/9c9d339b6d8d4b6fae3d1716c74433c8` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:44.875644 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd2c8f-48a4-44c2-afda-375e9fb4c8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9d339b6d8d4b6fae3d1716c74433c8)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:44.877830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd2c8f-48a4-44c2-afda-375e9fb4c8e7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:44.891333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:44.892260 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9e95b-9b1e-4924-84dd-b9848b43bcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:44.892981 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9e95b-9b1e-4924-84dd-b9848b43bcd7 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:44.893310 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9e95b-9b1e-4924-84dd-b9848b43bcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:44.893748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9e95b-9b1e-4924-84dd-b9848b43bcd7 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:44.894321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9e95b-9b1e-4924-84dd-b9848b43bcd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:44.896286 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9e95b-9b1e-4924-84dd-b9848b43bcd7 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:44.921653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1309/2598] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:44 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:44.927548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9e95b-9b1e-4924-84dd-b9848b43bcd7 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:44.937097 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e6dd2c8f-48a4-44c2-afda-375e9fb4c8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9d339b6d8d4b6fae3d1716c74433c8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:44.939663 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9e95b-9b1e-4924-84dd-b9848b43bcd7 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:44.944510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2a820-9cdc-47ce-ae3f-36b8a09f3000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:44.945136 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2a820-9cdc-47ce-ae3f-36b8a09f3000 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:44.945416 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2a820-9cdc-47ce-ae3f-36b8a09f3000 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:44.945688 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2a820-9cdc-47ce-ae3f-36b8a09f3000 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:44.946077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e6dd2c8f-48a4-44c2-afda-375e9fb4c8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9d339b6d8d4b6fae3d1716c74433c8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:44.946327 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2a820-9cdc-47ce-ae3f-36b8a09f3000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:44.946761 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e6dd2c8f-48a4-44c2-afda-375e9fb4c8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9d339b6d8d4b6fae3d1716c74433c8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:44.947472 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e6dd2c8f-48a4-44c2-afda-375e9fb4c8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9d339b6d8d4b6fae3d1716c74433c8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:44.947970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2a820-9cdc-47ce-ae3f-36b8a09f3000 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:44.958332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-e6dd2c8f-48a4-44c2-afda-375e9fb4c8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9d339b6d8d4b6fae3d1716c74433c8'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:44.959585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1310/2599] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 09:02:44.964030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2a820-9cdc-47ce-ae3f-36b8a09f3000 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:44.965895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c7d2a820-9cdc-47ce-ae3f-36b8a09f3000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:44.979272 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2a820-9cdc-47ce-ae3f-36b8a09f3000 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:44.979691 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1290/2600] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:44 2022] DELETE /identity/v3/users/9c9d339b6d8d4b6fae3d1716c74433c8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:44.984342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538628a-76a2-49a2-8cdf-5f1a807acc78 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:44.984632 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538628a-76a2-49a2-8cdf-5f1a807acc78 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:44.984914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538628a-76a2-49a2-8cdf-5f1a807acc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:45.006493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-b538628a-76a2-49a2-8cdf-5f1a807acc78 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:45.007748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b538628a-76a2-49a2-8cdf-5f1a807acc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:45.035389 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:45.043098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc699563-251f-45c2-9892-68736c9426a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:45.044228 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc699563-251f-45c2-9892-68736c9426a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:45.044834 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc699563-251f-45c2-9892-68736c9426a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:45.045398 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc699563-251f-45c2-9892-68736c9426a9 admin admin] PATH_INFO: `/v3/projects/d6eb1628e2a54b89b1443039670473ab/users/9e83a14d477d4872897221e43815b179/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:45.061562 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc699563-251f-45c2-9892-68736c9426a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6eb1628e2a54b89b1443039670473ab, user_id=9e83a14d477d4872897221e43815b179, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:45.064233 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc699563-251f-45c2-9892-68736c9426a9 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:45.073061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1291/2601] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:02:45.079066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1311/2602] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:44 2022] PUT /identity/v3/projects/d6eb1628e2a54b89b1443039670473ab/users/9e83a14d477d4872897221e43815b179/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:45.083204 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538628a-76a2-49a2-8cdf-5f1a807acc78 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:45.083367 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc699563-251f-45c2-9892-68736c9426a9 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:45.085097 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-bc699563-251f-45c2-9892-68736c9426a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:45.093506 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538628a-76a2-49a2-8cdf-5f1a807acc78 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:45.149021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc699563-251f-45c2-9892-68736c9426a9 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:45.152683 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c9fe2-9fb2-49b4-a339-9122fdcc69f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:45.153356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c9fe2-9fb2-49b4-a339-9122fdcc69f8 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:45.153637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c9fe2-9fb2-49b4-a339-9122fdcc69f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:45.153911 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c9fe2-9fb2-49b4-a339-9122fdcc69f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:45.154626 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaeccfc-0e9b-4db7-a071-5cf66c5fcc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:45.155248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaeccfc-0e9b-4db7-a071-5cf66c5fcc2d admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:45.155537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaeccfc-0e9b-4db7-a071-5cf66c5fcc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:45.155816 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaeccfc-0e9b-4db7-a071-5cf66c5fcc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:45.156469 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaeccfc-0e9b-4db7-a071-5cf66c5fcc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:45.158426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaeccfc-0e9b-4db7-a071-5cf66c5fcc2d admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:45.164108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c9fe2-9fb2-49b4-a339-9122fdcc69f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:45.166298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c9fe2-9fb2-49b4-a339-9122fdcc69f8 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:45.168847 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1292/2603] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:45.173933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaeccfc-0e9b-4db7-a071-5cf66c5fcc2d admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:45.176188 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1312/2604] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 09:02:45.185096 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaeccfc-0e9b-4db7-a071-5cf66c5fcc2d admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:45.189922 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586895f-a6c7-4926-8a64-9e971abc7cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:45.190586 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586895f-a6c7-4926-8a64-9e971abc7cac admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:45.191008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586895f-a6c7-4926-8a64-9e971abc7cac admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:45.191292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586895f-a6c7-4926-8a64-9e971abc7cac admin admin] PATH_INFO: `/v3/projects/d6eb1628e2a54b89b1443039670473ab/users/9e83a14d477d4872897221e43815b179/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:45.193637 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586895f-a6c7-4926-8a64-9e971abc7cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6eb1628e2a54b89b1443039670473ab, user_id=9e83a14d477d4872897221e43815b179, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:45.196361 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586895f-a6c7-4926-8a64-9e971abc7cac admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:45.208068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1293/2605] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:45 2022] PUT /identity/v3/projects/d6eb1628e2a54b89b1443039670473ab/users/9e83a14d477d4872897221e43815b179/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:45.220416 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef46f60-bb22-4bca-84bf-93e5ff7b8f08 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:45.220632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef46f60-bb22-4bca-84bf-93e5ff7b8f08 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:45.220910 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef46f60-bb22-4bca-84bf-93e5ff7b8f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:45.254309 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-7ef46f60-bb22-4bca-84bf-93e5ff7b8f08 None None] MFA Rules not processed for user `9e83a14d477d4872897221e43815b179`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:45.255766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-7ef46f60-bb22-4bca-84bf-93e5ff7b8f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:45.334254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1313/2606] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:45.346749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586895f-a6c7-4926-8a64-9e971abc7cac admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:45.348592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-9586895f-a6c7-4926-8a64-9e971abc7cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:45.364549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:45.412595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586895f-a6c7-4926-8a64-9e971abc7cac admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:45.416408 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a3998-6566-4c1f-9c41-42a416a00fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:45.417071 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a3998-6566-4c1f-9c41-42a416a00fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:45.417362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a3998-6566-4c1f-9c41-42a416a00fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:45.417647 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a3998-6566-4c1f-9c41-42a416a00fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:45.434988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a3998-6566-4c1f-9c41-42a416a00fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:45.437601 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a3998-6566-4c1f-9c41-42a416a00fd3 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:45.452112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1294/2607] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:45.467687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef46f60-bb22-4bca-84bf-93e5ff7b8f08 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:45.469461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-7ef46f60-bb22-4bca-84bf-93e5ff7b8f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:45.482356 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a3998-6566-4c1f-9c41-42a416a00fd3 service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:45.563071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef46f60-bb22-4bca-84bf-93e5ff7b8f08 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:45.565932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a3998-6566-4c1f-9c41-42a416a00fd3 service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:45.568441 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d6902-0af8-4417-95a9-8a9552d332d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:45.569105 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d6902-0af8-4417-95a9-8a9552d332d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:45.569396 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d6902-0af8-4417-95a9-8a9552d332d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:45.569677 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d6902-0af8-4417-95a9-8a9552d332d9 admin admin] PATH_INFO: `/v3/projects/fb93a26e6ab64731ac82ca6a8fd41127` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:45.570956 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5ff7b-b3d2-429a-8e4e-2f5a82c0cb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:45.571166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d6902-0af8-4417-95a9-8a9552d332d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb93a26e6ab64731ac82ca6a8fd41127)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:45.571336 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5ff7b-b3d2-429a-8e4e-2f5a82c0cb04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:45.571618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5ff7b-b3d2-429a-8e4e-2f5a82c0cb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:45.572004 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5ff7b-b3d2-429a-8e4e-2f5a82c0cb04 admin admin] PATH_INFO: `/v3/users/e93859fe58674f7ab071e7116b7b976f` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:45.573310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5ff7b-b3d2-429a-8e4e-2f5a82c0cb04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e93859fe58674f7ab071e7116b7b976f)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:45.573732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d6902-0af8-4417-95a9-8a9552d332d9 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:45.575298 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5ff7b-b3d2-429a-8e4e-2f5a82c0cb04 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:45.585831 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:45.635987 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1bb5ff7b-b3d2-429a-8e4e-2f5a82c0cb04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e93859fe58674f7ab071e7116b7b976f'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:45.643775 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-323d6902-0af8-4417-95a9-8a9552d332d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb93a26e6ab64731ac82ca6a8fd41127', 'request_id': 'req-323d6902-0af8-4417-95a9-8a9552d332d9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:45.646780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1bb5ff7b-b3d2-429a-8e4e-2f5a82c0cb04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e93859fe58674f7ab071e7116b7b976f'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:45.647693 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1bb5ff7b-b3d2-429a-8e4e-2f5a82c0cb04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e93859fe58674f7ab071e7116b7b976f'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:45.648401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1bb5ff7b-b3d2-429a-8e4e-2f5a82c0cb04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e93859fe58674f7ab071e7116b7b976f'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:45.651384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-323d6902-0af8-4417-95a9-8a9552d332d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb93a26e6ab64731ac82ca6a8fd41127', 'request_id': 'req-323d6902-0af8-4417-95a9-8a9552d332d9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:45.657084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1bb5ff7b-b3d2-429a-8e4e-2f5a82c0cb04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e93859fe58674f7ab071e7116b7b976f'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:45.659830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-323d6902-0af8-4417-95a9-8a9552d332d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb93a26e6ab64731ac82ca6a8fd41127', 'request_id': 'req-323d6902-0af8-4417-95a9-8a9552d332d9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:45.673778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-323d6902-0af8-4417-95a9-8a9552d332d9 admin admin] The token cache is being invalidate because project fb93a26e6ab64731ac82ca6a8fd41127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:45.674076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-323d6902-0af8-4417-95a9-8a9552d332d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:45.674739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-323d6902-0af8-4417-95a9-8a9552d332d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:45.675630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1295/2608] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:45 2022] DELETE /identity/v3/users/e93859fe58674f7ab071e7116b7b976f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:45.676386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1314/2609] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:45 2022] DELETE /identity/v3/projects/fb93a26e6ab64731ac82ca6a8fd41127 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:45.680247 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d6902-0af8-4417-95a9-8a9552d332d9 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:45.680634 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe16b3-42ea-43e3-b4cd-ea35e941f45b None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:45.680928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe16b3-42ea-43e3-b4cd-ea35e941f45b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:45.681243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe16b3-42ea-43e3-b4cd-ea35e941f45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:45.681699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-323d6902-0af8-4417-95a9-8a9552d332d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:45.700454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-c2fe16b3-42ea-43e3-b4cd-ea35e941f45b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:45.701728 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c2fe16b3-42ea-43e3-b4cd-ea35e941f45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:45.733082 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:45.751537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d6902-0af8-4417-95a9-8a9552d332d9 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:45.767236 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1296/2610] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:45.776938 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe16b3-42ea-43e3-b4cd-ea35e941f45b None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:45.783192 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c2fe16b3-42ea-43e3-b4cd-ea35e941f45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:45.822562 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3737608-92de-4eb1-8da5-8aa67bd5d006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:45.823215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3737608-92de-4eb1-8da5-8aa67bd5d006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:45.823525 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3737608-92de-4eb1-8da5-8aa67bd5d006 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:45.823801 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3737608-92de-4eb1-8da5-8aa67bd5d006 admin admin] PATH_INFO: `/v3/users/79ab3b99ef294621acf4501b8b1006bc` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:45.825093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3737608-92de-4eb1-8da5-8aa67bd5d006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ab3b99ef294621acf4501b8b1006bc)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:45.827159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3737608-92de-4eb1-8da5-8aa67bd5d006 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:45.846127 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe16b3-42ea-43e3-b4cd-ea35e941f45b None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:45.849778 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0acc2-0dbc-40ba-b5fc-fb21d55a2d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:45.850393 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0acc2-0dbc-40ba-b5fc-fb21d55a2d9c service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:45.850674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0acc2-0dbc-40ba-b5fc-fb21d55a2d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:45.850944 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0acc2-0dbc-40ba-b5fc-fb21d55a2d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:45.862348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0acc2-0dbc-40ba-b5fc-fb21d55a2d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:45.863932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0acc2-0dbc-40ba-b5fc-fb21d55a2d9c service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:45.874184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1297/2611] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 09:02:45.876652 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:45.882141 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e3737608-92de-4eb1-8da5-8aa67bd5d006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ab3b99ef294621acf4501b8b1006bc'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:45.891262 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e3737608-92de-4eb1-8da5-8aa67bd5d006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ab3b99ef294621acf4501b8b1006bc'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:45.891892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e3737608-92de-4eb1-8da5-8aa67bd5d006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ab3b99ef294621acf4501b8b1006bc'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:45.900546 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e3737608-92de-4eb1-8da5-8aa67bd5d006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ab3b99ef294621acf4501b8b1006bc'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:45.914212 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-e3737608-92de-4eb1-8da5-8aa67bd5d006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ab3b99ef294621acf4501b8b1006bc'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:45.922784 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1315/2612] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:45 2022] DELETE /identity/v3/users/79ab3b99ef294621acf4501b8b1006bc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:46.491640 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0acc2-0dbc-40ba-b5fc-fb21d55a2d9c service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:46.493439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-77b0acc2-0dbc-40ba-b5fc-fb21d55a2d9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:46.525728 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0acc2-0dbc-40ba-b5fc-fb21d55a2d9c service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:46.556108 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3737608-92de-4eb1-8da5-8aa67bd5d006 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:46.557745 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e3737608-92de-4eb1-8da5-8aa67bd5d006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:46.606373 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8fbd2-33f7-469e-b057-38758b2819bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:46.607608 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8fbd2-33f7-469e-b057-38758b2819bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:46.607896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8fbd2-33f7-469e-b057-38758b2819bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:46.608173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8fbd2-33f7-469e-b057-38758b2819bb admin admin] PATH_INFO: `/v3/projects/7d2f93fd22d445358a11f59da7060dc6` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:46.609753 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8fbd2-33f7-469e-b057-38758b2819bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2f93fd22d445358a11f59da7060dc6)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:46.612019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8fbd2-33f7-469e-b057-38758b2819bb admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:46.650349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3737608-92de-4eb1-8da5-8aa67bd5d006 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:46.663124 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-3ea8fbd2-33f7-469e-b057-38758b2819bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2f93fd22d445358a11f59da7060dc6', 'request_id': 'req-3ea8fbd2-33f7-469e-b057-38758b2819bb'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:46.669859 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-3ea8fbd2-33f7-469e-b057-38758b2819bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2f93fd22d445358a11f59da7060dc6', 'request_id': 'req-3ea8fbd2-33f7-469e-b057-38758b2819bb'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:46.678236 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-3ea8fbd2-33f7-469e-b057-38758b2819bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2f93fd22d445358a11f59da7060dc6', 'request_id': 'req-3ea8fbd2-33f7-469e-b057-38758b2819bb'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:46.689391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-3ea8fbd2-33f7-469e-b057-38758b2819bb admin admin] The token cache is being invalidate because project 7d2f93fd22d445358a11f59da7060dc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:46.689678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-3ea8fbd2-33f7-469e-b057-38758b2819bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:46.690314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-3ea8fbd2-33f7-469e-b057-38758b2819bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:46.691823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1298/2613] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:46 2022] DELETE /identity/v3/projects/7d2f93fd22d445358a11f59da7060dc6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:46.696240 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8fbd2-33f7-469e-b057-38758b2819bb admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:46.697631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3ea8fbd2-33f7-469e-b057-38758b2819bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:46.707625 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:46.712655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a873dc-e581-40d9-ac8c-bbf0eb684a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:46.713235 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a873dc-e581-40d9-ac8c-bbf0eb684a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:46.713538 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a873dc-e581-40d9-ac8c-bbf0eb684a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:46.713815 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a873dc-e581-40d9-ac8c-bbf0eb684a40 admin admin] PATH_INFO: `/v3/projects/7940310964ee4ffa96534083a8b20a80` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:46.715016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a873dc-e581-40d9-ac8c-bbf0eb684a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7940310964ee4ffa96534083a8b20a80)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:46.717509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a873dc-e581-40d9-ac8c-bbf0eb684a40 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:46.769930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-33a873dc-e581-40d9-ac8c-bbf0eb684a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7940310964ee4ffa96534083a8b20a80', 'request_id': 'req-33a873dc-e581-40d9-ac8c-bbf0eb684a40'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:46.776772 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-33a873dc-e581-40d9-ac8c-bbf0eb684a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7940310964ee4ffa96534083a8b20a80', 'request_id': 'req-33a873dc-e581-40d9-ac8c-bbf0eb684a40'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:46.780250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8fbd2-33f7-469e-b057-38758b2819bb admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:46.785762 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-33a873dc-e581-40d9-ac8c-bbf0eb684a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7940310964ee4ffa96534083a8b20a80', 'request_id': 'req-33a873dc-e581-40d9-ac8c-bbf0eb684a40'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:46.794701 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:46.799860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-33a873dc-e581-40d9-ac8c-bbf0eb684a40 admin admin] The token cache is being invalidate because project 7940310964ee4ffa96534083a8b20a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:46.800674 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-33a873dc-e581-40d9-ac8c-bbf0eb684a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:46.802105 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-33a873dc-e581-40d9-ac8c-bbf0eb684a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:46.803791 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1316/2614] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:46 2022] DELETE /identity/v3/projects/7940310964ee4ffa96534083a8b20a80 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:46.808873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1ff2d-c26e-4f84-a74b-7a3d84f45012 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:46.809123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1ff2d-c26e-4f84-a74b-7a3d84f45012 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:46.810233 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1ff2d-c26e-4f84-a74b-7a3d84f45012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:46.831222 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-89f1ff2d-c26e-4f84-a74b-7a3d84f45012 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:46.832479 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-89f1ff2d-c26e-4f84-a74b-7a3d84f45012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:46.844780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2575c5d-0bd4-4ed3-a5bf-4e52dafea654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:46.845461 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2575c5d-0bd4-4ed3-a5bf-4e52dafea654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:46.845739 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2575c5d-0bd4-4ed3-a5bf-4e52dafea654 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:46.846014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2575c5d-0bd4-4ed3-a5bf-4e52dafea654 admin admin] PATH_INFO: `/v3/users/9e83a14d477d4872897221e43815b179` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:46.847184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2575c5d-0bd4-4ed3-a5bf-4e52dafea654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e83a14d477d4872897221e43815b179)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:46.849152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2575c5d-0bd4-4ed3-a5bf-4e52dafea654 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:46.901013 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a2575c5d-0bd4-4ed3-a5bf-4e52dafea654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e83a14d477d4872897221e43815b179'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:46.908413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1317/2615] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:02:46.910170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a2575c5d-0bd4-4ed3-a5bf-4e52dafea654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e83a14d477d4872897221e43815b179'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:46.910801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a2575c5d-0bd4-4ed3-a5bf-4e52dafea654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e83a14d477d4872897221e43815b179'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:46.911430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a2575c5d-0bd4-4ed3-a5bf-4e52dafea654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e83a14d477d4872897221e43815b179'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:46.916139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92991e4a-bb80-43ea-8d1c-8d1dc9ace944 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:46.916437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92991e4a-bb80-43ea-8d1c-8d1dc9ace944 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:46.916717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92991e4a-bb80-43ea-8d1c-8d1dc9ace944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:46.920047 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-a2575c5d-0bd4-4ed3-a5bf-4e52dafea654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e83a14d477d4872897221e43815b179'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:46.937275 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-92991e4a-bb80-43ea-8d1c-8d1dc9ace944 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:46.938503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-92991e4a-bb80-43ea-8d1c-8d1dc9ace944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:46.938714 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1299/2616] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:46 2022] DELETE /identity/v3/users/9e83a14d477d4872897221e43815b179 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:47.007736 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1318/2617] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:02:47.012375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2575c5d-0bd4-4ed3-a5bf-4e52dafea654 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:47.023561 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2575c5d-0bd4-4ed3-a5bf-4e52dafea654 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:47.028449 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939f3fa-3fe0-4b2e-86fd-ed70b21e3f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:47.029107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939f3fa-3fe0-4b2e-86fd-ed70b21e3f5b admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.029391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939f3fa-3fe0-4b2e-86fd-ed70b21e3f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.029661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939f3fa-3fe0-4b2e-86fd-ed70b21e3f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.030316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939f3fa-3fe0-4b2e-86fd-ed70b21e3f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:02:47.030615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939f3fa-3fe0-4b2e-86fd-ed70b21e3f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:47.032266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939f3fa-3fe0-4b2e-86fd-ed70b21e3f5b admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:47.046288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1300/2618] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 09:02:47.050757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92991e4a-bb80-43ea-8d1c-8d1dc9ace944 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:47.061500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92991e4a-bb80-43ea-8d1c-8d1dc9ace944 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:47.066135 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13f872-3d03-4682-846b-da73b63cc6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:47.066754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13f872-3d03-4682-846b-da73b63cc6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.067036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13f872-3d03-4682-846b-da73b63cc6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.067308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13f872-3d03-4682-846b-da73b63cc6c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.067942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13f872-3d03-4682-846b-da73b63cc6c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:47.069876 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13f872-3d03-4682-846b-da73b63cc6c7 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:47.117052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1319/2619] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:47 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:47.121333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939f3fa-3fe0-4b2e-86fd-ed70b21e3f5b admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:47.133612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939f3fa-3fe0-4b2e-86fd-ed70b21e3f5b admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:47.154266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:47.200022 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d9ed4-8131-47ea-a90a-83ec1d661d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:47.200672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d9ed4-8131-47ea-a90a-83ec1d661d76 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.200956 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d9ed4-8131-47ea-a90a-83ec1d661d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.202355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d9ed4-8131-47ea-a90a-83ec1d661d76 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.202355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d9ed4-8131-47ea-a90a-83ec1d661d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:47.203795 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d9ed4-8131-47ea-a90a-83ec1d661d76 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:47.225980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1301/2620] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:47 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:47.230300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13f872-3d03-4682-846b-da73b63cc6c7 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:47.238406 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d9ed4-8131-47ea-a90a-83ec1d661d76 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:47.245911 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-800d9ed4-8131-47ea-a90a-83ec1d661d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:47.250130 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13f872-3d03-4682-846b-da73b63cc6c7 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:47.254594 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518becb-d82b-4d8f-a970-c96841665ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:47.254777 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d9ed4-8131-47ea-a90a-83ec1d661d76 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:47.255213 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518becb-d82b-4d8f-a970-c96841665ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.255536 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518becb-d82b-4d8f-a970-c96841665ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.255759 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518becb-d82b-4d8f-a970-c96841665ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.256400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518becb-d82b-4d8f-a970-c96841665ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:47.258036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518becb-d82b-4d8f-a970-c96841665ab6 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:47.259972 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020b632-c29c-4a36-b91c-bcbfd4f0dd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:47.260702 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020b632-c29c-4a36-b91c-bcbfd4f0dd79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.261136 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020b632-c29c-4a36-b91c-bcbfd4f0dd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.261505 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020b632-c29c-4a36-b91c-bcbfd4f0dd79 admin admin] PATH_INFO: `/v3/projects/d6eb1628e2a54b89b1443039670473ab` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.262774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020b632-c29c-4a36-b91c-bcbfd4f0dd79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6eb1628e2a54b89b1443039670473ab)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:47.264845 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020b632-c29c-4a36-b91c-bcbfd4f0dd79 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:47.268975 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1320/2621] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:47.273665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518becb-d82b-4d8f-a970-c96841665ab6 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:47.284404 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518becb-d82b-4d8f-a970-c96841665ab6 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:47.289202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423c31f-490b-4adf-95c0-d66e9b147565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:47.289804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423c31f-490b-4adf-95c0-d66e9b147565 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.290084 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423c31f-490b-4adf-95c0-d66e9b147565 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.290357 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423c31f-490b-4adf-95c0-d66e9b147565 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.290993 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423c31f-490b-4adf-95c0-d66e9b147565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:47.292595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423c31f-490b-4adf-95c0-d66e9b147565 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:47.304578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1321/2622] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:47.308767 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423c31f-490b-4adf-95c0-d66e9b147565 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:47.318738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423c31f-490b-4adf-95c0-d66e9b147565 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:47.323516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6020b632-c29c-4a36-b91c-bcbfd4f0dd79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6eb1628e2a54b89b1443039670473ab', 'request_id': 'req-6020b632-c29c-4a36-b91c-bcbfd4f0dd79'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:47.330779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6020b632-c29c-4a36-b91c-bcbfd4f0dd79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6eb1628e2a54b89b1443039670473ab', 'request_id': 'req-6020b632-c29c-4a36-b91c-bcbfd4f0dd79'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:47.338939 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6020b632-c29c-4a36-b91c-bcbfd4f0dd79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6eb1628e2a54b89b1443039670473ab', 'request_id': 'req-6020b632-c29c-4a36-b91c-bcbfd4f0dd79'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:47.350676 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6020b632-c29c-4a36-b91c-bcbfd4f0dd79 admin admin] The token cache is being invalidate because project d6eb1628e2a54b89b1443039670473ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:47.350970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6020b632-c29c-4a36-b91c-bcbfd4f0dd79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:47.351745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6020b632-c29c-4a36-b91c-bcbfd4f0dd79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:47.353295 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1302/2623] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:47 2022] DELETE /identity/v3/projects/d6eb1628e2a54b89b1443039670473ab => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:47.359266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50bbc3-1a0e-4247-9549-d257cf77c4a4 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.359556 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50bbc3-1a0e-4247-9549-d257cf77c4a4 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.359832 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50bbc3-1a0e-4247-9549-d257cf77c4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.375803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:47.379042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-4c50bbc3-1a0e-4247-9549-d257cf77c4a4 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:47.380597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-4c50bbc3-1a0e-4247-9549-d257cf77c4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:47.383113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6212213-90d9-4934-9759-baa01a0be8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:47.383918 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6212213-90d9-4934-9759-baa01a0be8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.384284 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6212213-90d9-4934-9759-baa01a0be8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.385131 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6212213-90d9-4934-9759-baa01a0be8e0 admin admin] PATH_INFO: `/v3/projects/b7bab9cc4ee14285b1c201b00a3d3384/users/506bc3d80d6f4cbe86554f15805a6e82/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.389659 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1303/2624] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:02:47.397699 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a19d9-7858-4a6d-867a-ccb86e72f177 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.398210 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a19d9-7858-4a6d-867a-ccb86e72f177 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.398487 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a19d9-7858-4a6d-867a-ccb86e72f177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.401460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6212213-90d9-4934-9759-baa01a0be8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7bab9cc4ee14285b1c201b00a3d3384, user_id=506bc3d80d6f4cbe86554f15805a6e82, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:47.404652 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6212213-90d9-4934-9759-baa01a0be8e0 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:47.419746 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1322/2625] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:47 2022] PUT /identity/v3/projects/b7bab9cc4ee14285b1c201b00a3d3384/users/506bc3d80d6f4cbe86554f15805a6e82/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:47.420240 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-e42a19d9-7858-4a6d-867a-ccb86e72f177 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:47.421495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-e42a19d9-7858-4a6d-867a-ccb86e72f177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:47.432169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dfc2d-93cb-44d9-aebf-915501b68e9d None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.432769 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dfc2d-93cb-44d9-aebf-915501b68e9d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.433081 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dfc2d-93cb-44d9-aebf-915501b68e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.460832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-576dfc2d-93cb-44d9-aebf-915501b68e9d None None] MFA Rules not processed for user `506bc3d80d6f4cbe86554f15805a6e82`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:47.462077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-576dfc2d-93cb-44d9-aebf-915501b68e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:47.483614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1304/2626] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:47.487998 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a19d9-7858-4a6d-867a-ccb86e72f177 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:47.497310 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a19d9-7858-4a6d-867a-ccb86e72f177 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:47.502650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636d65e-d5e9-4dc3-b2fc-5749869c51e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:47.503264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636d65e-d5e9-4dc3-b2fc-5749869c51e7 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.503546 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636d65e-d5e9-4dc3-b2fc-5749869c51e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.503902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636d65e-d5e9-4dc3-b2fc-5749869c51e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.504570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636d65e-d5e9-4dc3-b2fc-5749869c51e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:02:47.504884 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636d65e-d5e9-4dc3-b2fc-5749869c51e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:47.506511 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636d65e-d5e9-4dc3-b2fc-5749869c51e7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:47.519149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1305/2627] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 09:02:47.523611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636d65e-d5e9-4dc3-b2fc-5749869c51e7 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:47.535390 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636d65e-d5e9-4dc3-b2fc-5749869c51e7 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:47.537181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1323/2628] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:02:47.540462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cdb27-7ff8-46ab-9771-a60933f64b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:47.541367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cdb27-7ff8-46ab-9771-a60933f64b28 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.541651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cdb27-7ff8-46ab-9771-a60933f64b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.541927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cdb27-7ff8-46ab-9771-a60933f64b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.542566 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cdb27-7ff8-46ab-9771-a60933f64b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:47.544635 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cdb27-7ff8-46ab-9771-a60933f64b28 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:47.549292 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dfc2d-93cb-44d9-aebf-915501b68e9d None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:47.550699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-576dfc2d-93cb-44d9-aebf-915501b68e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:47.557333 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:47.580003 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1306/2629] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:47 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:02:47.581045 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cdb27-7ff8-46ab-9771-a60933f64b28 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:47.616252 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dfc2d-93cb-44d9-aebf-915501b68e9d None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:47.670779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cdb27-7ff8-46ab-9771-a60933f64b28 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:47.676965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b17dd-d51a-42b5-8f65-2b975391929a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:47.677602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b17dd-d51a-42b5-8f65-2b975391929a service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.677884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b17dd-d51a-42b5-8f65-2b975391929a service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.678040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd929cda-3ee6-4473-b46d-8ed2d91c235a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:47.678157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b17dd-d51a-42b5-8f65-2b975391929a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.678657 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd929cda-3ee6-4473-b46d-8ed2d91c235a admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.678940 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd929cda-3ee6-4473-b46d-8ed2d91c235a admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.679214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd929cda-3ee6-4473-b46d-8ed2d91c235a admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.679840 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd929cda-3ee6-4473-b46d-8ed2d91c235a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:47.681993 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd929cda-3ee6-4473-b46d-8ed2d91c235a admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:47.706067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1307/2630] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:47 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:47.709947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd929cda-3ee6-4473-b46d-8ed2d91c235a admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:47.721699 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd929cda-3ee6-4473-b46d-8ed2d91c235a admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:47.728019 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:47.728189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fc59d-4e33-4e11-9219-ec5852947064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:47.728888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fc59d-4e33-4e11-9219-ec5852947064 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.729062 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fc59d-4e33-4e11-9219-ec5852947064 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.729367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fc59d-4e33-4e11-9219-ec5852947064 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.730835 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fc59d-4e33-4e11-9219-ec5852947064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:47.732349 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fc59d-4e33-4e11-9219-ec5852947064 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:47.745784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1308/2631] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 09:02:47.746871 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fc59d-4e33-4e11-9219-ec5852947064 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:47.748065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b17dd-d51a-42b5-8f65-2b975391929a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:47.749559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b17dd-d51a-42b5-8f65-2b975391929a service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:47.756692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fc59d-4e33-4e11-9219-ec5852947064 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:47.760771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1324/2632] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 09:02:47.762000 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6145c-2516-40b4-95ff-4d7cb409d2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:47.763221 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6145c-2516-40b4-95ff-4d7cb409d2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.763499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6145c-2516-40b4-95ff-4d7cb409d2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.763767 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6145c-2516-40b4-95ff-4d7cb409d2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.764407 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6145c-2516-40b4-95ff-4d7cb409d2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:47.766027 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6145c-2516-40b4-95ff-4d7cb409d2c3 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:47.778944 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1309/2633] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:47.783350 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b17dd-d51a-42b5-8f65-2b975391929a service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:47.794197 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b17dd-d51a-42b5-8f65-2b975391929a service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:47.799252 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a21bed-afe9-4f4b-9cbb-a2ee6bbf2dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:47.799910 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a21bed-afe9-4f4b-9cbb-a2ee6bbf2dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.800193 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a21bed-afe9-4f4b-9cbb-a2ee6bbf2dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.800537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a21bed-afe9-4f4b-9cbb-a2ee6bbf2dc3 admin admin] PATH_INFO: `/v3/projects/ee0cfb3239644f09ab6d611bc9a14ac2/users/b848973cf4654284a8c125ec01f224bf/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.816042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a21bed-afe9-4f4b-9cbb-a2ee6bbf2dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee0cfb3239644f09ab6d611bc9a14ac2, user_id=b848973cf4654284a8c125ec01f224bf, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:47.818712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a21bed-afe9-4f4b-9cbb-a2ee6bbf2dc3 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:47.835298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1325/2634] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:47 2022] PUT /identity/v3/projects/ee0cfb3239644f09ab6d611bc9a14ac2/users/b848973cf4654284a8c125ec01f224bf/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:47.848322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aea8b-511b-4db9-b4b1-c5c584e76ae4 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:47.848606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aea8b-511b-4db9-b4b1-c5c584e76ae4 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:47.848887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aea8b-511b-4db9-b4b1-c5c584e76ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:47.880874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-7f6aea8b-511b-4db9-b4b1-c5c584e76ae4 None None] MFA Rules not processed for user `b848973cf4654284a8c125ec01f224bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:47.882264 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7f6aea8b-511b-4db9-b4b1-c5c584e76ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:47.961250 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1310/2635] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:02:47.965924 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a21bed-afe9-4f4b-9cbb-a2ee6bbf2dc3 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:48.049504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a21bed-afe9-4f4b-9cbb-a2ee6bbf2dc3 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:48.056280 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae6296-988e-4182-80ee-f2d109e97ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:48.056706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae6296-988e-4182-80ee-f2d109e97ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:48.057015 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae6296-988e-4182-80ee-f2d109e97ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:48.057304 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae6296-988e-4182-80ee-f2d109e97ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:48.057955 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae6296-988e-4182-80ee-f2d109e97ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:48.060597 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae6296-988e-4182-80ee-f2d109e97ee7 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:48.099285 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1326/2636] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:47 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:48.103201 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6aea8b-511b-4db9-b4b1-c5c584e76ae4 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:48.115906 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6aea8b-511b-4db9-b4b1-c5c584e76ae4 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:48.176568 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:48.190214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261063db-29a1-4355-81ea-cc8172094d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:48.190841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261063db-29a1-4355-81ea-cc8172094d33 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:48.191121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261063db-29a1-4355-81ea-cc8172094d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:48.191508 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261063db-29a1-4355-81ea-cc8172094d33 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:48.192012 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261063db-29a1-4355-81ea-cc8172094d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:48.194007 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261063db-29a1-4355-81ea-cc8172094d33 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:48.216941 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1311/2637] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:48 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:48.221422 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae6296-988e-4182-80ee-f2d109e97ee7 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:48.232602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae6296-988e-4182-80ee-f2d109e97ee7 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:48.238719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65356b4-a7d7-4d85-8118-959277d905c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:48.239349 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65356b4-a7d7-4d85-8118-959277d905c0 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:48.239630 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65356b4-a7d7-4d85-8118-959277d905c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:48.239898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65356b4-a7d7-4d85-8118-959277d905c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:48.240544 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65356b4-a7d7-4d85-8118-959277d905c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:48.242187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65356b4-a7d7-4d85-8118-959277d905c0 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:48.254298 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1327/2638] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:48.258897 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261063db-29a1-4355-81ea-cc8172094d33 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:48.269568 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261063db-29a1-4355-81ea-cc8172094d33 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:48.275200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51820941-5e6d-41ca-bab4-fbb902a3b09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:48.275943 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51820941-5e6d-41ca-bab4-fbb902a3b09c admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:48.276184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51820941-5e6d-41ca-bab4-fbb902a3b09c admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:48.276462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51820941-5e6d-41ca-bab4-fbb902a3b09c admin admin] PATH_INFO: `/v3/projects/61056d9eb81448229378a2de7b7bd8cd/users/9f499c5382334b64b7e16aa25b62fe9a/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:48.293293 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51820941-5e6d-41ca-bab4-fbb902a3b09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61056d9eb81448229378a2de7b7bd8cd, user_id=9f499c5382334b64b7e16aa25b62fe9a, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:48.296550 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51820941-5e6d-41ca-bab4-fbb902a3b09c admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:48.311936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1312/2639] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:48 2022] PUT /identity/v3/projects/61056d9eb81448229378a2de7b7bd8cd/users/9f499c5382334b64b7e16aa25b62fe9a/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:48.316376 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65356b4-a7d7-4d85-8118-959277d905c0 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:48.327250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65356b4-a7d7-4d85-8118-959277d905c0 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:48.388315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddc888-8d83-42aa-9c47-4e33db86173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:48.388929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddc888-8d83-42aa-9c47-4e33db86173f admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:48.389311 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddc888-8d83-42aa-9c47-4e33db86173f admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:48.389590 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddc888-8d83-42aa-9c47-4e33db86173f admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:48.390237 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddc888-8d83-42aa-9c47-4e33db86173f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:48.391852 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddc888-8d83-42aa-9c47-4e33db86173f admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:48.402537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1328/2640] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:48.407149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51820941-5e6d-41ca-bab4-fbb902a3b09c admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:48.417737 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51820941-5e6d-41ca-bab4-fbb902a3b09c admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:48.423043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185956ce-c38b-4689-8f1e-d812e5efc608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:48.423712 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185956ce-c38b-4689-8f1e-d812e5efc608 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:48.423996 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185956ce-c38b-4689-8f1e-d812e5efc608 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:48.424268 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185956ce-c38b-4689-8f1e-d812e5efc608 admin admin] PATH_INFO: `/v3/projects/61056d9eb81448229378a2de7b7bd8cd/users/9f499c5382334b64b7e16aa25b62fe9a/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:48.426242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185956ce-c38b-4689-8f1e-d812e5efc608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61056d9eb81448229378a2de7b7bd8cd, user_id=9f499c5382334b64b7e16aa25b62fe9a, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:48.428874 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185956ce-c38b-4689-8f1e-d812e5efc608 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:48.440730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1313/2641] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:48 2022] PUT /identity/v3/projects/61056d9eb81448229378a2de7b7bd8cd/users/9f499c5382334b64b7e16aa25b62fe9a/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:48.452706 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af844823-6b76-4de2-a660-b80545f57ed1 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:48.452986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af844823-6b76-4de2-a660-b80545f57ed1 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:48.453313 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af844823-6b76-4de2-a660-b80545f57ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:48.482511 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-af844823-6b76-4de2-a660-b80545f57ed1 None None] MFA Rules not processed for user `9f499c5382334b64b7e16aa25b62fe9a`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:48.484315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-af844823-6b76-4de2-a660-b80545f57ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:48.498277 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:48.556044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1329/2642] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:02:48.569212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185956ce-c38b-4689-8f1e-d812e5efc608 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:48.634824 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185956ce-c38b-4689-8f1e-d812e5efc608 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:48.637159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd70df-c2bf-4e37-922d-b5af52785cb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:48.638251 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd70df-c2bf-4e37-922d-b5af52785cb4 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:48.638251 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd70df-c2bf-4e37-922d-b5af52785cb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:48.638649 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd70df-c2bf-4e37-922d-b5af52785cb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:48.648548 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd70df-c2bf-4e37-922d-b5af52785cb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:48.650242 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd70df-c2bf-4e37-922d-b5af52785cb4 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:48.661322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1314/2643] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:48.728899 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af844823-6b76-4de2-a660-b80545f57ed1 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:48.794898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af844823-6b76-4de2-a660-b80545f57ed1 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:48.799613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2757fdc-ca66-4c0a-9c71-a1478dc140e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:48.800254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2757fdc-ca66-4c0a-9c71-a1478dc140e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:48.800539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2757fdc-ca66-4c0a-9c71-a1478dc140e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:48.800817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2757fdc-ca66-4c0a-9c71-a1478dc140e6 admin admin] PATH_INFO: `/v3/users/b848973cf4654284a8c125ec01f224bf` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:48.801995 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2757fdc-ca66-4c0a-9c71-a1478dc140e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b848973cf4654284a8c125ec01f224bf)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:48.803920 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2757fdc-ca66-4c0a-9c71-a1478dc140e6 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:48.850968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b2757fdc-ca66-4c0a-9c71-a1478dc140e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b848973cf4654284a8c125ec01f224bf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:48.859142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b2757fdc-ca66-4c0a-9c71-a1478dc140e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b848973cf4654284a8c125ec01f224bf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:48.859779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b2757fdc-ca66-4c0a-9c71-a1478dc140e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b848973cf4654284a8c125ec01f224bf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:48.867760 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b2757fdc-ca66-4c0a-9c71-a1478dc140e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b848973cf4654284a8c125ec01f224bf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:48.880620 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b2757fdc-ca66-4c0a-9c71-a1478dc140e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b848973cf4654284a8c125ec01f224bf'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:48.887365 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1330/2644] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:48 2022] DELETE /identity/v3/users/b848973cf4654284a8c125ec01f224bf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:48.892241 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe0b08-3f13-4334-a2a1-1ddbca493b41 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:48.892446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe0b08-3f13-4334-a2a1-1ddbca493b41 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:48.892718 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe0b08-3f13-4334-a2a1-1ddbca493b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:48.915065 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-3bbe0b08-3f13-4334-a2a1-1ddbca493b41 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:48.916309 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3bbe0b08-3f13-4334-a2a1-1ddbca493b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:48.981972 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1315/2645] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:48.991979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2757fdc-ca66-4c0a-9c71-a1478dc140e6 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:48.993987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b2757fdc-ca66-4c0a-9c71-a1478dc140e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:49.031832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:49.056725 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2757fdc-ca66-4c0a-9c71-a1478dc140e6 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:49.060513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3f8c3-9373-4234-97cd-e5ddc156f7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:49.061169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3f8c3-9373-4234-97cd-e5ddc156f7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:49.061450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3f8c3-9373-4234-97cd-e5ddc156f7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:49.061722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3f8c3-9373-4234-97cd-e5ddc156f7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:49.071476 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3f8c3-9373-4234-97cd-e5ddc156f7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:49.072917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3f8c3-9373-4234-97cd-e5ddc156f7b0 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:49.083751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1331/2646] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:49.378404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe0b08-3f13-4334-a2a1-1ddbca493b41 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:49.379842 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3bbe0b08-3f13-4334-a2a1-1ddbca493b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:49.392528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe0b08-3f13-4334-a2a1-1ddbca493b41 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:49.421554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72f059-de9c-4cee-8117-c1bd13ddb116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:49.421554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72f059-de9c-4cee-8117-c1bd13ddb116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:49.421554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72f059-de9c-4cee-8117-c1bd13ddb116 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:49.421554 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72f059-de9c-4cee-8117-c1bd13ddb116 admin admin] PATH_INFO: `/v3/projects/ee0cfb3239644f09ab6d611bc9a14ac2` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:49.422407 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb72f059-de9c-4cee-8117-c1bd13ddb116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee0cfb3239644f09ab6d611bc9a14ac2)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:49.422407 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb72f059-de9c-4cee-8117-c1bd13ddb116 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:49.471988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:49.486200 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-bb72f059-de9c-4cee-8117-c1bd13ddb116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee0cfb3239644f09ab6d611bc9a14ac2', 'request_id': 'req-bb72f059-de9c-4cee-8117-c1bd13ddb116'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:49.498377 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-bb72f059-de9c-4cee-8117-c1bd13ddb116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee0cfb3239644f09ab6d611bc9a14ac2', 'request_id': 'req-bb72f059-de9c-4cee-8117-c1bd13ddb116'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:49.509278 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-bb72f059-de9c-4cee-8117-c1bd13ddb116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee0cfb3239644f09ab6d611bc9a14ac2', 'request_id': 'req-bb72f059-de9c-4cee-8117-c1bd13ddb116'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:49.521534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-bb72f059-de9c-4cee-8117-c1bd13ddb116 admin admin] The token cache is being invalidate because project ee0cfb3239644f09ab6d611bc9a14ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:49.521973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-bb72f059-de9c-4cee-8117-c1bd13ddb116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:49.522765 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-bb72f059-de9c-4cee-8117-c1bd13ddb116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:49.524337 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1316/2647] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:49 2022] DELETE /identity/v3/projects/ee0cfb3239644f09ab6d611bc9a14ac2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:49.528408 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3f8c3-9373-4234-97cd-e5ddc156f7b0 service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:49.539430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3f8c3-9373-4234-97cd-e5ddc156f7b0 service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:49.614371 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215756a-bd2a-416a-b825-ed3e65d0d499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:49.615037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215756a-bd2a-416a-b825-ed3e65d0d499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:49.615348 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215756a-bd2a-416a-b825-ed3e65d0d499 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:49.615586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215756a-bd2a-416a-b825-ed3e65d0d499 admin admin] PATH_INFO: `/v3/users/9f499c5382334b64b7e16aa25b62fe9a` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:49.616709 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215756a-bd2a-416a-b825-ed3e65d0d499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f499c5382334b64b7e16aa25b62fe9a)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:49.618987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215756a-bd2a-416a-b825-ed3e65d0d499 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:49.671530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f215756a-bd2a-416a-b825-ed3e65d0d499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f499c5382334b64b7e16aa25b62fe9a'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:49.678735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f215756a-bd2a-416a-b825-ed3e65d0d499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f499c5382334b64b7e16aa25b62fe9a'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:49.679475 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f215756a-bd2a-416a-b825-ed3e65d0d499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f499c5382334b64b7e16aa25b62fe9a'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:49.691766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f215756a-bd2a-416a-b825-ed3e65d0d499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f499c5382334b64b7e16aa25b62fe9a'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:49.709187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f215756a-bd2a-416a-b825-ed3e65d0d499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f499c5382334b64b7e16aa25b62fe9a'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:49.715225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1332/2648] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:49 2022] DELETE /identity/v3/users/9f499c5382334b64b7e16aa25b62fe9a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:50.024491 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72f059-de9c-4cee-8117-c1bd13ddb116 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:50.025928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-bb72f059-de9c-4cee-8117-c1bd13ddb116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:50.048733 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72f059-de9c-4cee-8117-c1bd13ddb116 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:50.109329 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746249b5-0c94-44c2-938f-33599661f9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:50.109973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746249b5-0c94-44c2-938f-33599661f9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:50.110263 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746249b5-0c94-44c2-938f-33599661f9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:50.110540 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746249b5-0c94-44c2-938f-33599661f9e7 admin admin] PATH_INFO: `/v3/projects/61056d9eb81448229378a2de7b7bd8cd` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:50.111713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746249b5-0c94-44c2-938f-33599661f9e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61056d9eb81448229378a2de7b7bd8cd)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:50.113699 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746249b5-0c94-44c2-938f-33599661f9e7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:50.161582 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-746249b5-0c94-44c2-938f-33599661f9e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61056d9eb81448229378a2de7b7bd8cd', 'request_id': 'req-746249b5-0c94-44c2-938f-33599661f9e7'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:50.167927 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-746249b5-0c94-44c2-938f-33599661f9e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61056d9eb81448229378a2de7b7bd8cd', 'request_id': 'req-746249b5-0c94-44c2-938f-33599661f9e7'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:50.176339 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-746249b5-0c94-44c2-938f-33599661f9e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61056d9eb81448229378a2de7b7bd8cd', 'request_id': 'req-746249b5-0c94-44c2-938f-33599661f9e7'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:50.187130 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-746249b5-0c94-44c2-938f-33599661f9e7 admin admin] The token cache is being invalidate because project 61056d9eb81448229378a2de7b7bd8cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:50.187426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-746249b5-0c94-44c2-938f-33599661f9e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:50.188066 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-746249b5-0c94-44c2-938f-33599661f9e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:50.189609 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1317/2649] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:50 2022] DELETE /identity/v3/projects/61056d9eb81448229378a2de7b7bd8cd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:50.194534 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d0052-51f9-4f07-a07c-b5793c247b0f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:50.195020 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d0052-51f9-4f07-a07c-b5793c247b0f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:50.195145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d0052-51f9-4f07-a07c-b5793c247b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:50.214961 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-067d0052-51f9-4f07-a07c-b5793c247b0f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:50.216695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-067d0052-51f9-4f07-a07c-b5793c247b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:50.265101 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:50.280005 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1333/2650] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:50.287805 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb9deb-dc22-4e3c-a550-f8952b431d2e None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:50.288100 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb9deb-dc22-4e3c-a550-f8952b431d2e None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:50.288379 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb9deb-dc22-4e3c-a550-f8952b431d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:50.309493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-d5cb9deb-dc22-4e3c-a550-f8952b431d2e None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:50.310710 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d5cb9deb-dc22-4e3c-a550-f8952b431d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:50.318661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1318/2651] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:50.322981 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d0052-51f9-4f07-a07c-b5793c247b0f None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:50.332859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d0052-51f9-4f07-a07c-b5793c247b0f None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:50.337449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6831dd6-77e4-4061-a79b-c9142d34da83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:50.338051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6831dd6-77e4-4061-a79b-c9142d34da83 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:50.338332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6831dd6-77e4-4061-a79b-c9142d34da83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:50.338602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6831dd6-77e4-4061-a79b-c9142d34da83 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:50.339276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6831dd6-77e4-4061-a79b-c9142d34da83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:02:50.339584 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6831dd6-77e4-4061-a79b-c9142d34da83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:50.341704 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6831dd6-77e4-4061-a79b-c9142d34da83 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:50.353627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1334/2652] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:02:50.358686 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb9deb-dc22-4e3c-a550-f8952b431d2e None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:50.368069 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb9deb-dc22-4e3c-a550-f8952b431d2e None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:50.372718 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4968b-fbf9-4fd9-aac2-163ba17a3c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:50.373376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4968b-fbf9-4fd9-aac2-163ba17a3c14 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:50.373656 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4968b-fbf9-4fd9-aac2-163ba17a3c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:50.373932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4968b-fbf9-4fd9-aac2-163ba17a3c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:50.374567 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4968b-fbf9-4fd9-aac2-163ba17a3c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:50.376448 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4968b-fbf9-4fd9-aac2-163ba17a3c14 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:50.405876 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1319/2653] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:50 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:02:50.410257 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6831dd6-77e4-4061-a79b-c9142d34da83 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:50.421515 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6831dd6-77e4-4061-a79b-c9142d34da83 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:50.477414 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c717def-fe4b-45dc-a2bc-5b9b9aec0369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:50.478024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c717def-fe4b-45dc-a2bc-5b9b9aec0369 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:50.478309 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c717def-fe4b-45dc-a2bc-5b9b9aec0369 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:50.478586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c717def-fe4b-45dc-a2bc-5b9b9aec0369 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:50.479209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c717def-fe4b-45dc-a2bc-5b9b9aec0369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:50.481780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c717def-fe4b-45dc-a2bc-5b9b9aec0369 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:50.503845 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1335/2654] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:50 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:50.508638 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4968b-fbf9-4fd9-aac2-163ba17a3c14 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:50.520002 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4968b-fbf9-4fd9-aac2-163ba17a3c14 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:50.524635 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d853bb-d581-4fef-b132-5b2beb3de1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:50.525276 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d853bb-d581-4fef-b132-5b2beb3de1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:50.525563 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d853bb-d581-4fef-b132-5b2beb3de1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:50.525839 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d853bb-d581-4fef-b132-5b2beb3de1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:50.526484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d853bb-d581-4fef-b132-5b2beb3de1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:50.528754 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d853bb-d581-4fef-b132-5b2beb3de1e0 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:50.539269 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1320/2655] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:50.543497 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c717def-fe4b-45dc-a2bc-5b9b9aec0369 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:50.553632 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c717def-fe4b-45dc-a2bc-5b9b9aec0369 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:50.558324 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcdafd-e742-49a6-a58a-42bfdbe06b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:50.558919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcdafd-e742-49a6-a58a-42bfdbe06b04 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:50.559201 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcdafd-e742-49a6-a58a-42bfdbe06b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:50.559478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcdafd-e742-49a6-a58a-42bfdbe06b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:50.560115 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcdafd-e742-49a6-a58a-42bfdbe06b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:50.561745 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcdafd-e742-49a6-a58a-42bfdbe06b04 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:50.572735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1336/2656] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:50.577336 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d853bb-d581-4fef-b132-5b2beb3de1e0 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:50.587750 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d853bb-d581-4fef-b132-5b2beb3de1e0 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:50.593033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb838e62-0278-426f-bbf4-f3d82844393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:50.593946 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb838e62-0278-426f-bbf4-f3d82844393d admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:50.594227 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb838e62-0278-426f-bbf4-f3d82844393d admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:50.594503 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb838e62-0278-426f-bbf4-f3d82844393d admin admin] PATH_INFO: `/v3/projects/171af1ee4c1f444eb7a3bfe32181ad5b/users/36207576fa224e8aba868f2e4134d8ed/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:50.609610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb838e62-0278-426f-bbf4-f3d82844393d admin admin] RBAC: Authorizing `identity:create_grant(project_id=171af1ee4c1f444eb7a3bfe32181ad5b, user_id=36207576fa224e8aba868f2e4134d8ed, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:50.612261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb838e62-0278-426f-bbf4-f3d82844393d admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:50.614749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:50.626780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1321/2657] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:50 2022] PUT /identity/v3/projects/171af1ee4c1f444eb7a3bfe32181ad5b/users/36207576fa224e8aba868f2e4134d8ed/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:50.637907 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ab6a1-3820-46a0-b62f-7ebda2b5deff None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:50.638271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ab6a1-3820-46a0-b62f-7ebda2b5deff None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:50.638613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ab6a1-3820-46a0-b62f-7ebda2b5deff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:50.667242 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-2c3ab6a1-3820-46a0-b62f-7ebda2b5deff None None] MFA Rules not processed for user `36207576fa224e8aba868f2e4134d8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:50.668501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-2c3ab6a1-3820-46a0-b62f-7ebda2b5deff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:50.734368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1337/2658] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:50.738877 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb838e62-0278-426f-bbf4-f3d82844393d admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:50.800265 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb838e62-0278-426f-bbf4-f3d82844393d admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:50.805063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aecf38-b938-4bb6-83a7-0d1a76c05afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:50.805678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aecf38-b938-4bb6-83a7-0d1a76c05afe admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:50.805963 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aecf38-b938-4bb6-83a7-0d1a76c05afe admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:50.806241 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aecf38-b938-4bb6-83a7-0d1a76c05afe admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:50.806873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aecf38-b938-4bb6-83a7-0d1a76c05afe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:50.808777 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aecf38-b938-4bb6-83a7-0d1a76c05afe admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:50.835570 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1322/2659] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:50 2022] POST /identity/v3/projects => generated 389 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:50.839653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ab6a1-3820-46a0-b62f-7ebda2b5deff None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:50.851162 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ab6a1-3820-46a0-b62f-7ebda2b5deff None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:50.895472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:50.909305 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b1657-a5dd-47b5-af75-e9c5b80e8294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:50.909927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b1657-a5dd-47b5-af75-e9c5b80e8294 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:50.910215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b1657-a5dd-47b5-af75-e9c5b80e8294 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:50.910495 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b1657-a5dd-47b5-af75-e9c5b80e8294 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:50.911133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b1657-a5dd-47b5-af75-e9c5b80e8294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:50.913087 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b1657-a5dd-47b5-af75-e9c5b80e8294 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:50.930445 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aecf38-b938-4bb6-83a7-0d1a76c05afe admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:50.932184 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d1aecf38-b938-4bb6-83a7-0d1a76c05afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:50.938075 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1338/2660] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:50 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:50.939053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b1657-a5dd-47b5-af75-e9c5b80e8294 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:50.945550 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aecf38-b938-4bb6-83a7-0d1a76c05afe admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:50.948729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b1657-a5dd-47b5-af75-e9c5b80e8294 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:50.950963 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f839e9-5bb1-4b7b-a615-3813ffee9764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:50.951605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f839e9-5bb1-4b7b-a615-3813ffee9764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:50.951887 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f839e9-5bb1-4b7b-a615-3813ffee9764 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:50.952166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f839e9-5bb1-4b7b-a615-3813ffee9764 admin admin] PATH_INFO: `/v3/users/506bc3d80d6f4cbe86554f15805a6e82` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:50.953336 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f839e9-5bb1-4b7b-a615-3813ffee9764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=506bc3d80d6f4cbe86554f15805a6e82)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:50.953929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303d4de-ffb4-4022-89de-ec94e36ed2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:50.954529 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303d4de-ffb4-4022-89de-ec94e36ed2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:50.954827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303d4de-ffb4-4022-89de-ec94e36ed2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:50.955092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303d4de-ffb4-4022-89de-ec94e36ed2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:50.955260 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f839e9-5bb1-4b7b-a615-3813ffee9764 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:50.955731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303d4de-ffb4-4022-89de-ec94e36ed2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:50.957337 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303d4de-ffb4-4022-89de-ec94e36ed2d3 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:50.967635 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1339/2661] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 09:02:50.971785 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303d4de-ffb4-4022-89de-ec94e36ed2d3 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:50.981990 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303d4de-ffb4-4022-89de-ec94e36ed2d3 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:50.987168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a19e99-0dff-461b-a1f7-a8c54d3d66a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:50.987803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a19e99-0dff-461b-a1f7-a8c54d3d66a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:50.988170 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a19e99-0dff-461b-a1f7-a8c54d3d66a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:50.988452 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a19e99-0dff-461b-a1f7-a8c54d3d66a6 admin admin] PATH_INFO: `/v3/projects/054255d828104031958c7a15177d2afa/users/17552c68aa3345fc97c34df730bbeee1/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:51.004706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b8f839e9-5bb1-4b7b-a615-3813ffee9764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506bc3d80d6f4cbe86554f15805a6e82'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:51.005308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a19e99-0dff-461b-a1f7-a8c54d3d66a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054255d828104031958c7a15177d2afa, user_id=17552c68aa3345fc97c34df730bbeee1, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:51.008093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a19e99-0dff-461b-a1f7-a8c54d3d66a6 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:51.014311 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b8f839e9-5bb1-4b7b-a615-3813ffee9764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506bc3d80d6f4cbe86554f15805a6e82'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:51.015081 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b8f839e9-5bb1-4b7b-a615-3813ffee9764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506bc3d80d6f4cbe86554f15805a6e82'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:51.015851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b8f839e9-5bb1-4b7b-a615-3813ffee9764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506bc3d80d6f4cbe86554f15805a6e82'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:51.022791 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1340/2662] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:50 2022] PUT /identity/v3/projects/054255d828104031958c7a15177d2afa/users/17552c68aa3345fc97c34df730bbeee1/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:51.024060 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b8f839e9-5bb1-4b7b-a615-3813ffee9764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506bc3d80d6f4cbe86554f15805a6e82'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:51.026652 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a19e99-0dff-461b-a1f7-a8c54d3d66a6 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:51.028326 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-39a19e99-0dff-461b-a1f7-a8c54d3d66a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:51.043058 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1323/2663] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:50 2022] DELETE /identity/v3/users/506bc3d80d6f4cbe86554f15805a6e82 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:51.047530 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb271c3c-6af7-4d7d-9fcc-e2c806b988a9 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:51.047825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb271c3c-6af7-4d7d-9fcc-e2c806b988a9 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:51.048104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb271c3c-6af7-4d7d-9fcc-e2c806b988a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:51.067891 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-fb271c3c-6af7-4d7d-9fcc-e2c806b988a9 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:51.069171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-fb271c3c-6af7-4d7d-9fcc-e2c806b988a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:51.095672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a19e99-0dff-461b-a1f7-a8c54d3d66a6 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:51.115077 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:51.135915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1324/2664] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:51.146440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb271c3c-6af7-4d7d-9fcc-e2c806b988a9 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:51.147909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-fb271c3c-6af7-4d7d-9fcc-e2c806b988a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:51.157688 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63099f-a2a9-4bbe-b7a5-6a45a82a62d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:51.158402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63099f-a2a9-4bbe-b7a5-6a45a82a62d7 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:51.158695 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63099f-a2a9-4bbe-b7a5-6a45a82a62d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:51.159056 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63099f-a2a9-4bbe-b7a5-6a45a82a62d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:51.159743 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63099f-a2a9-4bbe-b7a5-6a45a82a62d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:51.161508 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63099f-a2a9-4bbe-b7a5-6a45a82a62d7 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:51.172118 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1341/2665] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 09:02:51.176307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63099f-a2a9-4bbe-b7a5-6a45a82a62d7 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:51.187205 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63099f-a2a9-4bbe-b7a5-6a45a82a62d7 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:51.192059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e58786-af42-4a9e-a01b-de776744ed77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:51.192719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58786-af42-4a9e-a01b-de776744ed77 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:51.193035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58786-af42-4a9e-a01b-de776744ed77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:51.193423 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58786-af42-4a9e-a01b-de776744ed77 admin admin] PATH_INFO: `/v3/projects/054255d828104031958c7a15177d2afa/users/17552c68aa3345fc97c34df730bbeee1/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:51.195388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e58786-af42-4a9e-a01b-de776744ed77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054255d828104031958c7a15177d2afa, user_id=17552c68aa3345fc97c34df730bbeee1, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:51.198070 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e58786-af42-4a9e-a01b-de776744ed77 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:51.209334 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1342/2666] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:51 2022] PUT /identity/v3/projects/054255d828104031958c7a15177d2afa/users/17552c68aa3345fc97c34df730bbeee1/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:51.209558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb271c3c-6af7-4d7d-9fcc-e2c806b988a9 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:51.222014 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d8783-e73f-4f95-905d-7c4cc6684cfd None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:51.222311 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d8783-e73f-4f95-905d-7c4cc6684cfd None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:51.222583 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d8783-e73f-4f95-905d-7c4cc6684cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:51.253407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-368d8783-e73f-4f95-905d-7c4cc6684cfd None None] MFA Rules not processed for user `17552c68aa3345fc97c34df730bbeee1`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:51.254857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-368d8783-e73f-4f95-905d-7c4cc6684cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:51.261116 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67f884-9c04-459d-88a7-a8b571c2a7c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:51.261641 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67f884-9c04-459d-88a7-a8b571c2a7c7 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:51.261928 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67f884-9c04-459d-88a7-a8b571c2a7c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:51.262222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67f884-9c04-459d-88a7-a8b571c2a7c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:51.276225 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:51.326553 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67f884-9c04-459d-88a7-a8b571c2a7c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:51.328008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67f884-9c04-459d-88a7-a8b571c2a7c7 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:51.328302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1343/2667] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:51.338295 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1325/2668] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:51.339534 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d8783-e73f-4f95-905d-7c4cc6684cfd None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:51.341058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-368d8783-e73f-4f95-905d-7c4cc6684cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:51.401597 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d8783-e73f-4f95-905d-7c4cc6684cfd None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:51.405602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5b589-59fa-429d-8ed6-0d6dedfcf960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:51.406218 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5b589-59fa-429d-8ed6-0d6dedfcf960 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:51.406537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5b589-59fa-429d-8ed6-0d6dedfcf960 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:51.406837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5b589-59fa-429d-8ed6-0d6dedfcf960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:51.416899 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5b589-59fa-429d-8ed6-0d6dedfcf960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:51.418919 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5b589-59fa-429d-8ed6-0d6dedfcf960 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:51.429598 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1344/2669] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:51 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:51.578401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67f884-9c04-459d-88a7-a8b571c2a7c7 service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:51.589824 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67f884-9c04-459d-88a7-a8b571c2a7c7 service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:51.594969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b017ddc-e4a2-442e-bc46-e44d9e8a9ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:51.595714 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b017ddc-e4a2-442e-bc46-e44d9e8a9ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:51.596068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b017ddc-e4a2-442e-bc46-e44d9e8a9ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:51.596414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b017ddc-e4a2-442e-bc46-e44d9e8a9ac9 admin admin] PATH_INFO: `/v3/users/36207576fa224e8aba868f2e4134d8ed` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:51.597616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b017ddc-e4a2-442e-bc46-e44d9e8a9ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36207576fa224e8aba868f2e4134d8ed)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:51.599603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b017ddc-e4a2-442e-bc46-e44d9e8a9ac9 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:51.635245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5b589-59fa-429d-8ed6-0d6dedfcf960 service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:51.637333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-28b5b589-59fa-429d-8ed6-0d6dedfcf960 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:51.654171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5b589-59fa-429d-8ed6-0d6dedfcf960 service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:51.659048 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:51.660211 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:51.660211 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:51.660211 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7 admin admin] PATH_INFO: `/v3/projects/b7bab9cc4ee14285b1c201b00a3d3384` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:51.661551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7bab9cc4ee14285b1c201b00a3d3384)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:51.663483 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:51.663786 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6b017ddc-e4a2-442e-bc46-e44d9e8a9ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36207576fa224e8aba868f2e4134d8ed'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:51.668135 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:51.676439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6b017ddc-e4a2-442e-bc46-e44d9e8a9ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36207576fa224e8aba868f2e4134d8ed'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:51.677206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6b017ddc-e4a2-442e-bc46-e44d9e8a9ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36207576fa224e8aba868f2e4134d8ed'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:51.677890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6b017ddc-e4a2-442e-bc46-e44d9e8a9ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36207576fa224e8aba868f2e4134d8ed'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:51.686102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6b017ddc-e4a2-442e-bc46-e44d9e8a9ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36207576fa224e8aba868f2e4134d8ed'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:51.706049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1326/2670] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:51 2022] DELETE /identity/v3/users/36207576fa224e8aba868f2e4134d8ed => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:51.710199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a04ef2-6137-42e1-b148-9eb80af6e2e3 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:51.710558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a04ef2-6137-42e1-b148-9eb80af6e2e3 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:51.710916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a04ef2-6137-42e1-b148-9eb80af6e2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:51.717788 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7bab9cc4ee14285b1c201b00a3d3384', 'request_id': 'req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:51.724808 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7bab9cc4ee14285b1c201b00a3d3384', 'request_id': 'req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:51.733939 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-69a04ef2-6137-42e1-b148-9eb80af6e2e3 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:51.734174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7bab9cc4ee14285b1c201b00a3d3384', 'request_id': 'req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:51.735364 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-69a04ef2-6137-42e1-b148-9eb80af6e2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:51.745025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7 admin admin] The token cache is being invalidate because project b7bab9cc4ee14285b1c201b00a3d3384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:51.745325 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:51.745964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:51.747499 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1345/2671] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:51 2022] DELETE /identity/v3/projects/b7bab9cc4ee14285b1c201b00a3d3384 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:51.803566 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1327/2672] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:02:51.814469 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:51.816065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:51.868612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:51.881830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ceb78-7fa8-4f98-88fb-42b0b1e1f9b7 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:51.935719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21587061-b2e4-45c2-9b32-8ca7f80c937e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:51.936383 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21587061-b2e4-45c2-9b32-8ca7f80c937e service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:51.936640 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21587061-b2e4-45c2-9b32-8ca7f80c937e service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:51.936918 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21587061-b2e4-45c2-9b32-8ca7f80c937e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:51.947602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21587061-b2e4-45c2-9b32-8ca7f80c937e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:51.949127 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21587061-b2e4-45c2-9b32-8ca7f80c937e service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:51.959862 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1346/2673] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 09:02:52.231401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a04ef2-6137-42e1-b148-9eb80af6e2e3 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:52.232871 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-69a04ef2-6137-42e1-b148-9eb80af6e2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:52.244940 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a04ef2-6137-42e1-b148-9eb80af6e2e3 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:52.249945 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a0757-ce40-4380-8dcb-d41a52ceeb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:52.250603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a0757-ce40-4380-8dcb-d41a52ceeb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:52.250910 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a0757-ce40-4380-8dcb-d41a52ceeb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:52.251165 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a0757-ce40-4380-8dcb-d41a52ceeb86 admin admin] PATH_INFO: `/v3/projects/171af1ee4c1f444eb7a3bfe32181ad5b` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:52.252300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a0757-ce40-4380-8dcb-d41a52ceeb86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=171af1ee4c1f444eb7a3bfe32181ad5b)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:52.254439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a0757-ce40-4380-8dcb-d41a52ceeb86 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:52.305256 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-193a0757-ce40-4380-8dcb-d41a52ceeb86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '171af1ee4c1f444eb7a3bfe32181ad5b', 'request_id': 'req-193a0757-ce40-4380-8dcb-d41a52ceeb86'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:52.311810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-193a0757-ce40-4380-8dcb-d41a52ceeb86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '171af1ee4c1f444eb7a3bfe32181ad5b', 'request_id': 'req-193a0757-ce40-4380-8dcb-d41a52ceeb86'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:52.319188 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-193a0757-ce40-4380-8dcb-d41a52ceeb86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '171af1ee4c1f444eb7a3bfe32181ad5b', 'request_id': 'req-193a0757-ce40-4380-8dcb-d41a52ceeb86'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:52.333433 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-193a0757-ce40-4380-8dcb-d41a52ceeb86 admin admin] The token cache is being invalidate because project 171af1ee4c1f444eb7a3bfe32181ad5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:52.333756 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-193a0757-ce40-4380-8dcb-d41a52ceeb86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:52.334402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-193a0757-ce40-4380-8dcb-d41a52ceeb86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:52.338764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1328/2674] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:52 2022] DELETE /identity/v3/projects/171af1ee4c1f444eb7a3bfe32181ad5b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:52.339998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21587061-b2e4-45c2-9b32-8ca7f80c937e service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:52.350692 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21587061-b2e4-45c2-9b32-8ca7f80c937e service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:52.408198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9df4d6-a9b4-4bfa-bcc2-60864fe28b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:52.408829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9df4d6-a9b4-4bfa-bcc2-60864fe28b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:52.409141 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9df4d6-a9b4-4bfa-bcc2-60864fe28b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:52.409416 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9df4d6-a9b4-4bfa-bcc2-60864fe28b56 admin admin] PATH_INFO: `/v3/users/17552c68aa3345fc97c34df730bbeee1` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:52.410524 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9df4d6-a9b4-4bfa-bcc2-60864fe28b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17552c68aa3345fc97c34df730bbeee1)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:52.412586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9df4d6-a9b4-4bfa-bcc2-60864fe28b56 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:52.459360 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ca9df4d6-a9b4-4bfa-bcc2-60864fe28b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17552c68aa3345fc97c34df730bbeee1'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:52.467009 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ca9df4d6-a9b4-4bfa-bcc2-60864fe28b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17552c68aa3345fc97c34df730bbeee1'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:52.467627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ca9df4d6-a9b4-4bfa-bcc2-60864fe28b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17552c68aa3345fc97c34df730bbeee1'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:52.474853 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ca9df4d6-a9b4-4bfa-bcc2-60864fe28b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17552c68aa3345fc97c34df730bbeee1'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:52.486548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ca9df4d6-a9b4-4bfa-bcc2-60864fe28b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17552c68aa3345fc97c34df730bbeee1'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:52.492392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1347/2675] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:52 2022] DELETE /identity/v3/users/17552c68aa3345fc97c34df730bbeee1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:52.765841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a0757-ce40-4380-8dcb-d41a52ceeb86 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:52.767478 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-193a0757-ce40-4380-8dcb-d41a52ceeb86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:52.784229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a0757-ce40-4380-8dcb-d41a52ceeb86 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:52.833765 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:52.844205 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe4970-5eb5-42ca-81ea-db11033581e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:52.844849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe4970-5eb5-42ca-81ea-db11033581e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:52.845160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe4970-5eb5-42ca-81ea-db11033581e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:52.845441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe4970-5eb5-42ca-81ea-db11033581e1 admin admin] PATH_INFO: `/v3/projects/054255d828104031958c7a15177d2afa` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:52.846582 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe4970-5eb5-42ca-81ea-db11033581e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=054255d828104031958c7a15177d2afa)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:52.848528 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe4970-5eb5-42ca-81ea-db11033581e1 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:52.895089 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1ffe4970-5eb5-42ca-81ea-db11033581e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054255d828104031958c7a15177d2afa', 'request_id': 'req-1ffe4970-5eb5-42ca-81ea-db11033581e1'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:52.901376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1ffe4970-5eb5-42ca-81ea-db11033581e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054255d828104031958c7a15177d2afa', 'request_id': 'req-1ffe4970-5eb5-42ca-81ea-db11033581e1'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:52.909485 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1ffe4970-5eb5-42ca-81ea-db11033581e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054255d828104031958c7a15177d2afa', 'request_id': 'req-1ffe4970-5eb5-42ca-81ea-db11033581e1'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:52.920350 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1ffe4970-5eb5-42ca-81ea-db11033581e1 admin admin] The token cache is being invalidate because project 054255d828104031958c7a15177d2afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:02:52.920635 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1ffe4970-5eb5-42ca-81ea-db11033581e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:52.921301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1ffe4970-5eb5-42ca-81ea-db11033581e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:52.922780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1329/2676] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:02:52 2022] DELETE /identity/v3/projects/054255d828104031958c7a15177d2afa => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:52.927609 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efc29a-42c2-4f86-a774-755db880b4f2 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:52.927896 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efc29a-42c2-4f86-a774-755db880b4f2 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:52.928171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efc29a-42c2-4f86-a774-755db880b4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:52.948194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-38efc29a-42c2-4f86-a774-755db880b4f2 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:52.949446 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-38efc29a-42c2-4f86-a774-755db880b4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:52.966574 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:53.010817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1348/2677] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:53.018631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82174e-dee6-4c7a-8746-2330784ed293 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:53.018916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82174e-dee6-4c7a-8746-2330784ed293 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:53.019185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82174e-dee6-4c7a-8746-2330784ed293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:53.038669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-4c82174e-dee6-4c7a-8746-2330784ed293 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:53.039871 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-4c82174e-dee6-4c7a-8746-2330784ed293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:53.048817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1330/2678] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:53.053093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efc29a-42c2-4f86-a774-755db880b4f2 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:53.063607 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efc29a-42c2-4f86-a774-755db880b4f2 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:53.068226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7661787-8167-4466-8d0d-5744decf04df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:53.068830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7661787-8167-4466-8d0d-5744decf04df admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:53.069144 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7661787-8167-4466-8d0d-5744decf04df admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:53.069413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7661787-8167-4466-8d0d-5744decf04df admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:53.070054 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7661787-8167-4466-8d0d-5744decf04df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:02:53.070358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7661787-8167-4466-8d0d-5744decf04df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:53.071945 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7661787-8167-4466-8d0d-5744decf04df admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:53.084415 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1349/2679] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:02:53.088878 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82174e-dee6-4c7a-8746-2330784ed293 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:53.098422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82174e-dee6-4c7a-8746-2330784ed293 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:53.103058 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930ddc8-c780-4772-8751-4b6b8a1ccdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:53.103651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930ddc8-c780-4772-8751-4b6b8a1ccdd0 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:53.103947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930ddc8-c780-4772-8751-4b6b8a1ccdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:53.104199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930ddc8-c780-4772-8751-4b6b8a1ccdd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:53.104810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930ddc8-c780-4772-8751-4b6b8a1ccdd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:53.107281 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930ddc8-c780-4772-8751-4b6b8a1ccdd0 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:53.134592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1331/2680] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:53 2022] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:02:53.138811 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7661787-8167-4466-8d0d-5744decf04df admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:53.148894 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7661787-8167-4466-8d0d-5744decf04df admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:53.207752 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41c473-215a-4203-8cee-00af7d7be452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:53.208381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41c473-215a-4203-8cee-00af7d7be452 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:53.208663 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41c473-215a-4203-8cee-00af7d7be452 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:53.208966 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41c473-215a-4203-8cee-00af7d7be452 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:53.209653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41c473-215a-4203-8cee-00af7d7be452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:53.211670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41c473-215a-4203-8cee-00af7d7be452 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:53.233946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1350/2681] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:53 2022] POST /identity/v3/users => generated 305 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:53.238103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930ddc8-c780-4772-8751-4b6b8a1ccdd0 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:53.248593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930ddc8-c780-4772-8751-4b6b8a1ccdd0 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:53.253216 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff96314-7658-4df8-9e27-d7758b1b26c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:53.253819 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff96314-7658-4df8-9e27-d7758b1b26c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:53.254102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff96314-7658-4df8-9e27-d7758b1b26c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:53.254381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff96314-7658-4df8-9e27-d7758b1b26c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:53.255028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff96314-7658-4df8-9e27-d7758b1b26c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:53.256615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff96314-7658-4df8-9e27-d7758b1b26c2 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:53.266590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1332/2682] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 09:02:53.270537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41c473-215a-4203-8cee-00af7d7be452 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:53.281052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41c473-215a-4203-8cee-00af7d7be452 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:53.285800 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc6168-ca82-4933-b5aa-23a07974e0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:53.286403 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc6168-ca82-4933-b5aa-23a07974e0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:53.286688 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc6168-ca82-4933-b5aa-23a07974e0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:53.286964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc6168-ca82-4933-b5aa-23a07974e0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:53.287612 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc6168-ca82-4933-b5aa-23a07974e0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:53.289236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc6168-ca82-4933-b5aa-23a07974e0c6 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:53.301914 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1351/2683] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:53.306208 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff96314-7658-4df8-9e27-d7758b1b26c2 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:53.316243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff96314-7658-4df8-9e27-d7758b1b26c2 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:53.321274 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3a9d0-6dc9-4ff4-b84d-7530526a25de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:53.321918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3a9d0-6dc9-4ff4-b84d-7530526a25de admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:53.322199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3a9d0-6dc9-4ff4-b84d-7530526a25de admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:53.322470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3a9d0-6dc9-4ff4-b84d-7530526a25de admin admin] PATH_INFO: `/v3/projects/478c867936c3488e935633c15e6b2ea9/users/d877396df00d419d904d0e9b9ab54b5d/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:53.337331 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3a9d0-6dc9-4ff4-b84d-7530526a25de admin admin] RBAC: Authorizing `identity:create_grant(project_id=478c867936c3488e935633c15e6b2ea9, user_id=d877396df00d419d904d0e9b9ab54b5d, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:53.339902 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3a9d0-6dc9-4ff4-b84d-7530526a25de admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:53.353657 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1333/2684] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:53 2022] PUT /identity/v3/projects/478c867936c3488e935633c15e6b2ea9/users/d877396df00d419d904d0e9b9ab54b5d/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:02:53.364731 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34e81a-f54c-43d6-9d60-71766c798666 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:53.365227 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34e81a-f54c-43d6-9d60-71766c798666 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:53.365327 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34e81a-f54c-43d6-9d60-71766c798666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:53.392196 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0d34e81a-f54c-43d6-9d60-71766c798666 None None] MFA Rules not processed for user `d877396df00d419d904d0e9b9ab54b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:53.393465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0d34e81a-f54c-43d6-9d60-71766c798666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:53.456553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1352/2685] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:53 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:02:53.461144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3a9d0-6dc9-4ff4-b84d-7530526a25de admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:53.522815 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3a9d0-6dc9-4ff4-b84d-7530526a25de admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:53.527458 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce30787-cfdd-41cf-b699-0d12d38a507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:53.528666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce30787-cfdd-41cf-b699-0d12d38a507a admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:53.528951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce30787-cfdd-41cf-b699-0d12d38a507a admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:53.529258 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce30787-cfdd-41cf-b699-0d12d38a507a admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:53.529885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce30787-cfdd-41cf-b699-0d12d38a507a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:53.531787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce30787-cfdd-41cf-b699-0d12d38a507a admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:53.558428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1334/2686] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:02:53 2022] POST /identity/v3/projects => generated 407 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:53.562519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34e81a-f54c-43d6-9d60-71766c798666 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:53.573718 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34e81a-f54c-43d6-9d60-71766c798666 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:53.587492 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:53.633137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2286f-67c7-4772-832a-aefac28f49ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:53.633741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2286f-67c7-4772-832a-aefac28f49ba admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:53.634023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2286f-67c7-4772-832a-aefac28f49ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:53.634302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2286f-67c7-4772-832a-aefac28f49ba admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:53.634930 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2286f-67c7-4772-832a-aefac28f49ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:53.636829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2286f-67c7-4772-832a-aefac28f49ba admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:53.659781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1353/2687] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:02:53 2022] POST /identity/v3/users => generated 310 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:02:53.663851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce30787-cfdd-41cf-b699-0d12d38a507a admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:53.670956 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:53.675394 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce30787-cfdd-41cf-b699-0d12d38a507a admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:53.681483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914b874-aa5c-446d-a43f-2a09e8aaecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:53.682057 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914b874-aa5c-446d-a43f-2a09e8aaecfc admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:53.682631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914b874-aa5c-446d-a43f-2a09e8aaecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:53.683098 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914b874-aa5c-446d-a43f-2a09e8aaecfc admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:53.684042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914b874-aa5c-446d-a43f-2a09e8aaecfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:53.685762 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914b874-aa5c-446d-a43f-2a09e8aaecfc admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:53.697102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1335/2688] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:53.701822 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2286f-67c7-4772-832a-aefac28f49ba admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:53.711729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2286f-67c7-4772-832a-aefac28f49ba admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:53.717169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f9dbc-358a-4c6e-b0da-502b6d256d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:53.717829 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f9dbc-358a-4c6e-b0da-502b6d256d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:53.718139 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f9dbc-358a-4c6e-b0da-502b6d256d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:53.718679 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f9dbc-358a-4c6e-b0da-502b6d256d8f admin admin] PATH_INFO: `/v3/projects/12813ef156df47a29e451343871c6e37/users/30724802604a4d9e8455cd81dc028ef7/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:53.734264 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f9dbc-358a-4c6e-b0da-502b6d256d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12813ef156df47a29e451343871c6e37, user_id=30724802604a4d9e8455cd81dc028ef7, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:53.736946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f9dbc-358a-4c6e-b0da-502b6d256d8f admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:53.759091 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1354/2689] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:53 2022] PUT /identity/v3/projects/12813ef156df47a29e451343871c6e37/users/30724802604a4d9e8455cd81dc028ef7/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:53.763275 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914b874-aa5c-446d-a43f-2a09e8aaecfc admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:53.773425 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914b874-aa5c-446d-a43f-2a09e8aaecfc admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:53.830516 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de9963-6806-4e3c-b968-a19840aec6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:53.831125 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de9963-6806-4e3c-b968-a19840aec6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:53.831410 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de9963-6806-4e3c-b968-a19840aec6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:53.831709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de9963-6806-4e3c-b968-a19840aec6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:53.832383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de9963-6806-4e3c-b968-a19840aec6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:53.834005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de9963-6806-4e3c-b968-a19840aec6a9 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:53.844009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1336/2690] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:02:53.848424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f9dbc-358a-4c6e-b0da-502b6d256d8f admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:53.859216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f9dbc-358a-4c6e-b0da-502b6d256d8f admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:53.863802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c91e1-72af-4aa3-a552-c16fd8797955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:53.864449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c91e1-72af-4aa3-a552-c16fd8797955 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:53.864732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c91e1-72af-4aa3-a552-c16fd8797955 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:53.865007 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c91e1-72af-4aa3-a552-c16fd8797955 admin admin] PATH_INFO: `/v3/projects/12813ef156df47a29e451343871c6e37/users/30724802604a4d9e8455cd81dc028ef7/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:53.866971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c91e1-72af-4aa3-a552-c16fd8797955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12813ef156df47a29e451343871c6e37, user_id=30724802604a4d9e8455cd81dc028ef7, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:53.869625 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c91e1-72af-4aa3-a552-c16fd8797955 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:53.880451 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1355/2691] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:02:53 2022] PUT /identity/v3/projects/12813ef156df47a29e451343871c6e37/users/30724802604a4d9e8455cd81dc028ef7/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:53.891609 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5fa5b-3f3a-4211-9c3a-48fb77172720 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:53.891903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5fa5b-3f3a-4211-9c3a-48fb77172720 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:53.892185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5fa5b-3f3a-4211-9c3a-48fb77172720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:53.920833 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-2de5fa5b-3f3a-4211-9c3a-48fb77172720 None None] MFA Rules not processed for user `30724802604a4d9e8455cd81dc028ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:53.922166 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-2de5fa5b-3f3a-4211-9c3a-48fb77172720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:53.991019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1337/2692] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:53 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:54.001644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c91e1-72af-4aa3-a552-c16fd8797955 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:54.003356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-700c91e1-72af-4aa3-a552-c16fd8797955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:54.064735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c91e1-72af-4aa3-a552-c16fd8797955 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:54.068418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55bbbd-7d73-40ff-8aeb-57d1b621a21e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:54.069106 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55bbbd-7d73-40ff-8aeb-57d1b621a21e service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:54.069385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55bbbd-7d73-40ff-8aeb-57d1b621a21e service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:54.069655 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55bbbd-7d73-40ff-8aeb-57d1b621a21e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:54.079676 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55bbbd-7d73-40ff-8aeb-57d1b621a21e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:54.081172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55bbbd-7d73-40ff-8aeb-57d1b621a21e service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:54.092492 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1356/2693] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:54 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:54.251208 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5fa5b-3f3a-4211-9c3a-48fb77172720 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:54.261304 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5fa5b-3f3a-4211-9c3a-48fb77172720 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:54.275274 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ab20e-3252-4677-bc50-97ab04d707a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:54.275900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ab20e-3252-4677-bc50-97ab04d707a7 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:54.276181 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ab20e-3252-4677-bc50-97ab04d707a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:54.276455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ab20e-3252-4677-bc50-97ab04d707a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:54.338661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ab20e-3252-4677-bc50-97ab04d707a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:54.340134 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ab20e-3252-4677-bc50-97ab04d707a7 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:54.351076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1338/2694] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:54 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:02:59.720142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55bbbd-7d73-40ff-8aeb-57d1b621a21e service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:59.784971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55bbbd-7d73-40ff-8aeb-57d1b621a21e service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:02:59.790675 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dd514-85fb-4bdd-b10f-e5f13e59dce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:02:59.791229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dd514-85fb-4bdd-b10f-e5f13e59dce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:59.791577 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dd514-85fb-4bdd-b10f-e5f13e59dce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:59.791847 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dd514-85fb-4bdd-b10f-e5f13e59dce9 admin admin] PATH_INFO: `/v3/users/d877396df00d419d904d0e9b9ab54b5d` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:59.793052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dd514-85fb-4bdd-b10f-e5f13e59dce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d877396df00d419d904d0e9b9ab54b5d)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:02:59.794951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dd514-85fb-4bdd-b10f-e5f13e59dce9 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:02:59.810568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:59.851377 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-538dd514-85fb-4bdd-b10f-e5f13e59dce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd877396df00d419d904d0e9b9ab54b5d'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:59.862230 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-538dd514-85fb-4bdd-b10f-e5f13e59dce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd877396df00d419d904d0e9b9ab54b5d'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:59.862902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-538dd514-85fb-4bdd-b10f-e5f13e59dce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd877396df00d419d904d0e9b9ab54b5d'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:59.870343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-538dd514-85fb-4bdd-b10f-e5f13e59dce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd877396df00d419d904d0e9b9ab54b5d'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:59.884031 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-538dd514-85fb-4bdd-b10f-e5f13e59dce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd877396df00d419d904d0e9b9ab54b5d'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:02:59.890307 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1357/2695] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:02:59 2022] DELETE /identity/v3/users/d877396df00d419d904d0e9b9ab54b5d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:02:59.895174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15ec53-88cf-4a31-927e-5e7cb975517e None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:02:59.895745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15ec53-88cf-4a31-927e-5e7cb975517e None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:02:59.895745 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15ec53-88cf-4a31-927e-5e7cb975517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:02:59.917531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-3c15ec53-88cf-4a31-927e-5e7cb975517e None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:02:59.918783 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3c15ec53-88cf-4a31-927e-5e7cb975517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:02:59.929009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:59.982658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1339/2696] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:02:59.993345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dd514-85fb-4bdd-b10f-e5f13e59dce9 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:02:59.994823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-538dd514-85fb-4bdd-b10f-e5f13e59dce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:00.057203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dd514-85fb-4bdd-b10f-e5f13e59dce9 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:00.060867 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987e78-26e9-41b3-9756-9ee35ac79a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:00.061503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987e78-26e9-41b3-9756-9ee35ac79a82 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:00.061784 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987e78-26e9-41b3-9756-9ee35ac79a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:00.062651 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987e78-26e9-41b3-9756-9ee35ac79a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:00.074573 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd987e78-26e9-41b3-9756-9ee35ac79a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:00.076523 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd987e78-26e9-41b3-9756-9ee35ac79a82 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:00.087329 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1358/2697] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:03:00.382808 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15ec53-88cf-4a31-927e-5e7cb975517e None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:00.384314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3c15ec53-88cf-4a31-927e-5e7cb975517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:00.399822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15ec53-88cf-4a31-927e-5e7cb975517e None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:00.408479 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:00.409154 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:00.409428 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:00.409703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f admin admin] PATH_INFO: `/v3/projects/478c867936c3488e935633c15e6b2ea9` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:00.410871 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=478c867936c3488e935633c15e6b2ea9)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:00.412711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:00.464629 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '478c867936c3488e935633c15e6b2ea9', 'request_id': 'req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:00.471453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '478c867936c3488e935633c15e6b2ea9', 'request_id': 'req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:00.479727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '478c867936c3488e935633c15e6b2ea9', 'request_id': 'req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:00.491863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f admin admin] The token cache is being invalidate because project 478c867936c3488e935633c15e6b2ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:03:00.492138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:00.492776 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:00.494328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1340/2698] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:03:00 2022] DELETE /identity/v3/projects/478c867936c3488e935633c15e6b2ea9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:03:00.498719 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987e78-26e9-41b3-9756-9ee35ac79a82 service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:00.508547 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987e78-26e9-41b3-9756-9ee35ac79a82 service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:00.574466 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0435f-30a6-4608-9778-4df2fff7a124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:00.575000 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0435f-30a6-4608-9778-4df2fff7a124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:00.575283 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0435f-30a6-4608-9778-4df2fff7a124 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:00.575559 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0435f-30a6-4608-9778-4df2fff7a124 admin admin] PATH_INFO: `/v3/users/30724802604a4d9e8455cd81dc028ef7` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:00.576681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0435f-30a6-4608-9778-4df2fff7a124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30724802604a4d9e8455cd81dc028ef7)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:00.579166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0435f-30a6-4608-9778-4df2fff7a124 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:00.633270 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:00.644900 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-93f0435f-30a6-4608-9778-4df2fff7a124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30724802604a4d9e8455cd81dc028ef7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:00.653430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-93f0435f-30a6-4608-9778-4df2fff7a124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30724802604a4d9e8455cd81dc028ef7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:00.654175 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-93f0435f-30a6-4608-9778-4df2fff7a124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30724802604a4d9e8455cd81dc028ef7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:00.662291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-93f0435f-30a6-4608-9778-4df2fff7a124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30724802604a4d9e8455cd81dc028ef7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:00.675932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-93f0435f-30a6-4608-9778-4df2fff7a124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30724802604a4d9e8455cd81dc028ef7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:00.682180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1359/2699] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:03:00 2022] DELETE /identity/v3/users/30724802604a4d9e8455cd81dc028ef7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:00.979926 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:00.981467 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:00.995141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa9b55-2e5b-4019-a375-b17d3fcf5a9f admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:01.066555 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301612b-1099-4d5a-866b-cd430e583976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:01.067194 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301612b-1099-4d5a-866b-cd430e583976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:01.067480 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301612b-1099-4d5a-866b-cd430e583976 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:01.067764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301612b-1099-4d5a-866b-cd430e583976 admin admin] PATH_INFO: `/v3/projects/12813ef156df47a29e451343871c6e37` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:01.068956 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301612b-1099-4d5a-866b-cd430e583976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12813ef156df47a29e451343871c6e37)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:01.070900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301612b-1099-4d5a-866b-cd430e583976 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:01.119606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:01.132885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c301612b-1099-4d5a-866b-cd430e583976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12813ef156df47a29e451343871c6e37', 'request_id': 'req-c301612b-1099-4d5a-866b-cd430e583976'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:01.140967 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c301612b-1099-4d5a-866b-cd430e583976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12813ef156df47a29e451343871c6e37', 'request_id': 'req-c301612b-1099-4d5a-866b-cd430e583976'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:01.149794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c301612b-1099-4d5a-866b-cd430e583976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12813ef156df47a29e451343871c6e37', 'request_id': 'req-c301612b-1099-4d5a-866b-cd430e583976'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:01.161594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c301612b-1099-4d5a-866b-cd430e583976 admin admin] The token cache is being invalidate because project 12813ef156df47a29e451343871c6e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:03:01.161879 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c301612b-1099-4d5a-866b-cd430e583976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:01.162518 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-c301612b-1099-4d5a-866b-cd430e583976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:01.164170 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1341/2700] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:03:00 2022] DELETE /identity/v3/projects/12813ef156df47a29e451343871c6e37 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:01.170142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a06b2-7b45-473c-bde6-5b50d87c248a None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:01.170789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a06b2-7b45-473c-bde6-5b50d87c248a None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:01.170789 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a06b2-7b45-473c-bde6-5b50d87c248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:01.196445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-d17a06b2-7b45-473c-bde6-5b50d87c248a None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:01.197729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d17a06b2-7b45-473c-bde6-5b50d87c248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:01.266672 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1360/2701] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:01.274943 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394e553-e26d-423c-b78e-546481eb2ac7 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:01.275225 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394e553-e26d-423c-b78e-546481eb2ac7 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:01.275499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394e553-e26d-423c-b78e-546481eb2ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:01.297751 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-b394e553-e26d-423c-b78e-546481eb2ac7 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:01.298970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b394e553-e26d-423c-b78e-546481eb2ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:01.307364 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1342/2702] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:01.312368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a06b2-7b45-473c-bde6-5b50d87c248a None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:01.323986 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a06b2-7b45-473c-bde6-5b50d87c248a None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:01.329754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037cbc-ea08-46e4-835c-239203bdb41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:01.330552 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037cbc-ea08-46e4-835c-239203bdb41e admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:01.330841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037cbc-ea08-46e4-835c-239203bdb41e admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:01.331114 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037cbc-ea08-46e4-835c-239203bdb41e admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:01.332099 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab037cbc-ea08-46e4-835c-239203bdb41e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:03:01.332591 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab037cbc-ea08-46e4-835c-239203bdb41e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:01.335368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab037cbc-ea08-46e4-835c-239203bdb41e admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:01.354744 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1361/2703] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:03:01.360350 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394e553-e26d-423c-b78e-546481eb2ac7 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:01.370232 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394e553-e26d-423c-b78e-546481eb2ac7 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:01.375553 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f754cf9-ffb0-45e5-b1f2-13466922d821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:01.376144 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f754cf9-ffb0-45e5-b1f2-13466922d821 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:01.376418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f754cf9-ffb0-45e5-b1f2-13466922d821 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:01.376690 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f754cf9-ffb0-45e5-b1f2-13466922d821 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:01.377353 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f754cf9-ffb0-45e5-b1f2-13466922d821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:01.379229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f754cf9-ffb0-45e5-b1f2-13466922d821 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:01.415203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1343/2704] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:03:01 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:03:01.422686 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037cbc-ea08-46e4-835c-239203bdb41e admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:01.433879 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037cbc-ea08-46e4-835c-239203bdb41e admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:01.500158 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0dd8f9-4ba8-4f4c-a75e-2e8e4bf6702d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:01.500802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dd8f9-4ba8-4f4c-a75e-2e8e4bf6702d admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:01.501117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dd8f9-4ba8-4f4c-a75e-2e8e4bf6702d admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:01.501426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dd8f9-4ba8-4f4c-a75e-2e8e4bf6702d admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:01.502084 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0dd8f9-4ba8-4f4c-a75e-2e8e4bf6702d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:01.504045 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0dd8f9-4ba8-4f4c-a75e-2e8e4bf6702d admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:01.527053 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1362/2705] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:03:01 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:03:01.531909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f754cf9-ffb0-45e5-b1f2-13466922d821 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:01.542730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f754cf9-ffb0-45e5-b1f2-13466922d821 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:01.548225 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cb989-3ae4-47ac-aba0-f405d01547e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:01.548851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cb989-3ae4-47ac-aba0-f405d01547e7 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:01.549167 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cb989-3ae4-47ac-aba0-f405d01547e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:01.549445 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cb989-3ae4-47ac-aba0-f405d01547e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:01.550100 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0cb989-3ae4-47ac-aba0-f405d01547e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:01.551766 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0cb989-3ae4-47ac-aba0-f405d01547e7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:01.563424 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1344/2706] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:03:01.567583 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0dd8f9-4ba8-4f4c-a75e-2e8e4bf6702d admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:01.579266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0dd8f9-4ba8-4f4c-a75e-2e8e4bf6702d admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:01.584093 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da91d4-9b35-4a20-8507-8066b0316cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:01.584703 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da91d4-9b35-4a20-8507-8066b0316cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:01.585008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da91d4-9b35-4a20-8507-8066b0316cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:01.585322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da91d4-9b35-4a20-8507-8066b0316cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:01.586036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da91d4-9b35-4a20-8507-8066b0316cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:01.587596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da91d4-9b35-4a20-8507-8066b0316cb4 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:01.599399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1363/2707] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:03:01.603880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cb989-3ae4-47ac-aba0-f405d01547e7 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:01.616530 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cb989-3ae4-47ac-aba0-f405d01547e7 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:01.621564 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8266f-e740-45ae-aa02-dcd8fc8adfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:01.622177 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8266f-e740-45ae-aa02-dcd8fc8adfbf admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:01.622464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8266f-e740-45ae-aa02-dcd8fc8adfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:01.622744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8266f-e740-45ae-aa02-dcd8fc8adfbf admin admin] PATH_INFO: `/v3/projects/da65348477604409b093c40a21f7e76e/users/6d789b79dee9491a994f8f58c899dd94/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:01.638863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8266f-e740-45ae-aa02-dcd8fc8adfbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=da65348477604409b093c40a21f7e76e, user_id=6d789b79dee9491a994f8f58c899dd94, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:01.641673 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8266f-e740-45ae-aa02-dcd8fc8adfbf admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:01.656244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1345/2708] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:03:01 2022] PUT /identity/v3/projects/da65348477604409b093c40a21f7e76e/users/6d789b79dee9491a994f8f58c899dd94/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:01.724114 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8662f9-7c0d-4260-8287-426e200c1c94 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:01.724399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8662f9-7c0d-4260-8287-426e200c1c94 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:01.724676 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8662f9-7c0d-4260-8287-426e200c1c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:01.754755 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-eb8662f9-7c0d-4260-8287-426e200c1c94 None None] MFA Rules not processed for user `6d789b79dee9491a994f8f58c899dd94`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:01.756071 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-eb8662f9-7c0d-4260-8287-426e200c1c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:01.765066 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:01.839897 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1364/2709] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:01.845034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8266f-e740-45ae-aa02-dcd8fc8adfbf admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:01.924903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8266f-e740-45ae-aa02-dcd8fc8adfbf admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:01.929667 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc0bbf-baea-42f4-8489-6ca620dd6072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:01.930277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc0bbf-baea-42f4-8489-6ca620dd6072 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:01.930563 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc0bbf-baea-42f4-8489-6ca620dd6072 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:01.930842 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc0bbf-baea-42f4-8489-6ca620dd6072 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:01.931469 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc0bbf-baea-42f4-8489-6ca620dd6072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:01.933423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc0bbf-baea-42f4-8489-6ca620dd6072 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:01.966197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1346/2710] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:03:01 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:03:01.972165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8662f9-7c0d-4260-8287-426e200c1c94 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:01.990809 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8662f9-7c0d-4260-8287-426e200c1c94 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:02.053865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a7eec-2408-4c02-a9a2-b92679295096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:02.054482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a7eec-2408-4c02-a9a2-b92679295096 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:02.054765 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a7eec-2408-4c02-a9a2-b92679295096 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:02.055079 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a7eec-2408-4c02-a9a2-b92679295096 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:02.055830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a7eec-2408-4c02-a9a2-b92679295096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:02.057787 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a7eec-2408-4c02-a9a2-b92679295096 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:02.080804 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1365/2711] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:03:01 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:03:02.085159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc0bbf-baea-42f4-8489-6ca620dd6072 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:02.096960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc0bbf-baea-42f4-8489-6ca620dd6072 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:02.101996 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f869ce8-fda9-498c-a090-35f15088abe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:02.102774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f869ce8-fda9-498c-a090-35f15088abe8 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:02.103092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f869ce8-fda9-498c-a090-35f15088abe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:02.103245 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f869ce8-fda9-498c-a090-35f15088abe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:02.103894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f869ce8-fda9-498c-a090-35f15088abe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:02.105577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f869ce8-fda9-498c-a090-35f15088abe8 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:02.117553 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1347/2712] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:03:02.122341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a7eec-2408-4c02-a9a2-b92679295096 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:02.134990 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a7eec-2408-4c02-a9a2-b92679295096 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:02.139729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f106e-4ed0-4889-a941-20313672ec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:02.140918 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f106e-4ed0-4889-a941-20313672ec48 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:02.141224 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f106e-4ed0-4889-a941-20313672ec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:02.141522 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f106e-4ed0-4889-a941-20313672ec48 admin admin] PATH_INFO: `/v3/projects/1f2415a236e94e7384f2c53962dcd61f/users/61710c144248460a81f02bf35343d52c/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:02.158477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f106e-4ed0-4889-a941-20313672ec48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2415a236e94e7384f2c53962dcd61f, user_id=61710c144248460a81f02bf35343d52c, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:02.161204 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f106e-4ed0-4889-a941-20313672ec48 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:02.177120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1366/2713] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:03:02 2022] PUT /identity/v3/projects/1f2415a236e94e7384f2c53962dcd61f/users/61710c144248460a81f02bf35343d52c/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:03:02.181253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f869ce8-fda9-498c-a090-35f15088abe8 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:02.191650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f869ce8-fda9-498c-a090-35f15088abe8 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:02.228546 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:02.259414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770d8e7-149b-4010-afd0-7c8faa430713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:02.260006 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770d8e7-149b-4010-afd0-7c8faa430713 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:02.260289 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770d8e7-149b-4010-afd0-7c8faa430713 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:02.260563 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770d8e7-149b-4010-afd0-7c8faa430713 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:02.261244 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770d8e7-149b-4010-afd0-7c8faa430713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:02.262860 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770d8e7-149b-4010-afd0-7c8faa430713 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:02.274464 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1348/2714] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:03:02.279386 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f106e-4ed0-4889-a941-20313672ec48 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:02.290260 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f106e-4ed0-4889-a941-20313672ec48 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:02.294774 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981f4ef-5f19-4c15-b6ce-6d67e9ed5e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:02.295418 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f4ef-5f19-4c15-b6ce-6d67e9ed5e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:02.295700 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f4ef-5f19-4c15-b6ce-6d67e9ed5e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:02.295979 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f4ef-5f19-4c15-b6ce-6d67e9ed5e1b admin admin] PATH_INFO: `/v3/projects/1f2415a236e94e7384f2c53962dcd61f/users/61710c144248460a81f02bf35343d52c/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:02.297946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981f4ef-5f19-4c15-b6ce-6d67e9ed5e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2415a236e94e7384f2c53962dcd61f, user_id=61710c144248460a81f02bf35343d52c, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:02.300551 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981f4ef-5f19-4c15-b6ce-6d67e9ed5e1b admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:02.313733 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1367/2715] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:03:02 2022] PUT /identity/v3/projects/1f2415a236e94e7384f2c53962dcd61f/users/61710c144248460a81f02bf35343d52c/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:03:02.324947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc97e9-44a4-478d-902f-2d6eefe1eae0 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:02.325381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc97e9-44a4-478d-902f-2d6eefe1eae0 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:02.325661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc97e9-44a4-478d-902f-2d6eefe1eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:02.358885 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-9bcc97e9-44a4-478d-902f-2d6eefe1eae0 None None] MFA Rules not processed for user `61710c144248460a81f02bf35343d52c`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:02.360113 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-9bcc97e9-44a4-478d-902f-2d6eefe1eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:02.435315 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1349/2716] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:02.446521 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981f4ef-5f19-4c15-b6ce-6d67e9ed5e1b admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:02.448240 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e981f4ef-5f19-4c15-b6ce-6d67e9ed5e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:02.513834 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981f4ef-5f19-4c15-b6ce-6d67e9ed5e1b admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:02.521385 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3625b69-673c-4b58-8111-d6e7e4366d46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:02.522840 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3625b69-673c-4b58-8111-d6e7e4366d46 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:02.523416 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3625b69-673c-4b58-8111-d6e7e4366d46 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:02.523872 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3625b69-673c-4b58-8111-d6e7e4366d46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:02.534932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3625b69-673c-4b58-8111-d6e7e4366d46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:02.536750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3625b69-673c-4b58-8111-d6e7e4366d46 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:02.547300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1368/2717] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:03:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:03:03.157514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc97e9-44a4-478d-902f-2d6eefe1eae0 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:03.225996 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc97e9-44a4-478d-902f-2d6eefe1eae0 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:03.231859 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9accf-3816-4454-961f-b0e2c22a6d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:03.232500 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9accf-3816-4454-961f-b0e2c22a6d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:03.232789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9accf-3816-4454-961f-b0e2c22a6d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:03.233097 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9accf-3816-4454-961f-b0e2c22a6d53 admin admin] PATH_INFO: `/v3/users/6d789b79dee9491a994f8f58c899dd94` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:03.234882 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9accf-3816-4454-961f-b0e2c22a6d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d789b79dee9491a994f8f58c899dd94)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:03.236970 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9accf-3816-4454-961f-b0e2c22a6d53 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:03.289292 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-21d9accf-3816-4454-961f-b0e2c22a6d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d789b79dee9491a994f8f58c899dd94'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:03.303743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-21d9accf-3816-4454-961f-b0e2c22a6d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d789b79dee9491a994f8f58c899dd94'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:03.304699 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-21d9accf-3816-4454-961f-b0e2c22a6d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d789b79dee9491a994f8f58c899dd94'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:03.305619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-21d9accf-3816-4454-961f-b0e2c22a6d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d789b79dee9491a994f8f58c899dd94'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:03.312841 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:03.315290 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-21d9accf-3816-4454-961f-b0e2c22a6d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d789b79dee9491a994f8f58c899dd94'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:03.338262 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1350/2718] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:03:03 2022] DELETE /identity/v3/users/6d789b79dee9491a994f8f58c899dd94 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:03.344388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f33614-7dd8-49f0-9071-088d2dee0397 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:03.344887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f33614-7dd8-49f0-9071-088d2dee0397 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:03.345031 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f33614-7dd8-49f0-9071-088d2dee0397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:03.353118 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:03.367593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-97f33614-7dd8-49f0-9071-088d2dee0397 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:03.369564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-97f33614-7dd8-49f0-9071-088d2dee0397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:03.434406 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1369/2719] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:03.444784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9accf-3816-4454-961f-b0e2c22a6d53 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:03.446301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-21d9accf-3816-4454-961f-b0e2c22a6d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:03.507943 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9accf-3816-4454-961f-b0e2c22a6d53 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:03.511882 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab989c-d1c6-48aa-a127-4447b422d380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:03.512492 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab989c-d1c6-48aa-a127-4447b422d380 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:03.512777 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab989c-d1c6-48aa-a127-4447b422d380 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:03.513084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab989c-d1c6-48aa-a127-4447b422d380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:03.522930 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab989c-d1c6-48aa-a127-4447b422d380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:03.525530 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab989c-d1c6-48aa-a127-4447b422d380 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:03.535339 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1351/2720] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:03:03.833168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f33614-7dd8-49f0-9071-088d2dee0397 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:03.843092 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-97f33614-7dd8-49f0-9071-088d2dee0397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:03.859322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f33614-7dd8-49f0-9071-088d2dee0397 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:03.864198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:03.864908 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:03.865282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:03.865751 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb admin admin] PATH_INFO: `/v3/projects/da65348477604409b093c40a21f7e76e` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:03.866949 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=da65348477604409b093c40a21f7e76e)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:03.870636 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:03.920958 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da65348477604409b093c40a21f7e76e', 'request_id': 'req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:03.927344 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da65348477604409b093c40a21f7e76e', 'request_id': 'req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:03.940012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da65348477604409b093c40a21f7e76e', 'request_id': 'req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:03.953857 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb admin admin] The token cache is being invalidate because project da65348477604409b093c40a21f7e76e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:03:03.954450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:03.955127 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:03.956802 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1370/2721] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:03:03 2022] DELETE /identity/v3/projects/da65348477604409b093c40a21f7e76e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:03.961369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab989c-d1c6-48aa-a127-4447b422d380 service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:03.973197 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab989c-d1c6-48aa-a127-4447b422d380 service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:04.034146 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8757d-d2cd-4d52-8f4c-d7a7273a23a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:04.034857 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8757d-d2cd-4d52-8f4c-d7a7273a23a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:04.035145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8757d-d2cd-4d52-8f4c-d7a7273a23a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:04.035501 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8757d-d2cd-4d52-8f4c-d7a7273a23a5 admin admin] PATH_INFO: `/v3/users/61710c144248460a81f02bf35343d52c` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:04.037171 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8757d-d2cd-4d52-8f4c-d7a7273a23a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61710c144248460a81f02bf35343d52c)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:04.039912 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8757d-d2cd-4d52-8f4c-d7a7273a23a5 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:04.096771 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2fd8757d-d2cd-4d52-8f4c-d7a7273a23a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61710c144248460a81f02bf35343d52c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:04.106674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2fd8757d-d2cd-4d52-8f4c-d7a7273a23a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61710c144248460a81f02bf35343d52c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:04.107537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2fd8757d-d2cd-4d52-8f4c-d7a7273a23a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61710c144248460a81f02bf35343d52c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:04.108493 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2fd8757d-d2cd-4d52-8f4c-d7a7273a23a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61710c144248460a81f02bf35343d52c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:04.116621 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2fd8757d-d2cd-4d52-8f4c-d7a7273a23a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61710c144248460a81f02bf35343d52c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:04.132462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:04.139630 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1352/2722] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:03:03 2022] DELETE /identity/v3/users/61710c144248460a81f02bf35343d52c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:04.433036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:04.441965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:04.452104 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7e59a-72a0-4245-8add-6cdfd8c98ddb admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:04.521303 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466d80a-c8c9-4a80-989a-35c59b02b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:04.521960 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466d80a-c8c9-4a80-989a-35c59b02b576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:04.522245 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466d80a-c8c9-4a80-989a-35c59b02b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:04.522570 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466d80a-c8c9-4a80-989a-35c59b02b576 admin admin] PATH_INFO: `/v3/projects/1f2415a236e94e7384f2c53962dcd61f` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:04.523711 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466d80a-c8c9-4a80-989a-35c59b02b576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f2415a236e94e7384f2c53962dcd61f)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:04.525854 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466d80a-c8c9-4a80-989a-35c59b02b576 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:04.570904 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:04.597241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0466d80a-c8c9-4a80-989a-35c59b02b576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f2415a236e94e7384f2c53962dcd61f', 'request_id': 'req-0466d80a-c8c9-4a80-989a-35c59b02b576'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:04.603933 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0466d80a-c8c9-4a80-989a-35c59b02b576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f2415a236e94e7384f2c53962dcd61f', 'request_id': 'req-0466d80a-c8c9-4a80-989a-35c59b02b576'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:04.614304 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0466d80a-c8c9-4a80-989a-35c59b02b576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f2415a236e94e7384f2c53962dcd61f', 'request_id': 'req-0466d80a-c8c9-4a80-989a-35c59b02b576'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:04.627705 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0466d80a-c8c9-4a80-989a-35c59b02b576 admin admin] The token cache is being invalidate because project 1f2415a236e94e7384f2c53962dcd61f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:03:04.628080 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0466d80a-c8c9-4a80-989a-35c59b02b576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:04.628748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0466d80a-c8c9-4a80-989a-35c59b02b576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:04.630249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1371/2723] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:03:04 2022] DELETE /identity/v3/projects/1f2415a236e94e7384f2c53962dcd61f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:04.635180 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3b2d6-47e6-44e8-b0a4-86fd3a86204d None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:04.635678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3b2d6-47e6-44e8-b0a4-86fd3a86204d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:04.635826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3b2d6-47e6-44e8-b0a4-86fd3a86204d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:04.661231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-31a3b2d6-47e6-44e8-b0a4-86fd3a86204d None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:04.662463 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-31a3b2d6-47e6-44e8-b0a4-86fd3a86204d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:04.725534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1353/2724] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:03:04.734051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cfecd-d44e-4543-afd9-99f0b1c20f7b None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:04.734902 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cfecd-d44e-4543-afd9-99f0b1c20f7b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:04.735236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cfecd-d44e-4543-afd9-99f0b1c20f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:04.755382 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-d01cfecd-d44e-4543-afd9-99f0b1c20f7b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:04.756580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d01cfecd-d44e-4543-afd9-99f0b1c20f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:04.764803 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1372/2725] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:03:04.769198 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3b2d6-47e6-44e8-b0a4-86fd3a86204d None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:04.779519 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3b2d6-47e6-44e8-b0a4-86fd3a86204d None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:04.784850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311d980-068d-4b9d-b2c3-df4c7e526fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:04.785489 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311d980-068d-4b9d-b2c3-df4c7e526fcc admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:04.785770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311d980-068d-4b9d-b2c3-df4c7e526fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:04.786043 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311d980-068d-4b9d-b2c3-df4c7e526fcc admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:04.786698 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311d980-068d-4b9d-b2c3-df4c7e526fcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:03:04.787028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311d980-068d-4b9d-b2c3-df4c7e526fcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:04.788618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311d980-068d-4b9d-b2c3-df4c7e526fcc admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:04.804647 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1354/2726] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:03:04.809786 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cfecd-d44e-4543-afd9-99f0b1c20f7b None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:04.820057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cfecd-d44e-4543-afd9-99f0b1c20f7b None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:04.825140 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc087e-ec1c-40de-af99-4024a1afac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:04.826315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc087e-ec1c-40de-af99-4024a1afac77 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:04.826315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc087e-ec1c-40de-af99-4024a1afac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:04.826675 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc087e-ec1c-40de-af99-4024a1afac77 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:04.827060 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc087e-ec1c-40de-af99-4024a1afac77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:04.828973 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc087e-ec1c-40de-af99-4024a1afac77 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:04.858100 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1373/2727] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:03:04 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:03:04.862832 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311d980-068d-4b9d-b2c3-df4c7e526fcc admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:04.873340 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311d980-068d-4b9d-b2c3-df4c7e526fcc admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:04.940801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d40f2a-97c2-4067-a701-b26568fd8dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:04.941445 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d40f2a-97c2-4067-a701-b26568fd8dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:04.941729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d40f2a-97c2-4067-a701-b26568fd8dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:04.942011 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d40f2a-97c2-4067-a701-b26568fd8dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:04.942647 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d40f2a-97c2-4067-a701-b26568fd8dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:04.944562 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d40f2a-97c2-4067-a701-b26568fd8dc7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:04.969214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1355/2728] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:03:04 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:03:04.973491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc087e-ec1c-40de-af99-4024a1afac77 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:04.985069 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc087e-ec1c-40de-af99-4024a1afac77 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:04.989744 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39d865-d86b-4228-b113-b4e23a086eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:04.990344 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39d865-d86b-4228-b113-b4e23a086eaf admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:04.990628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39d865-d86b-4228-b113-b4e23a086eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:04.990901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39d865-d86b-4228-b113-b4e23a086eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:04.991539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39d865-d86b-4228-b113-b4e23a086eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:04.993161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39d865-d86b-4228-b113-b4e23a086eaf admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:05.004362 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1374/2729] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:03:05.008558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d40f2a-97c2-4067-a701-b26568fd8dc7 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:05.018954 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d40f2a-97c2-4067-a701-b26568fd8dc7 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:05.023741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f153e32-4700-478f-b84b-770715e289fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:05.024358 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f153e32-4700-478f-b84b-770715e289fa admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:05.024638 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f153e32-4700-478f-b84b-770715e289fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:05.024913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f153e32-4700-478f-b84b-770715e289fa admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:05.025600 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f153e32-4700-478f-b84b-770715e289fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:05.027208 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f153e32-4700-478f-b84b-770715e289fa admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:05.039174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1356/2730] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 09:03:05.043522 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39d865-d86b-4228-b113-b4e23a086eaf admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:05.055342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39d865-d86b-4228-b113-b4e23a086eaf admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:05.062599 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f908c3-f995-4ca5-8264-18334038fb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:05.063399 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f908c3-f995-4ca5-8264-18334038fb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:05.063589 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f908c3-f995-4ca5-8264-18334038fb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:05.063878 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f908c3-f995-4ca5-8264-18334038fb9e admin admin] PATH_INFO: `/v3/projects/bb7d320e0a1b4beca2adcf1d6ef48109/users/9c7e6c8e090f47bcbbc83c55a6c7d1ca/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:05.079910 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f908c3-f995-4ca5-8264-18334038fb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb7d320e0a1b4beca2adcf1d6ef48109, user_id=9c7e6c8e090f47bcbbc83c55a6c7d1ca, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:05.082614 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f908c3-f995-4ca5-8264-18334038fb9e admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:05.097817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1375/2731] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:03:05 2022] PUT /identity/v3/projects/bb7d320e0a1b4beca2adcf1d6ef48109/users/9c7e6c8e090f47bcbbc83c55a6c7d1ca/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:05.110741 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc96c48-a3d8-47af-895e-e9ffba56056b None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:05.111131 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc96c48-a3d8-47af-895e-e9ffba56056b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:05.111506 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc96c48-a3d8-47af-895e-e9ffba56056b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:05.143016 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-abc96c48-a3d8-47af-895e-e9ffba56056b None None] MFA Rules not processed for user `9c7e6c8e090f47bcbbc83c55a6c7d1ca`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:05.144354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-abc96c48-a3d8-47af-895e-e9ffba56056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:05.208498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:05.221662 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1357/2732] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:05.239182 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f908c3-f995-4ca5-8264-18334038fb9e admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:05.240898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a3f908c3-f995-4ca5-8264-18334038fb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:05.306302 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f908c3-f995-4ca5-8264-18334038fb9e admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:05.309978 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7e90a-9c75-465d-81f9-b7827049f501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:05.310622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7e90a-9c75-465d-81f9-b7827049f501 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:05.310935 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7e90a-9c75-465d-81f9-b7827049f501 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:05.311215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7e90a-9c75-465d-81f9-b7827049f501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:05.320317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7e90a-9c75-465d-81f9-b7827049f501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:05.321814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7e90a-9c75-465d-81f9-b7827049f501 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:05.332787 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1376/2733] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:03:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:03:05.971146 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc96c48-a3d8-47af-895e-e9ffba56056b None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:05.972727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-abc96c48-a3d8-47af-895e-e9ffba56056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:06.039093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc96c48-a3d8-47af-895e-e9ffba56056b None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:06.043186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c8250-0d9b-4560-b9f3-7a1db9c4ac3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:06.043916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c8250-0d9b-4560-b9f3-7a1db9c4ac3a service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:06.044199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c8250-0d9b-4560-b9f3-7a1db9c4ac3a service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:06.044475 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c8250-0d9b-4560-b9f3-7a1db9c4ac3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:06.046374 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-c17c8250-0d9b-4560-b9f3-7a1db9c4ac3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:06.060392 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c8250-0d9b-4560-b9f3-7a1db9c4ac3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:06.062391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c8250-0d9b-4560-b9f3-7a1db9c4ac3a service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:06.071990 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1358/2734] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:03:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:03:15.326879 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=66,keystone:DELETE=5,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:16.068011 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=28 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:17.961764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7e90a-9c75-465d-81f9-b7827049f501 service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:18.035876 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7e90a-9c75-465d-81f9-b7827049f501 service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:18.040493 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f95a7b-ba00-4fe4-b5ec-206615793223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:18.041171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f95a7b-ba00-4fe4-b5ec-206615793223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:18.041451 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f95a7b-ba00-4fe4-b5ec-206615793223 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:18.041723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f95a7b-ba00-4fe4-b5ec-206615793223 admin admin] PATH_INFO: `/v3/users/9c7e6c8e090f47bcbbc83c55a6c7d1ca` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:18.042843 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f95a7b-ba00-4fe4-b5ec-206615793223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7e6c8e090f47bcbbc83c55a6c7d1ca)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:18.044942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f95a7b-ba00-4fe4-b5ec-206615793223 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:18.102766 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b8f95a7b-ba00-4fe4-b5ec-206615793223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7e6c8e090f47bcbbc83c55a6c7d1ca'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:18.110250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b8f95a7b-ba00-4fe4-b5ec-206615793223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7e6c8e090f47bcbbc83c55a6c7d1ca'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:18.110870 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b8f95a7b-ba00-4fe4-b5ec-206615793223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7e6c8e090f47bcbbc83c55a6c7d1ca'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:18.118553 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b8f95a7b-ba00-4fe4-b5ec-206615793223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7e6c8e090f47bcbbc83c55a6c7d1ca'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:18.131193 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b8f95a7b-ba00-4fe4-b5ec-206615793223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7e6c8e090f47bcbbc83c55a6c7d1ca'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:18.139756 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1377/2735] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:03:17 2022] DELETE /identity/v3/users/9c7e6c8e090f47bcbbc83c55a6c7d1ca => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:18.144923 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9bc76-5939-42bd-a7f0-78d78c3c5b04 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:18.145496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9bc76-5939-42bd-a7f0-78d78c3c5b04 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:18.145496 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9bc76-5939-42bd-a7f0-78d78c3c5b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:18.166578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-2dc9bc76-5939-42bd-a7f0-78d78c3c5b04 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:18.168117 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-2dc9bc76-5939-42bd-a7f0-78d78c3c5b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:18.234579 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1359/2736] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:03:18.244397 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f95a7b-ba00-4fe4-b5ec-206615793223 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:18.245922 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b8f95a7b-ba00-4fe4-b5ec-206615793223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:18.308198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f95a7b-ba00-4fe4-b5ec-206615793223 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:18.311953 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e56a0-100f-496c-93d6-6412dcfd9915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:18.313165 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e56a0-100f-496c-93d6-6412dcfd9915 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:18.313447 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e56a0-100f-496c-93d6-6412dcfd9915 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:18.313720 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e56a0-100f-496c-93d6-6412dcfd9915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:18.324539 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e56a0-100f-496c-93d6-6412dcfd9915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:18.326034 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e56a0-100f-496c-93d6-6412dcfd9915 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:18.337184 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1378/2737] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:03:18.623612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9bc76-5939-42bd-a7f0-78d78c3c5b04 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:18.626560 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-2dc9bc76-5939-42bd-a7f0-78d78c3c5b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:18.642454 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9bc76-5939-42bd-a7f0-78d78c3c5b04 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:18.648877 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ae181-a6cb-44b0-b292-c37dd505e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:18.650120 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ae181-a6cb-44b0-b292-c37dd505e36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:18.650724 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ae181-a6cb-44b0-b292-c37dd505e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:18.651347 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ae181-a6cb-44b0-b292-c37dd505e36e admin admin] PATH_INFO: `/v3/projects/bb7d320e0a1b4beca2adcf1d6ef48109` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:18.652868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ae181-a6cb-44b0-b292-c37dd505e36e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb7d320e0a1b4beca2adcf1d6ef48109)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:18.654904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ae181-a6cb-44b0-b292-c37dd505e36e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:18.709215 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-0a2ae181-a6cb-44b0-b292-c37dd505e36e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb7d320e0a1b4beca2adcf1d6ef48109', 'request_id': 'req-0a2ae181-a6cb-44b0-b292-c37dd505e36e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:18.716422 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-0a2ae181-a6cb-44b0-b292-c37dd505e36e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb7d320e0a1b4beca2adcf1d6ef48109', 'request_id': 'req-0a2ae181-a6cb-44b0-b292-c37dd505e36e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:18.725670 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-0a2ae181-a6cb-44b0-b292-c37dd505e36e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb7d320e0a1b4beca2adcf1d6ef48109', 'request_id': 'req-0a2ae181-a6cb-44b0-b292-c37dd505e36e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:18.737618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-0a2ae181-a6cb-44b0-b292-c37dd505e36e admin admin] The token cache is being invalidate because project bb7d320e0a1b4beca2adcf1d6ef48109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:03:18.737907 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-0a2ae181-a6cb-44b0-b292-c37dd505e36e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:18.738593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-0a2ae181-a6cb-44b0-b292-c37dd505e36e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:18.740098 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1360/2738] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:03:18 2022] DELETE /identity/v3/projects/bb7d320e0a1b4beca2adcf1d6ef48109 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:18.745633 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023edb0-5cee-4263-a09f-87a19f1b546f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:18.745923 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023edb0-5cee-4263-a09f-87a19f1b546f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:18.746199 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023edb0-5cee-4263-a09f-87a19f1b546f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:18.767180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-a023edb0-5cee-4263-a09f-87a19f1b546f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:18.768400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a023edb0-5cee-4263-a09f-87a19f1b546f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:18.786117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:18.840348 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1379/2739] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:18.848700 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6173f-f5ef-424c-8fb3-dc9ee50fbeaa None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:18.849020 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6173f-f5ef-424c-8fb3-dc9ee50fbeaa None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:18.849300 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6173f-f5ef-424c-8fb3-dc9ee50fbeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:18.869744 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-88b6173f-f5ef-424c-8fb3-dc9ee50fbeaa None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:18.870884 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-88b6173f-f5ef-424c-8fb3-dc9ee50fbeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:18.879553 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1361/2740] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:18.884030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023edb0-5cee-4263-a09f-87a19f1b546f None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:18.894002 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023edb0-5cee-4263-a09f-87a19f1b546f None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:18.898631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec71a4-90dd-426f-bb6c-c59f1327a6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:18.899244 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec71a4-90dd-426f-bb6c-c59f1327a6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:18.899531 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec71a4-90dd-426f-bb6c-c59f1327a6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:18.899816 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec71a4-90dd-426f-bb6c-c59f1327a6e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:18.900470 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec71a4-90dd-426f-bb6c-c59f1327a6e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:03:18.900778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec71a4-90dd-426f-bb6c-c59f1327a6e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:18.902412 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec71a4-90dd-426f-bb6c-c59f1327a6e1 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:18.915462 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1380/2741] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:03:18.920145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6173f-f5ef-424c-8fb3-dc9ee50fbeaa None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:18.930133 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6173f-f5ef-424c-8fb3-dc9ee50fbeaa None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:18.934780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6a929-59a7-4b13-931b-0d90a2a1985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:18.935401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6a929-59a7-4b13-931b-0d90a2a1985e admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:18.935681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6a929-59a7-4b13-931b-0d90a2a1985e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:18.935950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6a929-59a7-4b13-931b-0d90a2a1985e admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:18.936576 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6a929-59a7-4b13-931b-0d90a2a1985e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:18.939266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6a929-59a7-4b13-931b-0d90a2a1985e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:18.966824 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1362/2742] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:03:18 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:03:18.971483 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec71a4-90dd-426f-bb6c-c59f1327a6e1 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:18.982034 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec71a4-90dd-426f-bb6c-c59f1327a6e1 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:19.040963 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158c6cd-acec-46ef-9e77-b79ed21c11a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:19.041608 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158c6cd-acec-46ef-9e77-b79ed21c11a6 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:19.041885 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158c6cd-acec-46ef-9e77-b79ed21c11a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:19.042158 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158c6cd-acec-46ef-9e77-b79ed21c11a6 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:19.042783 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158c6cd-acec-46ef-9e77-b79ed21c11a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:19.044738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158c6cd-acec-46ef-9e77-b79ed21c11a6 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:19.069462 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1381/2743] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:03:18 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:03:19.073610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6a929-59a7-4b13-931b-0d90a2a1985e admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:19.084405 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6a929-59a7-4b13-931b-0d90a2a1985e admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:19.089189 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2276c05-cf8b-4281-b73c-af81d84a8d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:19.089806 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2276c05-cf8b-4281-b73c-af81d84a8d6d admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:19.090092 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2276c05-cf8b-4281-b73c-af81d84a8d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:19.090371 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2276c05-cf8b-4281-b73c-af81d84a8d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:19.091022 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2276c05-cf8b-4281-b73c-af81d84a8d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:19.092634 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2276c05-cf8b-4281-b73c-af81d84a8d6d admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:19.104525 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1363/2744] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:03:19.108637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158c6cd-acec-46ef-9e77-b79ed21c11a6 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:19.119865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158c6cd-acec-46ef-9e77-b79ed21c11a6 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:19.124764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dabd63-c087-44d5-8c76-1a2cdb88488d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:19.125402 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dabd63-c087-44d5-8c76-1a2cdb88488d admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:19.125683 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dabd63-c087-44d5-8c76-1a2cdb88488d admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:19.125974 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dabd63-c087-44d5-8c76-1a2cdb88488d admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:19.126605 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dabd63-c087-44d5-8c76-1a2cdb88488d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:19.128192 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dabd63-c087-44d5-8c76-1a2cdb88488d admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:19.140094 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1382/2745] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:03:19.144348 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2276c05-cf8b-4281-b73c-af81d84a8d6d admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:19.154716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2276c05-cf8b-4281-b73c-af81d84a8d6d admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:19.160255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c8b7e-a763-43e0-8df0-6571db8bfd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:19.160918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c8b7e-a763-43e0-8df0-6571db8bfd28 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:19.161243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c8b7e-a763-43e0-8df0-6571db8bfd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:19.161539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c8b7e-a763-43e0-8df0-6571db8bfd28 admin admin] PATH_INFO: `/v3/projects/c6f7732f957d4e6c999d4ce542713b9e/users/49cacda3d85e4eaca6218397f94e9837/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:19.176871 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c8b7e-a763-43e0-8df0-6571db8bfd28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f7732f957d4e6c999d4ce542713b9e, user_id=49cacda3d85e4eaca6218397f94e9837, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:19.179544 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c8b7e-a763-43e0-8df0-6571db8bfd28 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:19.192702 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1364/2746] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:03:19 2022] PUT /identity/v3/projects/c6f7732f957d4e6c999d4ce542713b9e/users/49cacda3d85e4eaca6218397f94e9837/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:19.204501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016889e-9c57-4a5f-a94f-71c2f7fcb2e4 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:19.204830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016889e-9c57-4a5f-a94f-71c2f7fcb2e4 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:19.205167 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016889e-9c57-4a5f-a94f-71c2f7fcb2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:19.233479 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-c016889e-9c57-4a5f-a94f-71c2f7fcb2e4 None None] MFA Rules not processed for user `49cacda3d85e4eaca6218397f94e9837`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:19.235291 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c016889e-9c57-4a5f-a94f-71c2f7fcb2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:19.300037 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1383/2747] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:19.311061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c8b7e-a763-43e0-8df0-6571db8bfd28 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:19.312856 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-168c8b7e-a763-43e0-8df0-6571db8bfd28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:19.335046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:19.371890 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c8b7e-a763-43e0-8df0-6571db8bfd28 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:19.375574 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd275e-0438-4f1f-ac66-e468ea2f55b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:19.376174 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd275e-0438-4f1f-ac66-e468ea2f55b1 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:19.376455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd275e-0438-4f1f-ac66-e468ea2f55b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:19.376729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd275e-0438-4f1f-ac66-e468ea2f55b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:19.385028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd275e-0438-4f1f-ac66-e468ea2f55b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:19.386614 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd275e-0438-4f1f-ac66-e468ea2f55b1 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:19.395960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1365/2748] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:03:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:03:29.296604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:29.326315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016889e-9c57-4a5f-a94f-71c2f7fcb2e4 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:29.389254 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016889e-9c57-4a5f-a94f-71c2f7fcb2e4 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:29.391915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=17 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:29.395173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3b1a1-2385-4d07-b98c-6ea36cff563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:29.395814 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3b1a1-2385-4d07-b98c-6ea36cff563a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:29.396098 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3b1a1-2385-4d07-b98c-6ea36cff563a admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:29.396372 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3b1a1-2385-4d07-b98c-6ea36cff563a admin admin] PATH_INFO: `/v3/users/49cacda3d85e4eaca6218397f94e9837` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:29.397556 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3b1a1-2385-4d07-b98c-6ea36cff563a admin admin] RBAC: Authorizing `identity:delete_user(user_id=49cacda3d85e4eaca6218397f94e9837)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:29.399483 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3b1a1-2385-4d07-b98c-6ea36cff563a admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:29.447020 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-11b3b1a1-2385-4d07-b98c-6ea36cff563a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49cacda3d85e4eaca6218397f94e9837'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:29.455102 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-11b3b1a1-2385-4d07-b98c-6ea36cff563a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49cacda3d85e4eaca6218397f94e9837'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:29.455712 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-11b3b1a1-2385-4d07-b98c-6ea36cff563a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49cacda3d85e4eaca6218397f94e9837'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:29.462891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-11b3b1a1-2385-4d07-b98c-6ea36cff563a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49cacda3d85e4eaca6218397f94e9837'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:29.475062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-11b3b1a1-2385-4d07-b98c-6ea36cff563a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49cacda3d85e4eaca6218397f94e9837'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:29.481181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1384/2749] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:03:29 2022] DELETE /identity/v3/users/49cacda3d85e4eaca6218397f94e9837 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:29.485714 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11e5b1-b58d-4d73-91f6-4c5ace0e77d4 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:29.486032 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11e5b1-b58d-4d73-91f6-4c5ace0e77d4 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:29.486319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11e5b1-b58d-4d73-91f6-4c5ace0e77d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:29.505746 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-7b11e5b1-b58d-4d73-91f6-4c5ace0e77d4 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:29.506975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7b11e5b1-b58d-4d73-91f6-4c5ace0e77d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:29.566771 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1366/2750] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:29.576604 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3b1a1-2385-4d07-b98c-6ea36cff563a admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:29.578665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-11b3b1a1-2385-4d07-b98c-6ea36cff563a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:29.639741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3b1a1-2385-4d07-b98c-6ea36cff563a admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:29.644012 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83361-c480-4aa5-98d0-eb9769828f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:29.644628 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83361-c480-4aa5-98d0-eb9769828f78 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:29.644913 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83361-c480-4aa5-98d0-eb9769828f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:29.645223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83361-c480-4aa5-98d0-eb9769828f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:29.655068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e83361-c480-4aa5-98d0-eb9769828f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:29.656561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e83361-c480-4aa5-98d0-eb9769828f78 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:29.667095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1385/2751] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:03:29.957447 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11e5b1-b58d-4d73-91f6-4c5ace0e77d4 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:29.958903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7b11e5b1-b58d-4d73-91f6-4c5ace0e77d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:29.973646 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11e5b1-b58d-4d73-91f6-4c5ace0e77d4 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:29.978563 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:29.979229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:29.979512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:29.979789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880 admin admin] PATH_INFO: `/v3/projects/c6f7732f957d4e6c999d4ce542713b9e` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:29.981863 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f7732f957d4e6c999d4ce542713b9e)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:29.984344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:30.035603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f7732f957d4e6c999d4ce542713b9e', 'request_id': 'req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:30.042667 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f7732f957d4e6c999d4ce542713b9e', 'request_id': 'req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:30.051520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f7732f957d4e6c999d4ce542713b9e', 'request_id': 'req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:30.064316 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880 admin admin] The token cache is being invalidate because project c6f7732f957d4e6c999d4ce542713b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:03:30.064602 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:30.065363 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:30.066904 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1367/2752] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:03:29 2022] DELETE /identity/v3/projects/c6f7732f957d4e6c999d4ce542713b9e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:36.266707 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83361-c480-4aa5-98d0-eb9769828f78 service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:36.271836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d2e83361-c480-4aa5-98d0-eb9769828f78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:36.299649 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:36.395738 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83361-c480-4aa5-98d0-eb9769828f78 service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:36.486247 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4250902-ee34-4ea3-a1d9-0a0981d0e1f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:36.486890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4250902-ee34-4ea3-a1d9-0a0981d0e1f6 service nova] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:36.487182 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4250902-ee34-4ea3-a1d9-0a0981d0e1f6 service nova] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:36.487459 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4250902-ee34-4ea3-a1d9-0a0981d0e1f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:36.489529 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e4250902-ee34-4ea3-a1d9-0a0981d0e1f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:36.502330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4250902-ee34-4ea3-a1d9-0a0981d0e1f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:36.504059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4250902-ee34-4ea3-a1d9-0a0981d0e1f6 service nova] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:36.516580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1386/2753] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:03:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:03:40.060284 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:40.220150 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:40.221660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:40.287900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc7be7-7b93-48e6-b1d3-42f93f6ef880 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:40.291725 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cf079-7c56-4f69-a3d0-0f0f2364c83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:40.292360 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cf079-7c56-4f69-a3d0-0f0f2364c83f service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:40.292647 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cf079-7c56-4f69-a3d0-0f0f2364c83f service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:40.292919 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cf079-7c56-4f69-a3d0-0f0f2364c83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:40.294814 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3a8cf079-7c56-4f69-a3d0-0f0f2364c83f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:40.367654 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cf079-7c56-4f69-a3d0-0f0f2364c83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:40.369119 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cf079-7c56-4f69-a3d0-0f0f2364c83f service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:40.378959 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1368/2754] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:03:43.634727 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4250902-ee34-4ea3-a1d9-0a0981d0e1f6 service nova] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:43.637968 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e4250902-ee34-4ea3-a1d9-0a0981d0e1f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:43.652833 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4250902-ee34-4ea3-a1d9-0a0981d0e1f6 service nova] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:43.659384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca618b-d1b2-43e2-8375-86d844a1eb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:43.660588 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca618b-d1b2-43e2-8375-86d844a1eb65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:43.661186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca618b-d1b2-43e2-8375-86d844a1eb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:43.661703 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca618b-d1b2-43e2-8375-86d844a1eb65 admin admin] PATH_INFO: `/v3/users/5541bfa4efc54abe85faf6b58196a2d7` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:43.681075 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca618b-d1b2-43e2-8375-86d844a1eb65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5541bfa4efc54abe85faf6b58196a2d7)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:43.682874 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca618b-d1b2-43e2-8375-86d844a1eb65 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:43.745342 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-25ca618b-d1b2-43e2-8375-86d844a1eb65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5541bfa4efc54abe85faf6b58196a2d7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:43.753653 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-25ca618b-d1b2-43e2-8375-86d844a1eb65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5541bfa4efc54abe85faf6b58196a2d7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:43.754316 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-25ca618b-d1b2-43e2-8375-86d844a1eb65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5541bfa4efc54abe85faf6b58196a2d7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:43.765486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-25ca618b-d1b2-43e2-8375-86d844a1eb65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5541bfa4efc54abe85faf6b58196a2d7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:43.785542 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-25ca618b-d1b2-43e2-8375-86d844a1eb65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5541bfa4efc54abe85faf6b58196a2d7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:43.793583 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1387/2755] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:03:43 2022] DELETE /identity/v3/users/5541bfa4efc54abe85faf6b58196a2d7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:03:43.983405 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cf079-7c56-4f69-a3d0-0f0f2364c83f service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:43.994347 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cf079-7c56-4f69-a3d0-0f0f2364c83f service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:44.056064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f9e62-19cf-422f-95f2-a4022d15a529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:44.056607 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f9e62-19cf-422f-95f2-a4022d15a529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:44.056888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f9e62-19cf-422f-95f2-a4022d15a529 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:44.057201 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f9e62-19cf-422f-95f2-a4022d15a529 admin admin] PATH_INFO: `/v3/projects/3082c759fb9e437eb1f4cb735dc43ef9` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:44.068681 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f9e62-19cf-422f-95f2-a4022d15a529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3082c759fb9e437eb1f4cb735dc43ef9)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:44.070703 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f9e62-19cf-422f-95f2-a4022d15a529 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:44.116427 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:44.120880 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-502f9e62-19cf-422f-95f2-a4022d15a529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3082c759fb9e437eb1f4cb735dc43ef9', 'request_id': 'req-502f9e62-19cf-422f-95f2-a4022d15a529'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:44.128257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-502f9e62-19cf-422f-95f2-a4022d15a529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3082c759fb9e437eb1f4cb735dc43ef9', 'request_id': 'req-502f9e62-19cf-422f-95f2-a4022d15a529'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:44.139361 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-502f9e62-19cf-422f-95f2-a4022d15a529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3082c759fb9e437eb1f4cb735dc43ef9', 'request_id': 'req-502f9e62-19cf-422f-95f2-a4022d15a529'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:44.152005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-502f9e62-19cf-422f-95f2-a4022d15a529 admin admin] The token cache is being invalidate because project 3082c759fb9e437eb1f4cb735dc43ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:03:44.152301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-502f9e62-19cf-422f-95f2-a4022d15a529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:44.152973 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-502f9e62-19cf-422f-95f2-a4022d15a529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:44.154527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1369/2756] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:03:43 2022] DELETE /identity/v3/projects/3082c759fb9e437eb1f4cb735dc43ef9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:44.160424 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61530f14-b607-4362-b3b1-b68341eba58b None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:44.160742 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61530f14-b607-4362-b3b1-b68341eba58b None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:44.161062 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61530f14-b607-4362-b3b1-b68341eba58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:44.176491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:44.183808 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-61530f14-b607-4362-b3b1-b68341eba58b None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:44.186045 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-61530f14-b607-4362-b3b1-b68341eba58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:44.253613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1388/2757] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:44.262015 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2b5f9-0648-4cc7-8a9b-6fecb6577031 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:44.262489 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2b5f9-0648-4cc7-8a9b-6fecb6577031 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:44.262789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2b5f9-0648-4cc7-8a9b-6fecb6577031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:44.284934 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-52c2b5f9-0648-4cc7-8a9b-6fecb6577031 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:44.286209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-52c2b5f9-0648-4cc7-8a9b-6fecb6577031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:44.294981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1370/2758] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:44.299631 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61530f14-b607-4362-b3b1-b68341eba58b None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:44.310341 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61530f14-b607-4362-b3b1-b68341eba58b None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:44.315183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d66a66-cddc-4c1b-83c3-a16c4c4a53cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:44.315820 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d66a66-cddc-4c1b-83c3-a16c4c4a53cc admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:44.316105 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d66a66-cddc-4c1b-83c3-a16c4c4a53cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:44.316384 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d66a66-cddc-4c1b-83c3-a16c4c4a53cc admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:44.317096 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d66a66-cddc-4c1b-83c3-a16c4c4a53cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:03:44.317410 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d66a66-cddc-4c1b-83c3-a16c4c4a53cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:44.319038 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d66a66-cddc-4c1b-83c3-a16c4c4a53cc admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:44.331907 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1389/2759] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:03:44.336788 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2b5f9-0648-4cc7-8a9b-6fecb6577031 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:44.347769 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2b5f9-0648-4cc7-8a9b-6fecb6577031 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:44.352974 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16c883-22ab-43c4-a8e9-7679bd85bc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:44.353636 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16c883-22ab-43c4-a8e9-7679bd85bc2b admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:44.353915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16c883-22ab-43c4-a8e9-7679bd85bc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:44.354187 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16c883-22ab-43c4-a8e9-7679bd85bc2b admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:44.354832 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16c883-22ab-43c4-a8e9-7679bd85bc2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:44.356868 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16c883-22ab-43c4-a8e9-7679bd85bc2b admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:44.387612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1371/2760] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:03:44 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:03:44.392548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d66a66-cddc-4c1b-83c3-a16c4c4a53cc admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:44.403013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d66a66-cddc-4c1b-83c3-a16c4c4a53cc admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:44.464582 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040909cd-8359-4f9b-adfe-72f5e0b1a1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:44.465230 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040909cd-8359-4f9b-adfe-72f5e0b1a1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:44.465515 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040909cd-8359-4f9b-adfe-72f5e0b1a1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:44.465793 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040909cd-8359-4f9b-adfe-72f5e0b1a1e2 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:44.466439 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040909cd-8359-4f9b-adfe-72f5e0b1a1e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:44.468562 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040909cd-8359-4f9b-adfe-72f5e0b1a1e2 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:44.490345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1390/2761] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:03:44 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:03:44.495449 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16c883-22ab-43c4-a8e9-7679bd85bc2b admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:44.506875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16c883-22ab-43c4-a8e9-7679bd85bc2b admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:44.511807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94c35d-7cf8-4532-9ed0-2baa406cfdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:44.512437 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94c35d-7cf8-4532-9ed0-2baa406cfdfc admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:44.512717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94c35d-7cf8-4532-9ed0-2baa406cfdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:44.513018 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94c35d-7cf8-4532-9ed0-2baa406cfdfc admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:44.513668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94c35d-7cf8-4532-9ed0-2baa406cfdfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:44.516347 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94c35d-7cf8-4532-9ed0-2baa406cfdfc admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:44.527612 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1372/2762] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:03:44.531912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040909cd-8359-4f9b-adfe-72f5e0b1a1e2 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:44.543711 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040909cd-8359-4f9b-adfe-72f5e0b1a1e2 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:44.548624 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abdb49-0ab7-49ff-a081-111b0b1b9e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:44.549282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abdb49-0ab7-49ff-a081-111b0b1b9e31 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:44.549565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abdb49-0ab7-49ff-a081-111b0b1b9e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:44.549840 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abdb49-0ab7-49ff-a081-111b0b1b9e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:44.550497 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abdb49-0ab7-49ff-a081-111b0b1b9e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:44.552117 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abdb49-0ab7-49ff-a081-111b0b1b9e31 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:44.564593 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1391/2763] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:03:44.568822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94c35d-7cf8-4532-9ed0-2baa406cfdfc admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:44.582837 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94c35d-7cf8-4532-9ed0-2baa406cfdfc admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:44.587799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b541c-fab4-42e1-a950-5d8c2de68ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:44.588486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b541c-fab4-42e1-a950-5d8c2de68ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:44.588774 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b541c-fab4-42e1-a950-5d8c2de68ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:44.589095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b541c-fab4-42e1-a950-5d8c2de68ca3 admin admin] PATH_INFO: `/v3/projects/decd1127873f4489b036d7ac7d7a01fd/users/cd6f9024af5845e3af95c9ed7030ec99/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:44.611583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b541c-fab4-42e1-a950-5d8c2de68ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=decd1127873f4489b036d7ac7d7a01fd, user_id=cd6f9024af5845e3af95c9ed7030ec99, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:44.615366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b541c-fab4-42e1-a950-5d8c2de68ca3 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:44.632807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1373/2764] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:03:44 2022] PUT /identity/v3/projects/decd1127873f4489b036d7ac7d7a01fd/users/cd6f9024af5845e3af95c9ed7030ec99/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:44.646174 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ba751-cca1-4f2e-8708-719bab5105e8 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:44.646771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ba751-cca1-4f2e-8708-719bab5105e8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:44.646771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ba751-cca1-4f2e-8708-719bab5105e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:44.676974 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-226ba751-cca1-4f2e-8708-719bab5105e8 None None] MFA Rules not processed for user `cd6f9024af5845e3af95c9ed7030ec99`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:44.678348 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-226ba751-cca1-4f2e-8708-719bab5105e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:44.758354 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1392/2765] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:44.770602 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b541c-fab4-42e1-a950-5d8c2de68ca3 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:44.772307 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-183b541c-fab4-42e1-a950-5d8c2de68ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:44.836557 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b541c-fab4-42e1-a950-5d8c2de68ca3 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:44.840229 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6cc81-f768-46ad-af25-99d9e2e5affb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:44.840850 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6cc81-f768-46ad-af25-99d9e2e5affb service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:44.841175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6cc81-f768-46ad-af25-99d9e2e5affb service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:44.841456 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6cc81-f768-46ad-af25-99d9e2e5affb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:44.850905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6cc81-f768-46ad-af25-99d9e2e5affb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:44.852366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6cc81-f768-46ad-af25-99d9e2e5affb service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:44.863365 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1374/2766] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:03:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:03:53.323395 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ba751-cca1-4f2e-8708-719bab5105e8 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:53.328039 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:53.392721 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ba751-cca1-4f2e-8708-719bab5105e8 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:53.397486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1b14b-e696-4693-9a23-48ff3f3d1ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:53.398120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1b14b-e696-4693-9a23-48ff3f3d1ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:53.398403 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1b14b-e696-4693-9a23-48ff3f3d1ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:53.398684 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1b14b-e696-4693-9a23-48ff3f3d1ff5 admin admin] PATH_INFO: `/v3/users/cd6f9024af5845e3af95c9ed7030ec99` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:53.399813 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1b14b-e696-4693-9a23-48ff3f3d1ff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6f9024af5845e3af95c9ed7030ec99)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:53.401764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1b14b-e696-4693-9a23-48ff3f3d1ff5 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:53.447918 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a7d1b14b-e696-4693-9a23-48ff3f3d1ff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6f9024af5845e3af95c9ed7030ec99'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:53.456089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a7d1b14b-e696-4693-9a23-48ff3f3d1ff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6f9024af5845e3af95c9ed7030ec99'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:53.456716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a7d1b14b-e696-4693-9a23-48ff3f3d1ff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6f9024af5845e3af95c9ed7030ec99'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:53.463792 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a7d1b14b-e696-4693-9a23-48ff3f3d1ff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6f9024af5845e3af95c9ed7030ec99'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:53.476982 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-a7d1b14b-e696-4693-9a23-48ff3f3d1ff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6f9024af5845e3af95c9ed7030ec99'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:53.483078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1393/2767] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:03:53 2022] DELETE /identity/v3/users/cd6f9024af5845e3af95c9ed7030ec99 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:53.487877 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f497b26-a389-46c1-b47c-3e910d8964f5 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:53.488372 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f497b26-a389-46c1-b47c-3e910d8964f5 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:53.488483 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f497b26-a389-46c1-b47c-3e910d8964f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:53.507647 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-5f497b26-a389-46c1-b47c-3e910d8964f5 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:53.508923 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5f497b26-a389-46c1-b47c-3e910d8964f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:53.568854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1375/2768] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:03:53.579780 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1b14b-e696-4693-9a23-48ff3f3d1ff5 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:53.580922 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a7d1b14b-e696-4693-9a23-48ff3f3d1ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:53.640691 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1b14b-e696-4693-9a23-48ff3f3d1ff5 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:53.644507 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c9aef-2e4b-444c-ba1b-d820a7a440da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:53.645090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c9aef-2e4b-444c-ba1b-d820a7a440da service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:53.645378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c9aef-2e4b-444c-ba1b-d820a7a440da service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:53.645657 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c9aef-2e4b-444c-ba1b-d820a7a440da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:53.655187 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c9aef-2e4b-444c-ba1b-d820a7a440da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:53.656666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c9aef-2e4b-444c-ba1b-d820a7a440da service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:53.666474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1394/2769] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:03:53.934517 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f497b26-a389-46c1-b47c-3e910d8964f5 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:53.936017 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5f497b26-a389-46c1-b47c-3e910d8964f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:53.949080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f497b26-a389-46c1-b47c-3e910d8964f5 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:53.953659 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547d69a-4b73-45e8-96e1-5d9650af97bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:53.954315 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547d69a-4b73-45e8-96e1-5d9650af97bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:53.954579 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547d69a-4b73-45e8-96e1-5d9650af97bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:53.954858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547d69a-4b73-45e8-96e1-5d9650af97bb admin admin] PATH_INFO: `/v3/projects/decd1127873f4489b036d7ac7d7a01fd` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:53.955988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547d69a-4b73-45e8-96e1-5d9650af97bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=decd1127873f4489b036d7ac7d7a01fd)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:53.957933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547d69a-4b73-45e8-96e1-5d9650af97bb admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:53.964873 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:54.011363 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f547d69a-4b73-45e8-96e1-5d9650af97bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'decd1127873f4489b036d7ac7d7a01fd', 'request_id': 'req-f547d69a-4b73-45e8-96e1-5d9650af97bb'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:54.017605 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f547d69a-4b73-45e8-96e1-5d9650af97bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'decd1127873f4489b036d7ac7d7a01fd', 'request_id': 'req-f547d69a-4b73-45e8-96e1-5d9650af97bb'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:54.025049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f547d69a-4b73-45e8-96e1-5d9650af97bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'decd1127873f4489b036d7ac7d7a01fd', 'request_id': 'req-f547d69a-4b73-45e8-96e1-5d9650af97bb'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:54.035618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f547d69a-4b73-45e8-96e1-5d9650af97bb admin admin] The token cache is being invalidate because project decd1127873f4489b036d7ac7d7a01fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:03:54.035909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f547d69a-4b73-45e8-96e1-5d9650af97bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:54.036529 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f547d69a-4b73-45e8-96e1-5d9650af97bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:54.038044 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1376/2770] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:03:53 2022] DELETE /identity/v3/projects/decd1127873f4489b036d7ac7d7a01fd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:54.042884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a1478-cee3-4d70-af5c-449d05d94e44 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:54.043171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a1478-cee3-4d70-af5c-449d05d94e44 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:54.043445 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a1478-cee3-4d70-af5c-449d05d94e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:54.063463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-e33a1478-cee3-4d70-af5c-449d05d94e44 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:54.064668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-e33a1478-cee3-4d70-af5c-449d05d94e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:54.083308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:54.131158 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1395/2771] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:54.139053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a28f83-beec-49a8-8edc-83f57ceaaafe None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:54.139368 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a28f83-beec-49a8-8edc-83f57ceaaafe None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:54.139650 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a28f83-beec-49a8-8edc-83f57ceaaafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:54.162559 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-87a28f83-beec-49a8-8edc-83f57ceaaafe None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:54.163773 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-87a28f83-beec-49a8-8edc-83f57ceaaafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:54.172178 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1377/2772] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:54.176372 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a1478-cee3-4d70-af5c-449d05d94e44 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:54.187172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a1478-cee3-4d70-af5c-449d05d94e44 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:54.191715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d520d6-5a0a-4f48-a53a-f05f264c1886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:54.192332 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d520d6-5a0a-4f48-a53a-f05f264c1886 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:54.192618 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d520d6-5a0a-4f48-a53a-f05f264c1886 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:54.192890 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d520d6-5a0a-4f48-a53a-f05f264c1886 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:54.193565 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d520d6-5a0a-4f48-a53a-f05f264c1886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:03:54.193868 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d520d6-5a0a-4f48-a53a-f05f264c1886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:54.195446 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d520d6-5a0a-4f48-a53a-f05f264c1886 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:54.208202 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1396/2773] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:03:54.212692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a28f83-beec-49a8-8edc-83f57ceaaafe None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:54.222818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a28f83-beec-49a8-8edc-83f57ceaaafe None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:54.227414 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca4873-a498-4905-a79a-ee16901fc720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:54.228014 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca4873-a498-4905-a79a-ee16901fc720 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:54.228301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca4873-a498-4905-a79a-ee16901fc720 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:54.228578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca4873-a498-4905-a79a-ee16901fc720 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:54.229228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca4873-a498-4905-a79a-ee16901fc720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:54.231128 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca4873-a498-4905-a79a-ee16901fc720 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:54.261697 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1378/2774] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:03:54 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:03:54.266032 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d520d6-5a0a-4f48-a53a-f05f264c1886 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:54.276059 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d520d6-5a0a-4f48-a53a-f05f264c1886 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:54.334879 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6f947-68e5-4139-8ca3-bd1ea22753fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:54.335596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6f947-68e5-4139-8ca3-bd1ea22753fc admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:54.335758 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6f947-68e5-4139-8ca3-bd1ea22753fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:54.336036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6f947-68e5-4139-8ca3-bd1ea22753fc admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:54.336670 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6f947-68e5-4139-8ca3-bd1ea22753fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:54.338667 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6f947-68e5-4139-8ca3-bd1ea22753fc admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:54.359345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1397/2775] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:03:54 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:03:54.363494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca4873-a498-4905-a79a-ee16901fc720 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:54.374701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca4873-a498-4905-a79a-ee16901fc720 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:54.379203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5ade6-f123-4556-9da0-9084d78576fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:54.379817 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5ade6-f123-4556-9da0-9084d78576fa admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:54.380109 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5ade6-f123-4556-9da0-9084d78576fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:54.380383 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5ade6-f123-4556-9da0-9084d78576fa admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:54.381048 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5ade6-f123-4556-9da0-9084d78576fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:54.382797 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5ade6-f123-4556-9da0-9084d78576fa admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:54.393141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1379/2776] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:03:54.397230 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6f947-68e5-4139-8ca3-bd1ea22753fc admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:54.407361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6f947-68e5-4139-8ca3-bd1ea22753fc admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:54.411873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdddc11-d039-4832-be1b-3944fa980b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:54.412519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdddc11-d039-4832-be1b-3944fa980b02 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:54.412800 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdddc11-d039-4832-be1b-3944fa980b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:54.413100 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdddc11-d039-4832-be1b-3944fa980b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:54.413735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdddc11-d039-4832-be1b-3944fa980b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:54.415510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdddc11-d039-4832-be1b-3944fa980b02 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:54.426072 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1398/2777] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:03:54.430173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5ade6-f123-4556-9da0-9084d78576fa admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:54.440807 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5ade6-f123-4556-9da0-9084d78576fa admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:54.445507 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9213dd-dd91-4d54-86d5-4dd050f46bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:54.446149 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9213dd-dd91-4d54-86d5-4dd050f46bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:54.446432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9213dd-dd91-4d54-86d5-4dd050f46bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:54.446708 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9213dd-dd91-4d54-86d5-4dd050f46bfa admin admin] PATH_INFO: `/v3/projects/eea27636526a46c0b467a4014e172f15/users/652cd64c95dd40968401ca01449419ec/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:54.461830 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9213dd-dd91-4d54-86d5-4dd050f46bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea27636526a46c0b467a4014e172f15, user_id=652cd64c95dd40968401ca01449419ec, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:54.464498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9213dd-dd91-4d54-86d5-4dd050f46bfa admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:54.479192 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1380/2778] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:03:54 2022] PUT /identity/v3/projects/eea27636526a46c0b467a4014e172f15/users/652cd64c95dd40968401ca01449419ec/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:54.486392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb2b6e-fe97-4bff-b841-334ca0599c29 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:54.486392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb2b6e-fe97-4bff-b841-334ca0599c29 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:54.486392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb2b6e-fe97-4bff-b841-334ca0599c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:54.505121 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-6ffb2b6e-fe97-4bff-b841-334ca0599c29 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:54.506357 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6ffb2b6e-fe97-4bff-b841-334ca0599c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:54.565477 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1399/2779] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:54.575257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9213dd-dd91-4d54-86d5-4dd050f46bfa admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:54.577561 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-0f9213dd-dd91-4d54-86d5-4dd050f46bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:54.634363 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9213dd-dd91-4d54-86d5-4dd050f46bfa admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:54.637998 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876ae79-f399-43f7-be01-1bd7b9c60142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:54.638609 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876ae79-f399-43f7-be01-1bd7b9c60142 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:54.638888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876ae79-f399-43f7-be01-1bd7b9c60142 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:54.639161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876ae79-f399-43f7-be01-1bd7b9c60142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:54.648527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876ae79-f399-43f7-be01-1bd7b9c60142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:54.649988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876ae79-f399-43f7-be01-1bd7b9c60142 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:54.659936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1381/2780] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:03:55.284932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea46b2-41a9-475b-b952-897ae3b8aff0 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:55.285256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea46b2-41a9-475b-b952-897ae3b8aff0 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:55.285531 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea46b2-41a9-475b-b952-897ae3b8aff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:55.313791 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-deea46b2-41a9-475b-b952-897ae3b8aff0 None None] MFA Rules not processed for user `652cd64c95dd40968401ca01449419ec`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:55.315021 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-deea46b2-41a9-475b-b952-897ae3b8aff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:55.334874 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:55.388527 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1400/2781] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:55 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:55.393611 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876ae79-f399-43f7-be01-1bd7b9c60142 service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:55.403559 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876ae79-f399-43f7-be01-1bd7b9c60142 service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:55.408717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bf39d-01a3-4004-a3c9-c3761b88dfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:55.409426 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bf39d-01a3-4004-a3c9-c3761b88dfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:55.409705 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bf39d-01a3-4004-a3c9-c3761b88dfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:55.410067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bf39d-01a3-4004-a3c9-c3761b88dfb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:55.410780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bf39d-01a3-4004-a3c9-c3761b88dfb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:55.412726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bf39d-01a3-4004-a3c9-c3761b88dfb3 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:55.442391 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1382/2782] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:03:55 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:03:55.443699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea46b2-41a9-475b-b952-897ae3b8aff0 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:55.454996 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea46b2-41a9-475b-b952-897ae3b8aff0 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:55.511526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a453dd-d064-4a4b-b45e-604dd67e54e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:55.512137 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a453dd-d064-4a4b-b45e-604dd67e54e3 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:55.512421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a453dd-d064-4a4b-b45e-604dd67e54e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:55.512697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a453dd-d064-4a4b-b45e-604dd67e54e3 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:55.513353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a453dd-d064-4a4b-b45e-604dd67e54e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:55.515777 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a453dd-d064-4a4b-b45e-604dd67e54e3 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:55.536710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1401/2783] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:03:55 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:03:55.540792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bf39d-01a3-4004-a3c9-c3761b88dfb3 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:55.550949 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bf39d-01a3-4004-a3c9-c3761b88dfb3 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:55.555900 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfd8f7-b81f-4ade-94d1-930d486c44f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:55.556504 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfd8f7-b81f-4ade-94d1-930d486c44f3 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:55.556784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfd8f7-b81f-4ade-94d1-930d486c44f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:55.557084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfd8f7-b81f-4ade-94d1-930d486c44f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:55.557759 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfd8f7-b81f-4ade-94d1-930d486c44f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:55.559343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfd8f7-b81f-4ade-94d1-930d486c44f3 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:55.564865 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:55.574204 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1383/2784] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:03:55.575453 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a453dd-d064-4a4b-b45e-604dd67e54e3 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:55.586547 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a453dd-d064-4a4b-b45e-604dd67e54e3 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:55.591249 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f9a93-d6ee-4afd-8295-28a6ceb66da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:55.591912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f9a93-d6ee-4afd-8295-28a6ceb66da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:55.592198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f9a93-d6ee-4afd-8295-28a6ceb66da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:55.592479 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f9a93-d6ee-4afd-8295-28a6ceb66da4 admin admin] PATH_INFO: `/v3/projects/9d6b6ab2f33c4ff6bf834dbf3e689ae3/users/15fd0bb6a3ba433ab61d2b2521fb9b8b/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:55.608595 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f9a93-d6ee-4afd-8295-28a6ceb66da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6b6ab2f33c4ff6bf834dbf3e689ae3, user_id=15fd0bb6a3ba433ab61d2b2521fb9b8b, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:55.611335 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f9a93-d6ee-4afd-8295-28a6ceb66da4 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:55.624929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1402/2785] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:03:55 2022] PUT /identity/v3/projects/9d6b6ab2f33c4ff6bf834dbf3e689ae3/users/15fd0bb6a3ba433ab61d2b2521fb9b8b/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:55.630382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfd8f7-b81f-4ade-94d1-930d486c44f3 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:55.641526 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfd8f7-b81f-4ade-94d1-930d486c44f3 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:55.697573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edc0d4-d77c-49c9-bf5b-37ec64bbf544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:55.698187 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edc0d4-d77c-49c9-bf5b-37ec64bbf544 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:55.698486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edc0d4-d77c-49c9-bf5b-37ec64bbf544 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:55.698742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edc0d4-d77c-49c9-bf5b-37ec64bbf544 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:55.699381 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edc0d4-d77c-49c9-bf5b-37ec64bbf544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:55.700964 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edc0d4-d77c-49c9-bf5b-37ec64bbf544 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:55.711541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1384/2786] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:03:55.715906 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f9a93-d6ee-4afd-8295-28a6ceb66da4 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:55.726486 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f9a93-d6ee-4afd-8295-28a6ceb66da4 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:55.731077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb28bbd-b4ce-477c-8cb5-d46214dbf3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:55.731729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb28bbd-b4ce-477c-8cb5-d46214dbf3ef admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:55.732009 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb28bbd-b4ce-477c-8cb5-d46214dbf3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:55.732311 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb28bbd-b4ce-477c-8cb5-d46214dbf3ef admin admin] PATH_INFO: `/v3/projects/9d6b6ab2f33c4ff6bf834dbf3e689ae3/users/15fd0bb6a3ba433ab61d2b2521fb9b8b/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:55.734253 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb28bbd-b4ce-477c-8cb5-d46214dbf3ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6b6ab2f33c4ff6bf834dbf3e689ae3, user_id=15fd0bb6a3ba433ab61d2b2521fb9b8b, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:55.736866 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb28bbd-b4ce-477c-8cb5-d46214dbf3ef admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:55.747115 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1403/2787] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:03:55 2022] PUT /identity/v3/projects/9d6b6ab2f33c4ff6bf834dbf3e689ae3/users/15fd0bb6a3ba433ab61d2b2521fb9b8b/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:56.381222 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888710a4-2edc-4239-a733-dd2283007a14 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:56.381538 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888710a4-2edc-4239-a733-dd2283007a14 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:56.381788 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888710a4-2edc-4239-a733-dd2283007a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:56.411514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-888710a4-2edc-4239-a733-dd2283007a14 None None] MFA Rules not processed for user `15fd0bb6a3ba433ab61d2b2521fb9b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:56.412734 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-888710a4-2edc-4239-a733-dd2283007a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:56.484291 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1385/2788] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:56 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:57.507865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb28bbd-b4ce-477c-8cb5-d46214dbf3ef admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:57.574823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb28bbd-b4ce-477c-8cb5-d46214dbf3ef admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:57.579453 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525ba6b-26cf-4bdb-80ca-baa4387576dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:57.580085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525ba6b-26cf-4bdb-80ca-baa4387576dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:57.580370 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525ba6b-26cf-4bdb-80ca-baa4387576dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:57.580648 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525ba6b-26cf-4bdb-80ca-baa4387576dd admin admin] PATH_INFO: `/v3/users/652cd64c95dd40968401ca01449419ec` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:57.581827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525ba6b-26cf-4bdb-80ca-baa4387576dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=652cd64c95dd40968401ca01449419ec)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:57.583801 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525ba6b-26cf-4bdb-80ca-baa4387576dd admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:57.598505 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:57.632016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0525ba6b-26cf-4bdb-80ca-baa4387576dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652cd64c95dd40968401ca01449419ec'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:57.638489 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0525ba6b-26cf-4bdb-80ca-baa4387576dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652cd64c95dd40968401ca01449419ec'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:57.639142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0525ba6b-26cf-4bdb-80ca-baa4387576dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652cd64c95dd40968401ca01449419ec'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:57.646043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0525ba6b-26cf-4bdb-80ca-baa4387576dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652cd64c95dd40968401ca01449419ec'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:57.658662 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-0525ba6b-26cf-4bdb-80ca-baa4387576dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652cd64c95dd40968401ca01449419ec'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:57.664572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1404/2789] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:03:57 2022] DELETE /identity/v3/users/652cd64c95dd40968401ca01449419ec => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:03:57.838046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888710a4-2edc-4239-a733-dd2283007a14 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:57.850078 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888710a4-2edc-4239-a733-dd2283007a14 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:57.908446 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:57.909020 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:57.909314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:57.909591 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c admin admin] PATH_INFO: `/v3/projects/eea27636526a46c0b467a4014e172f15` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:57.910732 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea27636526a46c0b467a4014e172f15)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:57.912682 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:57.937903 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:57.960253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea27636526a46c0b467a4014e172f15', 'request_id': 'req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:57.966322 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea27636526a46c0b467a4014e172f15', 'request_id': 'req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:57.975098 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea27636526a46c0b467a4014e172f15', 'request_id': 'req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:57.986440 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c admin admin] The token cache is being invalidate because project eea27636526a46c0b467a4014e172f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:03:57.986730 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:57.987367 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:57.988858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1386/2790] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:03:57 2022] DELETE /identity/v3/projects/eea27636526a46c0b467a4014e172f15 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:57.992843 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525ba6b-26cf-4bdb-80ca-baa4387576dd admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:57.994268 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0525ba6b-26cf-4bdb-80ca-baa4387576dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:58.007279 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525ba6b-26cf-4bdb-80ca-baa4387576dd admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:58.063150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f7c98-3aba-4674-b545-93f3f32218e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:58.063776 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f7c98-3aba-4674-b545-93f3f32218e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:58.064055 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f7c98-3aba-4674-b545-93f3f32218e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:58.064329 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f7c98-3aba-4674-b545-93f3f32218e4 admin admin] PATH_INFO: `/v3/users/15fd0bb6a3ba433ab61d2b2521fb9b8b` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:58.065490 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f7c98-3aba-4674-b545-93f3f32218e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15fd0bb6a3ba433ab61d2b2521fb9b8b)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:58.067397 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f7c98-3aba-4674-b545-93f3f32218e4 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:58.114133 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ba4f7c98-3aba-4674-b545-93f3f32218e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15fd0bb6a3ba433ab61d2b2521fb9b8b'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:58.121323 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ba4f7c98-3aba-4674-b545-93f3f32218e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15fd0bb6a3ba433ab61d2b2521fb9b8b'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:58.122216 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ba4f7c98-3aba-4674-b545-93f3f32218e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15fd0bb6a3ba433ab61d2b2521fb9b8b'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:58.130042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ba4f7c98-3aba-4674-b545-93f3f32218e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15fd0bb6a3ba433ab61d2b2521fb9b8b'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:58.145725 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ba4f7c98-3aba-4674-b545-93f3f32218e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15fd0bb6a3ba433ab61d2b2521fb9b8b'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:58.152011 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1405/2791] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:03:57 2022] DELETE /identity/v3/users/15fd0bb6a3ba433ab61d2b2521fb9b8b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:58.325145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:58.326699 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:58.340875 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a24ec6-f2c5-48aa-83e4-7b3616070d4c admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:58.399211 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76507f-86ce-4bf8-a34b-03378f1581d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:58.399846 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76507f-86ce-4bf8-a34b-03378f1581d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:58.400156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76507f-86ce-4bf8-a34b-03378f1581d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:58.400404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76507f-86ce-4bf8-a34b-03378f1581d0 admin admin] PATH_INFO: `/v3/projects/9d6b6ab2f33c4ff6bf834dbf3e689ae3` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:58.401549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76507f-86ce-4bf8-a34b-03378f1581d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6b6ab2f33c4ff6bf834dbf3e689ae3)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:58.403443 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76507f-86ce-4bf8-a34b-03378f1581d0 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:58.449905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-db76507f-86ce-4bf8-a34b-03378f1581d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6b6ab2f33c4ff6bf834dbf3e689ae3', 'request_id': 'req-db76507f-86ce-4bf8-a34b-03378f1581d0'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:58.456138 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-db76507f-86ce-4bf8-a34b-03378f1581d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6b6ab2f33c4ff6bf834dbf3e689ae3', 'request_id': 'req-db76507f-86ce-4bf8-a34b-03378f1581d0'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:58.464831 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-db76507f-86ce-4bf8-a34b-03378f1581d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6b6ab2f33c4ff6bf834dbf3e689ae3', 'request_id': 'req-db76507f-86ce-4bf8-a34b-03378f1581d0'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:58.476033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-db76507f-86ce-4bf8-a34b-03378f1581d0 admin admin] The token cache is being invalidate because project 9d6b6ab2f33c4ff6bf834dbf3e689ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:03:58.476325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-db76507f-86ce-4bf8-a34b-03378f1581d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:58.476956 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-db76507f-86ce-4bf8-a34b-03378f1581d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:03:58.478743 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1387/2792] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:03:58 2022] DELETE /identity/v3/projects/9d6b6ab2f33c4ff6bf834dbf3e689ae3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:58.484287 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62ac92-e390-47c7-ab39-f18b269ab685 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:58.484646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62ac92-e390-47c7-ab39-f18b269ab685 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:58.484927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62ac92-e390-47c7-ab39-f18b269ab685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:58.504771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-4d62ac92-e390-47c7-ab39-f18b269ab685 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:58.506017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4d62ac92-e390-47c7-ab39-f18b269ab685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:58.511293 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:58.568541 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1406/2793] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:58.576594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e934eec-aa4a-4011-a55a-e94e73280670 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:58.576909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e934eec-aa4a-4011-a55a-e94e73280670 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:58.577248 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e934eec-aa4a-4011-a55a-e94e73280670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:58.597640 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-4e934eec-aa4a-4011-a55a-e94e73280670 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:58.598882 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-4e934eec-aa4a-4011-a55a-e94e73280670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:58.606988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1388/2794] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:58.611907 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62ac92-e390-47c7-ab39-f18b269ab685 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:58.621870 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62ac92-e390-47c7-ab39-f18b269ab685 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:58.626964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab48fc-f4e6-4079-b703-78f39a50251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:58.627564 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab48fc-f4e6-4079-b703-78f39a50251b admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:58.627841 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab48fc-f4e6-4079-b703-78f39a50251b admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:58.628111 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab48fc-f4e6-4079-b703-78f39a50251b admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:58.628749 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab48fc-f4e6-4079-b703-78f39a50251b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:03:58.629157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab48fc-f4e6-4079-b703-78f39a50251b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:58.630739 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab48fc-f4e6-4079-b703-78f39a50251b admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:58.642343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1407/2795] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:03:58.646710 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e934eec-aa4a-4011-a55a-e94e73280670 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:58.656168 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e934eec-aa4a-4011-a55a-e94e73280670 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:58.660877 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b6fd8-9d83-4e41-a4c9-592f8729e3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:58.661508 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b6fd8-9d83-4e41-a4c9-592f8729e3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:58.661794 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b6fd8-9d83-4e41-a4c9-592f8729e3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:58.662070 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b6fd8-9d83-4e41-a4c9-592f8729e3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:58.662704 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b6fd8-9d83-4e41-a4c9-592f8729e3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:58.664610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b6fd8-9d83-4e41-a4c9-592f8729e3b1 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:58.693384 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1389/2796] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:03:58 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:03:58.697617 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab48fc-f4e6-4079-b703-78f39a50251b admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:58.708145 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab48fc-f4e6-4079-b703-78f39a50251b admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:58.770343 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3e55f-e165-4118-98ba-cc671d117c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:58.770944 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3e55f-e165-4118-98ba-cc671d117c74 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:58.771226 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3e55f-e165-4118-98ba-cc671d117c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:58.771500 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3e55f-e165-4118-98ba-cc671d117c74 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:58.772132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3e55f-e165-4118-98ba-cc671d117c74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:58.774077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3e55f-e165-4118-98ba-cc671d117c74 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:58.797346 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1408/2797] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:03:58 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:03:58.801532 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b6fd8-9d83-4e41-a4c9-592f8729e3b1 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:58.811825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b6fd8-9d83-4e41-a4c9-592f8729e3b1 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:58.817129 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ee20e-0354-4640-a841-dec1d1274254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:58.817742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ee20e-0354-4640-a841-dec1d1274254 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:58.818054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ee20e-0354-4640-a841-dec1d1274254 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:58.818335 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ee20e-0354-4640-a841-dec1d1274254 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:58.818982 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ee20e-0354-4640-a841-dec1d1274254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:58.820586 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ee20e-0354-4640-a841-dec1d1274254 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:58.830849 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1390/2798] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:03:58.834860 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3e55f-e165-4118-98ba-cc671d117c74 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:58.846832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3e55f-e165-4118-98ba-cc671d117c74 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:58.851530 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e90351-c1d5-4656-ba17-68820b5df741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:58.852131 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90351-c1d5-4656-ba17-68820b5df741 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:58.852414 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90351-c1d5-4656-ba17-68820b5df741 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:58.852687 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90351-c1d5-4656-ba17-68820b5df741 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:58.853361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e90351-c1d5-4656-ba17-68820b5df741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:58.854950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e90351-c1d5-4656-ba17-68820b5df741 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:58.868013 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1409/2799] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:03:58.872158 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ee20e-0354-4640-a841-dec1d1274254 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:58.877399 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:58.884844 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ee20e-0354-4640-a841-dec1d1274254 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:58.891121 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e5f4a-b9cf-4ab4-b7c8-ab6ce58735ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:58.891790 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e5f4a-b9cf-4ab4-b7c8-ab6ce58735ab admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:58.892072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e5f4a-b9cf-4ab4-b7c8-ab6ce58735ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:58.892347 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e5f4a-b9cf-4ab4-b7c8-ab6ce58735ab admin admin] PATH_INFO: `/v3/projects/1b8d9c98bed84585b71db2c8e454b6f7/users/9be30ac328714fb08614207ab839f370/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:58.908975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e5f4a-b9cf-4ab4-b7c8-ab6ce58735ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8d9c98bed84585b71db2c8e454b6f7, user_id=9be30ac328714fb08614207ab839f370, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:58.911669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e5f4a-b9cf-4ab4-b7c8-ab6ce58735ab admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:58.925818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1391/2800] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:03:58 2022] PUT /identity/v3/projects/1b8d9c98bed84585b71db2c8e454b6f7/users/9be30ac328714fb08614207ab839f370/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:03:58.932492 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a5c01-44fd-47f3-a480-3421cb23b6a5 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:58.932775 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a5c01-44fd-47f3-a480-3421cb23b6a5 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:58.933089 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a5c01-44fd-47f3-a480-3421cb23b6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:58.951579 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-904a5c01-44fd-47f3-a480-3421cb23b6a5 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:03:58.952791 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-904a5c01-44fd-47f3-a480-3421cb23b6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:59.015185 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1410/2801] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:03:59.025226 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e5f4a-b9cf-4ab4-b7c8-ab6ce58735ab admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:03:59.026951 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-276e5f4a-b9cf-4ab4-b7c8-ab6ce58735ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:03:59.087389 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e5f4a-b9cf-4ab4-b7c8-ab6ce58735ab admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:03:59.091058 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfc0e8-8327-4156-a59f-f135494e3bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:03:59.091672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfc0e8-8327-4156-a59f-f135494e3bce service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:59.091955 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfc0e8-8327-4156-a59f-f135494e3bce service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:59.092228 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfc0e8-8327-4156-a59f-f135494e3bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:03:59.102495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfc0e8-8327-4156-a59f-f135494e3bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:03:59.104007 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfc0e8-8327-4156-a59f-f135494e3bce service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:03:59.114317 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1392/2802] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:03:59.987065 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ef734-3dde-4db7-9e30-f578a88a3f9d None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:03:59.987615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ef734-3dde-4db7-9e30-f578a88a3f9d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:03:59.987732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ef734-3dde-4db7-9e30-f578a88a3f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:00.016615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-5b7ef734-3dde-4db7-9e30-f578a88a3f9d None None] MFA Rules not processed for user `9be30ac328714fb08614207ab839f370`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:00.017873 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-5b7ef734-3dde-4db7-9e30-f578a88a3f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:00.022998 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:00.086184 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1411/2803] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:03:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:04:00.090651 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfc0e8-8327-4156-a59f-f135494e3bce service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:00.100638 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfc0e8-8327-4156-a59f-f135494e3bce service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:00.108757 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd8dea-0bdc-4d93-99f8-dd6fbc383a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:00.108983 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd8dea-0bdc-4d93-99f8-dd6fbc383a36 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:00.109211 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd8dea-0bdc-4d93-99f8-dd6fbc383a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:00.109481 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd8dea-0bdc-4d93-99f8-dd6fbc383a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:00.110465 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd8dea-0bdc-4d93-99f8-dd6fbc383a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:00.111994 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd8dea-0bdc-4d93-99f8-dd6fbc383a36 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:00.146009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1393/2804] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:04:00 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:04:00.147456 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ef734-3dde-4db7-9e30-f578a88a3f9d None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:00.158526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ef734-3dde-4db7-9e30-f578a88a3f9d None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:00.215601 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d01c7c-d162-4af5-9273-8e1b842b83dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:00.216243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d01c7c-d162-4af5-9273-8e1b842b83dd admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:00.216528 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d01c7c-d162-4af5-9273-8e1b842b83dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:00.216805 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d01c7c-d162-4af5-9273-8e1b842b83dd admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:00.218102 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d01c7c-d162-4af5-9273-8e1b842b83dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:00.220300 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d01c7c-d162-4af5-9273-8e1b842b83dd admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:00.241867 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1412/2805] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:04:00 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:04:00.245882 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd8dea-0bdc-4d93-99f8-dd6fbc383a36 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:00.256257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd8dea-0bdc-4d93-99f8-dd6fbc383a36 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:00.260764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595a175-0c29-42ec-b09b-b6cd0af0142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:00.261470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595a175-0c29-42ec-b09b-b6cd0af0142b admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:00.261754 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595a175-0c29-42ec-b09b-b6cd0af0142b admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:00.262030 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595a175-0c29-42ec-b09b-b6cd0af0142b admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:00.262674 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595a175-0c29-42ec-b09b-b6cd0af0142b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:00.264257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595a175-0c29-42ec-b09b-b6cd0af0142b admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:00.274709 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1394/2806] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:04:00.278734 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d01c7c-d162-4af5-9273-8e1b842b83dd admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:00.289259 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d01c7c-d162-4af5-9273-8e1b842b83dd admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:00.293834 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45d59a-fd3d-4996-9693-abf1548a8229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:00.294481 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45d59a-fd3d-4996-9693-abf1548a8229 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:00.294764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45d59a-fd3d-4996-9693-abf1548a8229 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:00.295040 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45d59a-fd3d-4996-9693-abf1548a8229 admin admin] PATH_INFO: `/v3/projects/55b602c9c48747e4891eaa93596b21fb/users/2605807ea370496bb1b1f430c6b281f9/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:00.311029 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45d59a-fd3d-4996-9693-abf1548a8229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b602c9c48747e4891eaa93596b21fb, user_id=2605807ea370496bb1b1f430c6b281f9, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:00.313822 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45d59a-fd3d-4996-9693-abf1548a8229 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:00.327183 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1413/2807] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:04:00 2022] PUT /identity/v3/projects/55b602c9c48747e4891eaa93596b21fb/users/2605807ea370496bb1b1f430c6b281f9/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:00.331156 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595a175-0c29-42ec-b09b-b6cd0af0142b admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:00.341380 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595a175-0c29-42ec-b09b-b6cd0af0142b admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:00.397178 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1145f-6fe1-413f-8f9b-5806f8e8ffbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:00.397787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1145f-6fe1-413f-8f9b-5806f8e8ffbb admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:00.398253 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1145f-6fe1-413f-8f9b-5806f8e8ffbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:00.398585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1145f-6fe1-413f-8f9b-5806f8e8ffbb admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:00.399233 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1145f-6fe1-413f-8f9b-5806f8e8ffbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:00.400815 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1145f-6fe1-413f-8f9b-5806f8e8ffbb admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:00.411159 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1395/2808] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:04:00.415256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45d59a-fd3d-4996-9693-abf1548a8229 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:00.426030 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45d59a-fd3d-4996-9693-abf1548a8229 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:00.430737 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddb512-092a-4bff-a595-9285a39c8c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:00.431379 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb512-092a-4bff-a595-9285a39c8c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:00.431658 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb512-092a-4bff-a595-9285a39c8c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:00.431948 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb512-092a-4bff-a595-9285a39c8c6c admin admin] PATH_INFO: `/v3/projects/55b602c9c48747e4891eaa93596b21fb/users/2605807ea370496bb1b1f430c6b281f9/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:00.433891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddb512-092a-4bff-a595-9285a39c8c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b602c9c48747e4891eaa93596b21fb, user_id=2605807ea370496bb1b1f430c6b281f9, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:00.436512 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddb512-092a-4bff-a595-9285a39c8c6c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:00.446525 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1414/2809] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:04:00 2022] PUT /identity/v3/projects/55b602c9c48747e4891eaa93596b21fb/users/2605807ea370496bb1b1f430c6b281f9/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:01.066965 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab37031-fbb5-47b1-b7b8-fcc5e09d33e0 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:01.067352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab37031-fbb5-47b1-b7b8-fcc5e09d33e0 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:01.067697 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab37031-fbb5-47b1-b7b8-fcc5e09d33e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:01.098227 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-aab37031-fbb5-47b1-b7b8-fcc5e09d33e0 None None] MFA Rules not processed for user `2605807ea370496bb1b1f430c6b281f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:01.099575 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-aab37031-fbb5-47b1-b7b8-fcc5e09d33e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:01.132402 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:01.170753 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1396/2810] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:04:01.181297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece05052-c731-4d70-8c39-b15e367d2154 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:01.181830 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece05052-c731-4d70-8c39-b15e367d2154 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:01.181965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece05052-c731-4d70-8c39-b15e367d2154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:01.201410 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-ece05052-c731-4d70-8c39-b15e367d2154 None None] MFA Rules not processed for user `9be30ac328714fb08614207ab839f370`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:01.203113 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ece05052-c731-4d70-8c39-b15e367d2154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:01.259509 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1415/2811] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:04:01.272946 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab37031-fbb5-47b1-b7b8-fcc5e09d33e0 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:01.274457 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-aab37031-fbb5-47b1-b7b8-fcc5e09d33e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:01.350627 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab37031-fbb5-47b1-b7b8-fcc5e09d33e0 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:01.356137 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163133e-3121-4e8f-a975-8423bc708e96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:01.356738 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163133e-3121-4e8f-a975-8423bc708e96 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:01.357046 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163133e-3121-4e8f-a975-8423bc708e96 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:01.357326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163133e-3121-4e8f-a975-8423bc708e96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:01.365107 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163133e-3121-4e8f-a975-8423bc708e96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:01.366678 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163133e-3121-4e8f-a975-8423bc708e96 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:01.375435 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1397/2812] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:04:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:04:01.913779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece05052-c731-4d70-8c39-b15e367d2154 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:01.915268 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ece05052-c731-4d70-8c39-b15e367d2154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:01.921545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:01.989085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece05052-c731-4d70-8c39-b15e367d2154 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:01.994171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16aea-3915-43ab-a549-58937c1a27f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95abbd88e549427abbf5699efed0451a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:01.994784 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16aea-3915-43ab-a549-58937c1a27f7 service placement] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:01.995070 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16aea-3915-43ab-a549-58937c1a27f7 service placement] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:01.995355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16aea-3915-43ab-a549-58937c1a27f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:01.997115 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6af16aea-3915-43ab-a549-58937c1a27f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:02.009177 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af16aea-3915-43ab-a549-58937c1a27f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:02.010748 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af16aea-3915-43ab-a549-58937c1a27f7 service placement] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:02.021397 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1416/2813] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:04:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:04:11.371364 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=48 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:11.768136 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163133e-3121-4e8f-a975-8423bc708e96 service nova] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:11.769822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-1163133e-3121-4e8f-a975-8423bc708e96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:11.785537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163133e-3121-4e8f-a975-8423bc708e96 service nova] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:11.791352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7434e5-82a8-4b67-a0d3-9a26cc778a47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63d6e588f6e4b598b75a2ec13bea25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:11.792112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7434e5-82a8-4b67-a0d3-9a26cc778a47 service nova] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:11.792404 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7434e5-82a8-4b67-a0d3-9a26cc778a47 service nova] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:11.792782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7434e5-82a8-4b67-a0d3-9a26cc778a47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:11.794560 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-bc7434e5-82a8-4b67-a0d3-9a26cc778a47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:11.807961 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7434e5-82a8-4b67-a0d3-9a26cc778a47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:11.809579 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7434e5-82a8-4b67-a0d3-9a26cc778a47 service nova] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:11.820468 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1398/2814] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:04:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:04:12.016934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=30 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:15.238430 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16aea-3915-43ab-a549-58937c1a27f7 service placement] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:15.239821 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6af16aea-3915-43ab-a549-58937c1a27f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:15.295837 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16aea-3915-43ab-a549-58937c1a27f7 service placement] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:15.299473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019da588-b7c7-42b5-9ad4-de0547f150f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:15.300076 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019da588-b7c7-42b5-9ad4-de0547f150f9 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:15.300358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019da588-b7c7-42b5-9ad4-de0547f150f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:15.300633 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019da588-b7c7-42b5-9ad4-de0547f150f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:15.309561 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019da588-b7c7-42b5-9ad4-de0547f150f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:15.311009 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019da588-b7c7-42b5-9ad4-de0547f150f9 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:15.320288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1417/2815] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:04:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:04:21.815684 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=6 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:25.316100 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=26 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:34.519584 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7434e5-82a8-4b67-a0d3-9a26cc778a47 service nova] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:34.521139 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-bc7434e5-82a8-4b67-a0d3-9a26cc778a47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:34.537027 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7434e5-82a8-4b67-a0d3-9a26cc778a47 service nova] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:34.542040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c821b8-a382-4e18-b0cc-ef80202b1d20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95abbd88e549427abbf5699efed0451a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:34.542652 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c821b8-a382-4e18-b0cc-ef80202b1d20 service placement] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:34.542936 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c821b8-a382-4e18-b0cc-ef80202b1d20 service placement] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:34.543214 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c821b8-a382-4e18-b0cc-ef80202b1d20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:34.544932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-10c821b8-a382-4e18-b0cc-ef80202b1d20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:34.557064 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c821b8-a382-4e18-b0cc-ef80202b1d20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:34.558688 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c821b8-a382-4e18-b0cc-ef80202b1d20 service placement] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:34.572894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1399/2816] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:04:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:04:35.098460 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019da588-b7c7-42b5-9ad4-de0547f150f9 service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:35.110665 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019da588-b7c7-42b5-9ad4-de0547f150f9 service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:35.115928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7848972-aaf7-49ee-be51-5f8764339fb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95abbd88e549427abbf5699efed0451a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:35.116747 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7848972-aaf7-49ee-be51-5f8764339fb9 service placement] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:35.117056 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7848972-aaf7-49ee-be51-5f8764339fb9 service placement] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:35.117328 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7848972-aaf7-49ee-be51-5f8764339fb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:35.119271 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-a7848972-aaf7-49ee-be51-5f8764339fb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:35.132962 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7848972-aaf7-49ee-be51-5f8764339fb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:35.134582 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7848972-aaf7-49ee-be51-5f8764339fb9 service placement] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:35.146990 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1418/2817] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:04:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 09:04:35.159701 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c821b8-a382-4e18-b0cc-ef80202b1d20 service placement] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:35.229028 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c821b8-a382-4e18-b0cc-ef80202b1d20 service placement] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:35.234136 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242c34d-44e2-402c-91c9-5105c9466f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:35.234764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242c34d-44e2-402c-91c9-5105c9466f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:35.235049 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242c34d-44e2-402c-91c9-5105c9466f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:35.235352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242c34d-44e2-402c-91c9-5105c9466f80 admin admin] PATH_INFO: `/v3/users/9be30ac328714fb08614207ab839f370` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:35.236475 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242c34d-44e2-402c-91c9-5105c9466f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be30ac328714fb08614207ab839f370)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:35.238441 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242c34d-44e2-402c-91c9-5105c9466f80 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:35.283717 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7242c34d-44e2-402c-91c9-5105c9466f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be30ac328714fb08614207ab839f370'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:35.290432 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7242c34d-44e2-402c-91c9-5105c9466f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be30ac328714fb08614207ab839f370'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:35.291123 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7242c34d-44e2-402c-91c9-5105c9466f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be30ac328714fb08614207ab839f370'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:35.291735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7242c34d-44e2-402c-91c9-5105c9466f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be30ac328714fb08614207ab839f370'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:35.299395 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-7242c34d-44e2-402c-91c9-5105c9466f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be30ac328714fb08614207ab839f370'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:35.316812 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1400/2818] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:04:35 2022] DELETE /identity/v3/users/9be30ac328714fb08614207ab839f370 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:35.487459 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7848972-aaf7-49ee-be51-5f8764339fb9 service placement] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:35.497941 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7848972-aaf7-49ee-be51-5f8764339fb9 service placement] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:35.559058 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974cd77-eb41-49b9-bb16-633363a6bd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:35.559610 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974cd77-eb41-49b9-bb16-633363a6bd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:35.559892 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974cd77-eb41-49b9-bb16-633363a6bd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:35.560195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974cd77-eb41-49b9-bb16-633363a6bd41 admin admin] PATH_INFO: `/v3/projects/1b8d9c98bed84585b71db2c8e454b6f7` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:35.561333 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974cd77-eb41-49b9-bb16-633363a6bd41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8d9c98bed84585b71db2c8e454b6f7)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:35.563224 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974cd77-eb41-49b9-bb16-633363a6bd41 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:35.614951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c974cd77-eb41-49b9-bb16-633363a6bd41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8d9c98bed84585b71db2c8e454b6f7', 'request_id': 'req-c974cd77-eb41-49b9-bb16-633363a6bd41'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:35.621176 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c974cd77-eb41-49b9-bb16-633363a6bd41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8d9c98bed84585b71db2c8e454b6f7', 'request_id': 'req-c974cd77-eb41-49b9-bb16-633363a6bd41'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:35.628965 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c974cd77-eb41-49b9-bb16-633363a6bd41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8d9c98bed84585b71db2c8e454b6f7', 'request_id': 'req-c974cd77-eb41-49b9-bb16-633363a6bd41'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:35.639778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c974cd77-eb41-49b9-bb16-633363a6bd41 admin admin] The token cache is being invalidate because project 1b8d9c98bed84585b71db2c8e454b6f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:04:35.640095 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c974cd77-eb41-49b9-bb16-633363a6bd41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:35.640704 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-c974cd77-eb41-49b9-bb16-633363a6bd41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:35.642209 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1419/2819] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:04:35 2022] DELETE /identity/v3/projects/1b8d9c98bed84585b71db2c8e454b6f7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:35.646176 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242c34d-44e2-402c-91c9-5105c9466f80 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:35.647573 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7242c34d-44e2-402c-91c9-5105c9466f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:35.667088 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242c34d-44e2-402c-91c9-5105c9466f80 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:35.731068 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e1c19-bdd0-4f00-b4e3-11ef70bb0583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:35.732695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e1c19-bdd0-4f00-b4e3-11ef70bb0583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:35.732981 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e1c19-bdd0-4f00-b4e3-11ef70bb0583 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:35.733732 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e1c19-bdd0-4f00-b4e3-11ef70bb0583 admin admin] PATH_INFO: `/v3/users/2605807ea370496bb1b1f430c6b281f9` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:35.734429 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e1c19-bdd0-4f00-b4e3-11ef70bb0583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2605807ea370496bb1b1f430c6b281f9)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:35.736345 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e1c19-bdd0-4f00-b4e3-11ef70bb0583 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:35.742811 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:35.794531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6f4e1c19-bdd0-4f00-b4e3-11ef70bb0583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2605807ea370496bb1b1f430c6b281f9'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:35.802731 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6f4e1c19-bdd0-4f00-b4e3-11ef70bb0583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2605807ea370496bb1b1f430c6b281f9'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:35.803400 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6f4e1c19-bdd0-4f00-b4e3-11ef70bb0583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2605807ea370496bb1b1f430c6b281f9'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:35.804053 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6f4e1c19-bdd0-4f00-b4e3-11ef70bb0583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2605807ea370496bb1b1f430c6b281f9'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:35.811457 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-6f4e1c19-bdd0-4f00-b4e3-11ef70bb0583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2605807ea370496bb1b1f430c6b281f9'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:35.830344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1401/2820] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:04:35 2022] DELETE /identity/v3/users/2605807ea370496bb1b1f430c6b281f9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:36.008420 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974cd77-eb41-49b9-bb16-633363a6bd41 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:36.009891 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c974cd77-eb41-49b9-bb16-633363a6bd41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:36.030169 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974cd77-eb41-49b9-bb16-633363a6bd41 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:36.104381 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf9923-f404-4e71-9b06-a2e59b62a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:36.105135 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf9923-f404-4e71-9b06-a2e59b62a459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:36.105488 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf9923-f404-4e71-9b06-a2e59b62a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:36.105827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf9923-f404-4e71-9b06-a2e59b62a459 admin admin] PATH_INFO: `/v3/projects/55b602c9c48747e4891eaa93596b21fb` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:36.107585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf9923-f404-4e71-9b06-a2e59b62a459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b602c9c48747e4891eaa93596b21fb)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:36.109925 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf9923-f404-4e71-9b06-a2e59b62a459 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:36.133159 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:36.173916 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ddcf9923-f404-4e71-9b06-a2e59b62a459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b602c9c48747e4891eaa93596b21fb', 'request_id': 'req-ddcf9923-f404-4e71-9b06-a2e59b62a459'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:36.180723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ddcf9923-f404-4e71-9b06-a2e59b62a459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b602c9c48747e4891eaa93596b21fb', 'request_id': 'req-ddcf9923-f404-4e71-9b06-a2e59b62a459'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:36.189467 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ddcf9923-f404-4e71-9b06-a2e59b62a459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b602c9c48747e4891eaa93596b21fb', 'request_id': 'req-ddcf9923-f404-4e71-9b06-a2e59b62a459'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:36.199887 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ddcf9923-f404-4e71-9b06-a2e59b62a459 admin admin] The token cache is being invalidate because project 55b602c9c48747e4891eaa93596b21fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:04:36.200173 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ddcf9923-f404-4e71-9b06-a2e59b62a459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:36.200817 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-ddcf9923-f404-4e71-9b06-a2e59b62a459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:36.202330 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1420/2821] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:04:36 2022] DELETE /identity/v3/projects/55b602c9c48747e4891eaa93596b21fb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:36.207231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc1f24-c739-493f-9980-72c302bb897f None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:36.207515 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc1f24-c739-493f-9980-72c302bb897f None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:36.207810 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc1f24-c739-493f-9980-72c302bb897f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:36.230288 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-89bc1f24-c739-493f-9980-72c302bb897f None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:36.231531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-89bc1f24-c739-493f-9980-72c302bb897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:36.293999 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1402/2822] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:04:36.302082 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b71731-4275-4624-82f4-d7e4b09e6cd4 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:36.302369 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b71731-4275-4624-82f4-d7e4b09e6cd4 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:36.302644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b71731-4275-4624-82f4-d7e4b09e6cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:36.322067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-53b71731-4275-4624-82f4-d7e4b09e6cd4 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:36.323269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-53b71731-4275-4624-82f4-d7e4b09e6cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:36.331077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1421/2823] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:04:36.335343 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc1f24-c739-493f-9980-72c302bb897f None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:36.345876 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc1f24-c739-493f-9980-72c302bb897f None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:36.350484 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a87988-81f3-4388-b5c7-3dbc8b24bc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:36.351076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87988-81f3-4388-b5c7-3dbc8b24bc9b admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:36.351359 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87988-81f3-4388-b5c7-3dbc8b24bc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:36.351631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87988-81f3-4388-b5c7-3dbc8b24bc9b admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:36.352277 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a87988-81f3-4388-b5c7-3dbc8b24bc9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:04:36.352578 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a87988-81f3-4388-b5c7-3dbc8b24bc9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:36.354182 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a87988-81f3-4388-b5c7-3dbc8b24bc9b admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:36.366010 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1403/2824] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:04:36.370319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b71731-4275-4624-82f4-d7e4b09e6cd4 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:36.379421 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b71731-4275-4624-82f4-d7e4b09e6cd4 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:36.384084 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ae417-da51-4207-9cd5-7bcff005a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:36.384697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae417-da51-4207-9cd5-7bcff005a92a admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:36.384961 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae417-da51-4207-9cd5-7bcff005a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:36.385269 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae417-da51-4207-9cd5-7bcff005a92a admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:36.385895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ae417-da51-4207-9cd5-7bcff005a92a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:36.387800 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ae417-da51-4207-9cd5-7bcff005a92a admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:36.419109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1422/2825] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:04:36 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:04:36.420782 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a87988-81f3-4388-b5c7-3dbc8b24bc9b admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:36.431829 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a87988-81f3-4388-b5c7-3dbc8b24bc9b admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:36.487512 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6fc11-a826-4987-8ef3-9993e84b42b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:36.488117 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6fc11-a826-4987-8ef3-9993e84b42b1 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:36.488397 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6fc11-a826-4987-8ef3-9993e84b42b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:36.488669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6fc11-a826-4987-8ef3-9993e84b42b1 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:36.489313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6fc11-a826-4987-8ef3-9993e84b42b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:36.491216 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6fc11-a826-4987-8ef3-9993e84b42b1 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:36.511799 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1404/2826] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:04:36 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:04:36.515916 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ae417-da51-4207-9cd5-7bcff005a92a admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:36.526181 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ae417-da51-4207-9cd5-7bcff005a92a admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:36.531697 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685cb78-dd84-414a-85f8-9c60ad1e1eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:36.532352 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685cb78-dd84-414a-85f8-9c60ad1e1eec admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:36.532637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685cb78-dd84-414a-85f8-9c60ad1e1eec admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:36.532910 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685cb78-dd84-414a-85f8-9c60ad1e1eec admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:36.533585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685cb78-dd84-414a-85f8-9c60ad1e1eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:36.535180 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685cb78-dd84-414a-85f8-9c60ad1e1eec admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:36.545689 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1423/2827] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:04:36.549784 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6fc11-a826-4987-8ef3-9993e84b42b1 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:36.554980 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:36.561719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6fc11-a826-4987-8ef3-9993e84b42b1 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:36.567299 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cc103-2b72-4d72-b79d-aa69f169d3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:36.567918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cc103-2b72-4d72-b79d-aa69f169d3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:36.568185 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cc103-2b72-4d72-b79d-aa69f169d3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:36.568461 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cc103-2b72-4d72-b79d-aa69f169d3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:36.569160 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cc103-2b72-4d72-b79d-aa69f169d3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:36.570752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cc103-2b72-4d72-b79d-aa69f169d3f7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:36.582172 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1405/2828] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:04:36.586366 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685cb78-dd84-414a-85f8-9c60ad1e1eec admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:36.597463 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685cb78-dd84-414a-85f8-9c60ad1e1eec admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:36.602056 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c4585-beb6-4972-a0ed-011ed55e3e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:36.602704 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c4585-beb6-4972-a0ed-011ed55e3e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:36.602991 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c4585-beb6-4972-a0ed-011ed55e3e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:36.603272 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c4585-beb6-4972-a0ed-011ed55e3e30 admin admin] PATH_INFO: `/v3/projects/5af95dc0e43e4d7bb7e898eccbc109ff/users/001d863a05b44516a61998514985db1e/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:36.617646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c4585-beb6-4972-a0ed-011ed55e3e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af95dc0e43e4d7bb7e898eccbc109ff, user_id=001d863a05b44516a61998514985db1e, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:36.620297 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c4585-beb6-4972-a0ed-011ed55e3e30 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:36.634143 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1424/2829] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:04:36 2022] PUT /identity/v3/projects/5af95dc0e43e4d7bb7e898eccbc109ff/users/001d863a05b44516a61998514985db1e/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:36.644846 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8321188-26a2-447e-a684-900ec378577c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:36.645172 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8321188-26a2-447e-a684-900ec378577c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:36.645452 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8321188-26a2-447e-a684-900ec378577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:36.672729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-a8321188-26a2-447e-a684-900ec378577c None None] MFA Rules not processed for user `001d863a05b44516a61998514985db1e`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:36.673975 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a8321188-26a2-447e-a684-900ec378577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:36.741467 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1406/2830] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:04:36.752528 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c4585-beb6-4972-a0ed-011ed55e3e30 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:36.754250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-ac3c4585-beb6-4972-a0ed-011ed55e3e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:36.811447 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c4585-beb6-4972-a0ed-011ed55e3e30 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:36.815194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f44e43-3f10-40b4-8c2c-6f25706ba7ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:36.815796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f44e43-3f10-40b4-8c2c-6f25706ba7ec service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:36.816077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f44e43-3f10-40b4-8c2c-6f25706ba7ec service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:36.816353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f44e43-3f10-40b4-8c2c-6f25706ba7ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:36.824669 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f44e43-3f10-40b4-8c2c-6f25706ba7ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:36.826644 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f44e43-3f10-40b4-8c2c-6f25706ba7ec service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:36.835387 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1425/2831] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:04:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:04:36.855066 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8321188-26a2-447e-a684-900ec378577c None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:36.919154 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8321188-26a2-447e-a684-900ec378577c None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:36.923692 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be752cc-6e65-4432-8c2c-f6a05295589c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:36.924313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be752cc-6e65-4432-8c2c-f6a05295589c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:36.924593 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be752cc-6e65-4432-8c2c-f6a05295589c admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:36.924865 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be752cc-6e65-4432-8c2c-f6a05295589c admin admin] PATH_INFO: `/v3/users/001d863a05b44516a61998514985db1e` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:36.926008 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be752cc-6e65-4432-8c2c-f6a05295589c admin admin] RBAC: Authorizing `identity:delete_user(user_id=001d863a05b44516a61998514985db1e)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:36.928037 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be752cc-6e65-4432-8c2c-f6a05295589c admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:36.974042 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5be752cc-6e65-4432-8c2c-f6a05295589c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001d863a05b44516a61998514985db1e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:36.981262 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5be752cc-6e65-4432-8c2c-f6a05295589c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001d863a05b44516a61998514985db1e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:36.981893 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5be752cc-6e65-4432-8c2c-f6a05295589c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001d863a05b44516a61998514985db1e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:36.982603 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5be752cc-6e65-4432-8c2c-f6a05295589c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001d863a05b44516a61998514985db1e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:36.989661 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-5be752cc-6e65-4432-8c2c-f6a05295589c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001d863a05b44516a61998514985db1e'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:37.003081 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:37.008175 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1407/2832] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:04:36 2022] DELETE /identity/v3/users/001d863a05b44516a61998514985db1e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:37.012865 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c35c-8dd4-4841-96c8-1997109c19f3 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:37.013192 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c35c-8dd4-4841-96c8-1997109c19f3 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:37.014096 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c35c-8dd4-4841-96c8-1997109c19f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:37.032472 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-adc5c35c-8dd4-4841-96c8-1997109c19f3 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:37.033717 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-adc5c35c-8dd4-4841-96c8-1997109c19f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:37.074241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:37.097086 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1426/2833] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:04:37.106764 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be752cc-6e65-4432-8c2c-f6a05295589c admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:37.108249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-5be752cc-6e65-4432-8c2c-f6a05295589c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:37.165935 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be752cc-6e65-4432-8c2c-f6a05295589c admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:37.169591 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c7729-f560-45fb-bef3-ddfdd4611723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:37.170192 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c7729-f560-45fb-bef3-ddfdd4611723 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:37.170470 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c7729-f560-45fb-bef3-ddfdd4611723 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:37.170742 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c7729-f560-45fb-bef3-ddfdd4611723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:37.180369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c7729-f560-45fb-bef3-ddfdd4611723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:37.181820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c7729-f560-45fb-bef3-ddfdd4611723 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:37.194561 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1408/2834] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:04:37.474868 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5c35c-8dd4-4841-96c8-1997109c19f3 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:37.476368 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-adc5c35c-8dd4-4841-96c8-1997109c19f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:37.490324 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5c35c-8dd4-4841-96c8-1997109c19f3 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:37.495042 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102eca4-8b8b-476b-80e2-3e1ae44c6c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:37.495752 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102eca4-8b8b-476b-80e2-3e1ae44c6c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:37.496125 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102eca4-8b8b-476b-80e2-3e1ae44c6c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:37.496407 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102eca4-8b8b-476b-80e2-3e1ae44c6c49 admin admin] PATH_INFO: `/v3/projects/5af95dc0e43e4d7bb7e898eccbc109ff` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:37.497586 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102eca4-8b8b-476b-80e2-3e1ae44c6c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af95dc0e43e4d7bb7e898eccbc109ff)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:37.500100 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102eca4-8b8b-476b-80e2-3e1ae44c6c49 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:37.546578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f102eca4-8b8b-476b-80e2-3e1ae44c6c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af95dc0e43e4d7bb7e898eccbc109ff', 'request_id': 'req-f102eca4-8b8b-476b-80e2-3e1ae44c6c49'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:37.552724 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f102eca4-8b8b-476b-80e2-3e1ae44c6c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af95dc0e43e4d7bb7e898eccbc109ff', 'request_id': 'req-f102eca4-8b8b-476b-80e2-3e1ae44c6c49'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:37.560934 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f102eca4-8b8b-476b-80e2-3e1ae44c6c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af95dc0e43e4d7bb7e898eccbc109ff', 'request_id': 'req-f102eca4-8b8b-476b-80e2-3e1ae44c6c49'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:37.571361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f102eca4-8b8b-476b-80e2-3e1ae44c6c49 admin admin] The token cache is being invalidate because project 5af95dc0e43e4d7bb7e898eccbc109ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:04:37.571651 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f102eca4-8b8b-476b-80e2-3e1ae44c6c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:37.572308 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f102eca4-8b8b-476b-80e2-3e1ae44c6c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:37.573836 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1427/2835] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:04:37 2022] DELETE /identity/v3/projects/5af95dc0e43e4d7bb7e898eccbc109ff => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 09:04:37.578779 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f718d-e9b1-4878-bf22-a285d5f5c211 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:37.579164 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f718d-e9b1-4878-bf22-a285d5f5c211 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:37.579326 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f718d-e9b1-4878-bf22-a285d5f5c211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:37.600301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-7c3f718d-e9b1-4878-bf22-a285d5f5c211 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:37.601202 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7c3f718d-e9b1-4878-bf22-a285d5f5c211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:37.663255 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1409/2836] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:04:37.672929 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5c13d-ce54-4930-8ffc-bd09eb2d4366 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:37.673256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5c13d-ce54-4930-8ffc-bd09eb2d4366 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:37.673538 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5c13d-ce54-4930-8ffc-bd09eb2d4366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:37.693419 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-eac5c13d-ce54-4930-8ffc-bd09eb2d4366 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:37.694634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-eac5c13d-ce54-4930-8ffc-bd09eb2d4366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:37.702531 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1428/2837] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:04:37.706669 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f718d-e9b1-4878-bf22-a285d5f5c211 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:37.717169 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f718d-e9b1-4878-bf22-a285d5f5c211 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:37.721917 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aee98c-520c-47d2-9135-17e882195db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:37.722631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aee98c-520c-47d2-9135-17e882195db0 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:37.722909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aee98c-520c-47d2-9135-17e882195db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:37.723182 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aee98c-520c-47d2-9135-17e882195db0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:37.723825 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aee98c-520c-47d2-9135-17e882195db0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:04:37.724141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aee98c-520c-47d2-9135-17e882195db0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:37.725748 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aee98c-520c-47d2-9135-17e882195db0 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:37.737653 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1410/2838] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:04:37.741951 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5c13d-ce54-4930-8ffc-bd09eb2d4366 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:37.751221 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5c13d-ce54-4930-8ffc-bd09eb2d4366 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:37.755880 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31e126-317f-4215-bdfe-9b6c4923a8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:37.756482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31e126-317f-4215-bdfe-9b6c4923a8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:37.756765 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31e126-317f-4215-bdfe-9b6c4923a8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:37.757110 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31e126-317f-4215-bdfe-9b6c4923a8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:37.757735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31e126-317f-4215-bdfe-9b6c4923a8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:37.759640 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31e126-317f-4215-bdfe-9b6c4923a8f6 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:37.788576 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1429/2839] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:04:37 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:04:37.792729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aee98c-520c-47d2-9135-17e882195db0 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:37.803494 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aee98c-520c-47d2-9135-17e882195db0 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:37.859820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517a67b-2708-42c8-a35d-fb90d8a57aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:37.860530 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517a67b-2708-42c8-a35d-fb90d8a57aae admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:37.860813 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517a67b-2708-42c8-a35d-fb90d8a57aae admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:37.861112 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517a67b-2708-42c8-a35d-fb90d8a57aae admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:37.861726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517a67b-2708-42c8-a35d-fb90d8a57aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:37.863666 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517a67b-2708-42c8-a35d-fb90d8a57aae admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:37.884094 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1411/2840] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:04:37 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:04:37.888168 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31e126-317f-4215-bdfe-9b6c4923a8f6 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:37.898319 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31e126-317f-4215-bdfe-9b6c4923a8f6 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:37.902881 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fab71-212a-493f-ab7a-bef44636e0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:37.903470 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fab71-212a-493f-ab7a-bef44636e0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:37.903752 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fab71-212a-493f-ab7a-bef44636e0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:37.904537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fab71-212a-493f-ab7a-bef44636e0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:37.905200 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fab71-212a-493f-ab7a-bef44636e0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:37.906778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fab71-212a-493f-ab7a-bef44636e0f2 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:37.916502 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1430/2841] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:04:37.921063 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517a67b-2708-42c8-a35d-fb90d8a57aae admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:37.931505 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517a67b-2708-42c8-a35d-fb90d8a57aae admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:37.936330 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb861d7-fb54-4ee4-a20a-435bded0ea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:37.936930 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb861d7-fb54-4ee4-a20a-435bded0ea9b admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:37.937243 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb861d7-fb54-4ee4-a20a-435bded0ea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:37.937533 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb861d7-fb54-4ee4-a20a-435bded0ea9b admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:37.938163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb861d7-fb54-4ee4-a20a-435bded0ea9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:37.939752 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb861d7-fb54-4ee4-a20a-435bded0ea9b admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:37.951261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1412/2842] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:04:37.955388 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fab71-212a-493f-ab7a-bef44636e0f2 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:37.965350 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fab71-212a-493f-ab7a-bef44636e0f2 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:37.970705 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af0791-950a-4c57-98a5-794d251aaf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:37.971345 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af0791-950a-4c57-98a5-794d251aaf23 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:37.971627 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af0791-950a-4c57-98a5-794d251aaf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:37.971901 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af0791-950a-4c57-98a5-794d251aaf23 admin admin] PATH_INFO: `/v3/projects/59775e8996144431a7a211fa36eb7697/users/8eca429017e746399cf0c01c13d0d837/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:37.987223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af0791-950a-4c57-98a5-794d251aaf23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59775e8996144431a7a211fa36eb7697, user_id=8eca429017e746399cf0c01c13d0d837, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:37.989933 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af0791-950a-4c57-98a5-794d251aaf23 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:38.003741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1431/2843] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:04:37 2022] PUT /identity/v3/projects/59775e8996144431a7a211fa36eb7697/users/8eca429017e746399cf0c01c13d0d837/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:38.067060 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc725d1-9b54-4787-b5cb-a0e5211d558b None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:38.067344 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc725d1-9b54-4787-b5cb-a0e5211d558b None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:38.067719 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc725d1-9b54-4787-b5cb-a0e5211d558b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:38.087628 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:38.098699 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-6dc725d1-9b54-4787-b5cb-a0e5211d558b None None] MFA Rules not processed for user `8eca429017e746399cf0c01c13d0d837`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:38.099915 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-6dc725d1-9b54-4787-b5cb-a0e5211d558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:38.165948 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1413/2844] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:04:38.170469 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af0791-950a-4c57-98a5-794d251aaf23 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:38.236905 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af0791-950a-4c57-98a5-794d251aaf23 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:38.241863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c203df7-1a1f-4146-9f64-2e351dcdaa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:38.242466 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c203df7-1a1f-4146-9f64-2e351dcdaa4a admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:38.242765 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c203df7-1a1f-4146-9f64-2e351dcdaa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:38.243023 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c203df7-1a1f-4146-9f64-2e351dcdaa4a admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:38.243716 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c203df7-1a1f-4146-9f64-2e351dcdaa4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:38.245970 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c203df7-1a1f-4146-9f64-2e351dcdaa4a admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:38.258795 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:38.278373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1432/2845] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:04:38 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:04:38.283196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc725d1-9b54-4787-b5cb-a0e5211d558b None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:38.294523 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc725d1-9b54-4787-b5cb-a0e5211d558b None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:38.352352 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927766e-3f09-4bd6-ba69-0326ed8b6f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:38.352962 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927766e-3f09-4bd6-ba69-0326ed8b6f15 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:38.353278 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927766e-3f09-4bd6-ba69-0326ed8b6f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:38.353558 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927766e-3f09-4bd6-ba69-0326ed8b6f15 admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:38.354183 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927766e-3f09-4bd6-ba69-0326ed8b6f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:38.356122 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927766e-3f09-4bd6-ba69-0326ed8b6f15 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:38.379956 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1414/2846] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:04:38 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 09:04:38.383863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c203df7-1a1f-4146-9f64-2e351dcdaa4a admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:38.395043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c203df7-1a1f-4146-9f64-2e351dcdaa4a admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:38.400426 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968319ef-da95-4e14-967e-520f4b7719a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:38.400971 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968319ef-da95-4e14-967e-520f4b7719a0 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:38.401288 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968319ef-da95-4e14-967e-520f4b7719a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:38.401570 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968319ef-da95-4e14-967e-520f4b7719a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:38.402392 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968319ef-da95-4e14-967e-520f4b7719a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:38.404548 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968319ef-da95-4e14-967e-520f4b7719a0 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:38.417519 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1433/2847] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:04:38.420199 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927766e-3f09-4bd6-ba69-0326ed8b6f15 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:38.430495 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927766e-3f09-4bd6-ba69-0326ed8b6f15 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:38.436711 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b42be4-d2fb-49ae-ad69-35a20ecf6c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:38.437376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b42be4-d2fb-49ae-ad69-35a20ecf6c97 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:38.437914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b42be4-d2fb-49ae-ad69-35a20ecf6c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:38.437914 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b42be4-d2fb-49ae-ad69-35a20ecf6c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:38.438595 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b42be4-d2fb-49ae-ad69-35a20ecf6c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:38.440727 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b42be4-d2fb-49ae-ad69-35a20ecf6c97 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:38.452362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1415/2848] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:04:38.456448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968319ef-da95-4e14-967e-520f4b7719a0 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:38.468932 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968319ef-da95-4e14-967e-520f4b7719a0 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:38.474111 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8b6e1-6d21-4210-8377-9e01b49f3ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:38.475032 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8b6e1-6d21-4210-8377-9e01b49f3ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:38.475629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8b6e1-6d21-4210-8377-9e01b49f3ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:38.475629 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8b6e1-6d21-4210-8377-9e01b49f3ad9 admin admin] PATH_INFO: `/v3/projects/9dc023dc982a4c2faac7bc0a673334f7/users/7adaf8aee5eb4b9d86a4b9c74bf751f9/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:38.494114 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8b6e1-6d21-4210-8377-9e01b49f3ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc023dc982a4c2faac7bc0a673334f7, user_id=7adaf8aee5eb4b9d86a4b9c74bf751f9, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:38.496959 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8b6e1-6d21-4210-8377-9e01b49f3ad9 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:38.512782 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1434/2849] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:04:38 2022] PUT /identity/v3/projects/9dc023dc982a4c2faac7bc0a673334f7/users/7adaf8aee5eb4b9d86a4b9c74bf751f9/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:38.522596 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d4d94-0452-4758-b2ba-023fff1097b5 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:38.522896 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d4d94-0452-4758-b2ba-023fff1097b5 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:38.523161 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d4d94-0452-4758-b2ba-023fff1097b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:38.560967 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-a07d4d94-0452-4758-b2ba-023fff1097b5 None None] MFA Rules not processed for user `7adaf8aee5eb4b9d86a4b9c74bf751f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:38.562247 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a07d4d94-0452-4758-b2ba-023fff1097b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:38.628984 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1416/2850] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:04:38.633504 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8b6e1-6d21-4210-8377-9e01b49f3ad9 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:38.696166 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8b6e1-6d21-4210-8377-9e01b49f3ad9 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:38.700976 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f499790-6933-4255-980e-3ad4f6c09152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:38.701741 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499790-6933-4255-980e-3ad4f6c09152 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:38.702085 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499790-6933-4255-980e-3ad4f6c09152 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:38.702434 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499790-6933-4255-980e-3ad4f6c09152 admin admin] PATH_INFO: `/v3/projects` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:38.703128 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f499790-6933-4255-980e-3ad4f6c09152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:38.705043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f499790-6933-4255-980e-3ad4f6c09152 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:38.731908 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1435/2851] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:04:38 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:04:38.737327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d4d94-0452-4758-b2ba-023fff1097b5 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:38.748209 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d4d94-0452-4758-b2ba-023fff1097b5 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:38.751909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:38.805649 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ef2a8-917c-40fe-90be-6f73a857789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:38.806257 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ef2a8-917c-40fe-90be-6f73a857789e admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:38.806537 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ef2a8-917c-40fe-90be-6f73a857789e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:38.806808 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ef2a8-917c-40fe-90be-6f73a857789e admin admin] PATH_INFO: `/v3/users` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:38.807430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ef2a8-917c-40fe-90be-6f73a857789e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:38.809369 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ef2a8-917c-40fe-90be-6f73a857789e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:38.831057 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1417/2852] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:04:38 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:04:38.835039 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f499790-6933-4255-980e-3ad4f6c09152 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:38.846373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f499790-6933-4255-980e-3ad4f6c09152 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:38.850928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e82168-1f3e-4e02-8bff-daeacbb6ff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:38.851526 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e82168-1f3e-4e02-8bff-daeacbb6ff25 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:38.851812 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e82168-1f3e-4e02-8bff-daeacbb6ff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:38.852090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e82168-1f3e-4e02-8bff-daeacbb6ff25 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:38.852732 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e82168-1f3e-4e02-8bff-daeacbb6ff25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:38.854435 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e82168-1f3e-4e02-8bff-daeacbb6ff25 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:38.864863 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1436/2853] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 09:04:38.868905 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ef2a8-917c-40fe-90be-6f73a857789e admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:38.878826 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ef2a8-917c-40fe-90be-6f73a857789e admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:38.883401 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d589513-3b90-4838-bccd-c6b2c5f87b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:38.884039 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d589513-3b90-4838-bccd-c6b2c5f87b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:38.884318 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d589513-3b90-4838-bccd-c6b2c5f87b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:38.884584 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d589513-3b90-4838-bccd-c6b2c5f87b9e admin admin] PATH_INFO: `/v3/projects/686bdc69019f4e88bf7c861bf9d73a44/users/bfc40ada3a1f40d9bf32ea3853e7c1b7/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:38.899760 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d589513-3b90-4838-bccd-c6b2c5f87b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=686bdc69019f4e88bf7c861bf9d73a44, user_id=bfc40ada3a1f40d9bf32ea3853e7c1b7, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:38.902509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d589513-3b90-4838-bccd-c6b2c5f87b9e admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:38.915982 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1418/2854] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:04:38 2022] PUT /identity/v3/projects/686bdc69019f4e88bf7c861bf9d73a44/users/bfc40ada3a1f40d9bf32ea3853e7c1b7/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:38.919936 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e82168-1f3e-4e02-8bff-daeacbb6ff25 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:38.929927 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e82168-1f3e-4e02-8bff-daeacbb6ff25 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:38.986235 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd090948-ddc8-46e1-a77e-079721fa37da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:38.986754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd090948-ddc8-46e1-a77e-079721fa37da admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:38.987068 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd090948-ddc8-46e1-a77e-079721fa37da admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:38.987347 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd090948-ddc8-46e1-a77e-079721fa37da admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:38.988016 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd090948-ddc8-46e1-a77e-079721fa37da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:38.989645 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd090948-ddc8-46e1-a77e-079721fa37da admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:38.999429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1437/2855] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:04:39.003798 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d589513-3b90-4838-bccd-c6b2c5f87b9e admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:39.014552 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d589513-3b90-4838-bccd-c6b2c5f87b9e admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:39.019147 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a5b0b-b574-4d23-b2e3-14aad5823234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:39.019798 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a5b0b-b574-4d23-b2e3-14aad5823234 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:39.020084 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a5b0b-b574-4d23-b2e3-14aad5823234 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:39.020366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a5b0b-b574-4d23-b2e3-14aad5823234 admin admin] PATH_INFO: `/v3/projects/686bdc69019f4e88bf7c861bf9d73a44/users/bfc40ada3a1f40d9bf32ea3853e7c1b7/roles/09f2910c22c641428a249f1ccd5c5180` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:39.022354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a5b0b-b574-4d23-b2e3-14aad5823234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=686bdc69019f4e88bf7c861bf9d73a44, user_id=bfc40ada3a1f40d9bf32ea3853e7c1b7, role_id=09f2910c22c641428a249f1ccd5c5180)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:39.025019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a5b0b-b574-4d23-b2e3-14aad5823234 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:39.035735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1419/2856] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:04:39 2022] PUT /identity/v3/projects/686bdc69019f4e88bf7c861bf9d73a44/users/bfc40ada3a1f40d9bf32ea3853e7c1b7/roles/09f2910c22c641428a249f1ccd5c5180 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:39.047494 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dffa9-ea9c-4398-b61d-7566c5f1e891 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:39.047811 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dffa9-ea9c-4398-b61d-7566c5f1e891 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:39.048090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dffa9-ea9c-4398-b61d-7566c5f1e891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:39.075147 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-1b2dffa9-ea9c-4398-b61d-7566c5f1e891 None None] MFA Rules not processed for user `bfc40ada3a1f40d9bf32ea3853e7c1b7`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:39.076871 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-1b2dffa9-ea9c-4398-b61d-7566c5f1e891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:39.089607 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:39.147537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1438/2857] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:04:39.159499 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a5b0b-b574-4d23-b2e3-14aad5823234 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:39.161237 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a45a5b0b-b574-4d23-b2e3-14aad5823234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:39.218795 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a5b0b-b574-4d23-b2e3-14aad5823234 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:39.222665 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013beebd-d0df-4ed4-a3d9-bbd3544ba1f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:39.223267 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013beebd-d0df-4ed4-a3d9-bbd3544ba1f2 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:39.223549 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013beebd-d0df-4ed4-a3d9-bbd3544ba1f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:39.223823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013beebd-d0df-4ed4-a3d9-bbd3544ba1f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:39.282252 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013beebd-d0df-4ed4-a3d9-bbd3544ba1f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:39.283597 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013beebd-d0df-4ed4-a3d9-bbd3544ba1f2 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:39.292442 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1420/2858] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:04:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:04:40.791555 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dffa9-ea9c-4398-b61d-7566c5f1e891 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:40.806898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dffa9-ea9c-4398-b61d-7566c5f1e891 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:40.811171 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef18f5-7ef5-45d0-86db-a916eec3dc40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:40.811950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef18f5-7ef5-45d0-86db-a916eec3dc40 service cinder] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:40.812380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef18f5-7ef5-45d0-86db-a916eec3dc40 service cinder] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:40.812796 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef18f5-7ef5-45d0-86db-a916eec3dc40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:40.882210 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef18f5-7ef5-45d0-86db-a916eec3dc40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:40.883190 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef18f5-7ef5-45d0-86db-a916eec3dc40 service cinder] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:40.895241 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1439/2859] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:04:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:04:41.108153 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013beebd-d0df-4ed4-a3d9-bbd3544ba1f2 service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:41.111236 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-013beebd-d0df-4ed4-a3d9-bbd3544ba1f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:41.130939 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:41.190067 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013beebd-d0df-4ed4-a3d9-bbd3544ba1f2 service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:41.198625 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6401a-327d-4466-a09f-ae2bc7d194d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:41.199434 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6401a-327d-4466-a09f-ae2bc7d194d3 service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:41.199619 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6401a-327d-4466-a09f-ae2bc7d194d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:41.199854 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6401a-327d-4466-a09f-ae2bc7d194d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:41.201816 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-13f6401a-327d-4466-a09f-ae2bc7d194d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:41.213673 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6401a-327d-4466-a09f-ae2bc7d194d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:41.215682 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6401a-327d-4466-a09f-ae2bc7d194d3 service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:41.226514 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1421/2860] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:04:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:04:41.314243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef18f5-7ef5-45d0-86db-a916eec3dc40 service cinder] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:41.326478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef18f5-7ef5-45d0-86db-a916eec3dc40 service cinder] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:41.332203 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca76b76-2a06-494e-8282-762305b8e070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:41.333678 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca76b76-2a06-494e-8282-762305b8e070 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:41.333964 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca76b76-2a06-494e-8282-762305b8e070 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:41.334238 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca76b76-2a06-494e-8282-762305b8e070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:41.336429 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-5ca76b76-2a06-494e-8282-762305b8e070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:41.435198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca76b76-2a06-494e-8282-762305b8e070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:41.440754 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca76b76-2a06-494e-8282-762305b8e070 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:41.449510 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1440/2861] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:04:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 09:04:41.566375 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6401a-327d-4466-a09f-ae2bc7d194d3 service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:41.576177 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6401a-327d-4466-a09f-ae2bc7d194d3 service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:41.579912 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b86781-1ae3-4335-95d2-a408636c614a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:41.580513 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b86781-1ae3-4335-95d2-a408636c614a service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:41.580796 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b86781-1ae3-4335-95d2-a408636c614a service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:41.581095 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b86781-1ae3-4335-95d2-a408636c614a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:41.594715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b86781-1ae3-4335-95d2-a408636c614a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:41.596459 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b86781-1ae3-4335-95d2-a408636c614a service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:41.607931 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1422/2862] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:04:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:04:45.539972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca76b76-2a06-494e-8282-762305b8e070 service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:45.581972 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=100 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:45.606405 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca76b76-2a06-494e-8282-762305b8e070 service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:45.611546 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a441d-0043-44c4-9bfd-16f555d50f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:45.612182 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a441d-0043-44c4-9bfd-16f555d50f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:45.612466 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a441d-0043-44c4-9bfd-16f555d50f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:45.612743 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a441d-0043-44c4-9bfd-16f555d50f2f admin admin] PATH_INFO: `/v3/users/8eca429017e746399cf0c01c13d0d837` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:45.613903 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a441d-0043-44c4-9bfd-16f555d50f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eca429017e746399cf0c01c13d0d837)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:45.615827 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a441d-0043-44c4-9bfd-16f555d50f2f admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:45.675568 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be6a441d-0043-44c4-9bfd-16f555d50f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eca429017e746399cf0c01c13d0d837'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:45.683711 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be6a441d-0043-44c4-9bfd-16f555d50f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eca429017e746399cf0c01c13d0d837'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:45.684449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be6a441d-0043-44c4-9bfd-16f555d50f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eca429017e746399cf0c01c13d0d837'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:45.696946 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be6a441d-0043-44c4-9bfd-16f555d50f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eca429017e746399cf0c01c13d0d837'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:45.717572 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-be6a441d-0043-44c4-9bfd-16f555d50f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eca429017e746399cf0c01c13d0d837'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:45.725178 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1441/2863] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:04:45 2022] DELETE /identity/v3/users/8eca429017e746399cf0c01c13d0d837 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:45.731186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632aa57-d377-465c-85ea-54470342a73c None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:45.731706 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632aa57-d377-465c-85ea-54470342a73c None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:45.731836 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632aa57-d377-465c-85ea-54470342a73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:45.752919 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-a632aa57-d377-465c-85ea-54470342a73c None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:45.754163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a632aa57-d377-465c-85ea-54470342a73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:45.814438 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1423/2864] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:04:45.824276 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a441d-0043-44c4-9bfd-16f555d50f2f admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:45.825699 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-be6a441d-0043-44c4-9bfd-16f555d50f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:45.889615 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a441d-0043-44c4-9bfd-16f555d50f2f admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:45.893466 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef2283-d408-44c7-93b3-2aeac81f073f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:45.894077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef2283-d408-44c7-93b3-2aeac81f073f service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:45.894358 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef2283-d408-44c7-93b3-2aeac81f073f service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:45.894630 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef2283-d408-44c7-93b3-2aeac81f073f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:45.905926 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef2283-d408-44c7-93b3-2aeac81f073f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:45.907372 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef2283-d408-44c7-93b3-2aeac81f073f service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:45.918558 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1442/2865] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:04:46.239206 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632aa57-d377-465c-85ea-54470342a73c None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:46.240687 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-a632aa57-d377-465c-85ea-54470342a73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:46.253265 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632aa57-d377-465c-85ea-54470342a73c None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:46.259080 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f782ec6-305e-445b-94e1-27f751b93da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:46.260047 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f782ec6-305e-445b-94e1-27f751b93da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:46.260423 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f782ec6-305e-445b-94e1-27f751b93da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:46.260792 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f782ec6-305e-445b-94e1-27f751b93da0 admin admin] PATH_INFO: `/v3/projects/59775e8996144431a7a211fa36eb7697` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:46.262520 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f782ec6-305e-445b-94e1-27f751b93da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59775e8996144431a7a211fa36eb7697)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:46.265583 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f782ec6-305e-445b-94e1-27f751b93da0 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:46.313151 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2f782ec6-305e-445b-94e1-27f751b93da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59775e8996144431a7a211fa36eb7697', 'request_id': 'req-2f782ec6-305e-445b-94e1-27f751b93da0'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:46.319271 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2f782ec6-305e-445b-94e1-27f751b93da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59775e8996144431a7a211fa36eb7697', 'request_id': 'req-2f782ec6-305e-445b-94e1-27f751b93da0'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:46.326007 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2f782ec6-305e-445b-94e1-27f751b93da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59775e8996144431a7a211fa36eb7697', 'request_id': 'req-2f782ec6-305e-445b-94e1-27f751b93da0'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:46.337262 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2f782ec6-305e-445b-94e1-27f751b93da0 admin admin] The token cache is being invalidate because project 59775e8996144431a7a211fa36eb7697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:04:46.337642 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2f782ec6-305e-445b-94e1-27f751b93da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:46.338498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-2f782ec6-305e-445b-94e1-27f751b93da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:46.340076 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1424/2866] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:04:46 2022] DELETE /identity/v3/projects/59775e8996144431a7a211fa36eb7697 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:46.345229 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef2283-d408-44c7-93b3-2aeac81f073f service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:46.355035 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef2283-d408-44c7-93b3-2aeac81f073f service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:46.405912 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:46.413057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41abfcf-4bc5-477b-a6da-f8b1370acdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:46.413791 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41abfcf-4bc5-477b-a6da-f8b1370acdbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:46.414266 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41abfcf-4bc5-477b-a6da-f8b1370acdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:46.414715 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41abfcf-4bc5-477b-a6da-f8b1370acdbd admin admin] PATH_INFO: `/v3/users/7adaf8aee5eb4b9d86a4b9c74bf751f9` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:46.415950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41abfcf-4bc5-477b-a6da-f8b1370acdbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7adaf8aee5eb4b9d86a4b9c74bf751f9)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:46.417967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41abfcf-4bc5-477b-a6da-f8b1370acdbd admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:46.464223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d41abfcf-4bc5-477b-a6da-f8b1370acdbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7adaf8aee5eb4b9d86a4b9c74bf751f9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:46.472024 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d41abfcf-4bc5-477b-a6da-f8b1370acdbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7adaf8aee5eb4b9d86a4b9c74bf751f9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:46.472721 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d41abfcf-4bc5-477b-a6da-f8b1370acdbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7adaf8aee5eb4b9d86a4b9c74bf751f9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:46.479704 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d41abfcf-4bc5-477b-a6da-f8b1370acdbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7adaf8aee5eb4b9d86a4b9c74bf751f9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:46.492212 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d41abfcf-4bc5-477b-a6da-f8b1370acdbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7adaf8aee5eb4b9d86a4b9c74bf751f9'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:46.498889 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1443/2867] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:04:46 2022] DELETE /identity/v3/users/7adaf8aee5eb4b9d86a4b9c74bf751f9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:46.770534 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f782ec6-305e-445b-94e1-27f751b93da0 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:46.772282 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-2f782ec6-305e-445b-94e1-27f751b93da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:46.788916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f782ec6-305e-445b-94e1-27f751b93da0 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:46.815490 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:46.849822 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b58ab-4003-4361-88bb-966a42c4573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:46.850455 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b58ab-4003-4361-88bb-966a42c4573f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:46.850735 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b58ab-4003-4361-88bb-966a42c4573f admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:46.851009 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b58ab-4003-4361-88bb-966a42c4573f admin admin] PATH_INFO: `/v3/projects/9dc023dc982a4c2faac7bc0a673334f7` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:46.852150 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b58ab-4003-4361-88bb-966a42c4573f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc023dc982a4c2faac7bc0a673334f7)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:46.854162 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b58ab-4003-4361-88bb-966a42c4573f admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:46.902290 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-135b58ab-4003-4361-88bb-966a42c4573f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc023dc982a4c2faac7bc0a673334f7', 'request_id': 'req-135b58ab-4003-4361-88bb-966a42c4573f'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:46.909105 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-135b58ab-4003-4361-88bb-966a42c4573f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc023dc982a4c2faac7bc0a673334f7', 'request_id': 'req-135b58ab-4003-4361-88bb-966a42c4573f'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:46.916585 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-135b58ab-4003-4361-88bb-966a42c4573f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc023dc982a4c2faac7bc0a673334f7', 'request_id': 'req-135b58ab-4003-4361-88bb-966a42c4573f'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:46.927713 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-135b58ab-4003-4361-88bb-966a42c4573f admin admin] The token cache is being invalidate because project 9dc023dc982a4c2faac7bc0a673334f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:04:46.928004 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-135b58ab-4003-4361-88bb-966a42c4573f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:46.928643 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-135b58ab-4003-4361-88bb-966a42c4573f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:46.930152 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1425/2868] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:04:46 2022] DELETE /identity/v3/projects/9dc023dc982a4c2faac7bc0a673334f7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:46.934315 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41abfcf-4bc5-477b-a6da-f8b1370acdbd admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:46.935752 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d41abfcf-4bc5-477b-a6da-f8b1370acdbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:46.948605 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41abfcf-4bc5-477b-a6da-f8b1370acdbd admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:47.007022 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e52f4e-467b-44bf-8e9c-707593828852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:47.007666 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e52f4e-467b-44bf-8e9c-707593828852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:47.007952 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e52f4e-467b-44bf-8e9c-707593828852 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:47.008232 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e52f4e-467b-44bf-8e9c-707593828852 admin admin] PATH_INFO: `/v3/users/bfc40ada3a1f40d9bf32ea3853e7c1b7` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:47.009441 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e52f4e-467b-44bf-8e9c-707593828852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc40ada3a1f40d9bf32ea3853e7c1b7)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:47.011361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e52f4e-467b-44bf-8e9c-707593828852 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:47.059528 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f0e52f4e-467b-44bf-8e9c-707593828852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc40ada3a1f40d9bf32ea3853e7c1b7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:47.067545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f0e52f4e-467b-44bf-8e9c-707593828852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc40ada3a1f40d9bf32ea3853e7c1b7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:47.068230 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f0e52f4e-467b-44bf-8e9c-707593828852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc40ada3a1f40d9bf32ea3853e7c1b7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:47.077220 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f0e52f4e-467b-44bf-8e9c-707593828852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc40ada3a1f40d9bf32ea3853e7c1b7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:47.089212 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:47.090649 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-f0e52f4e-467b-44bf-8e9c-707593828852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc40ada3a1f40d9bf32ea3853e7c1b7'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:47.099623 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1444/2869] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:04:46 2022] DELETE /identity/v3/users/bfc40ada3a1f40d9bf32ea3853e7c1b7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:47.414945 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b58ab-4003-4361-88bb-966a42c4573f admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:47.416462 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-135b58ab-4003-4361-88bb-966a42c4573f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:47.432943 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b58ab-4003-4361-88bb-966a42c4573f admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:47.494631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2fd00-c3c7-4bb8-998d-7434e6533bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:47.495271 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2fd00-c3c7-4bb8-998d-7434e6533bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:47.495559 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2fd00-c3c7-4bb8-998d-7434e6533bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:47.495837 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2fd00-c3c7-4bb8-998d-7434e6533bf7 admin admin] PATH_INFO: `/v3/projects/686bdc69019f4e88bf7c861bf9d73a44` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:47.496969 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2fd00-c3c7-4bb8-998d-7434e6533bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=686bdc69019f4e88bf7c861bf9d73a44)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:47.499437 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2fd00-c3c7-4bb8-998d-7434e6533bf7 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:47.544532 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-85b2fd00-c3c7-4bb8-998d-7434e6533bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '686bdc69019f4e88bf7c861bf9d73a44', 'request_id': 'req-85b2fd00-c3c7-4bb8-998d-7434e6533bf7'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:47.550871 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-85b2fd00-c3c7-4bb8-998d-7434e6533bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '686bdc69019f4e88bf7c861bf9d73a44', 'request_id': 'req-85b2fd00-c3c7-4bb8-998d-7434e6533bf7'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:47.554958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:47.559702 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-85b2fd00-c3c7-4bb8-998d-7434e6533bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '686bdc69019f4e88bf7c861bf9d73a44', 'request_id': 'req-85b2fd00-c3c7-4bb8-998d-7434e6533bf7'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:47.571577 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-85b2fd00-c3c7-4bb8-998d-7434e6533bf7 admin admin] The token cache is being invalidate because project 686bdc69019f4e88bf7c861bf9d73a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:04:47.572632 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-85b2fd00-c3c7-4bb8-998d-7434e6533bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:47.574104 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-85b2fd00-c3c7-4bb8-998d-7434e6533bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:04:47.579820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1426/2870] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:04:47 2022] DELETE /identity/v3/projects/686bdc69019f4e88bf7c861bf9d73a44 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:47.581473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d691370-fc3c-453e-8abf-ab60f4bacbf8 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:47.581765 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d691370-fc3c-453e-8abf-ab60f4bacbf8 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:47.582043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d691370-fc3c-453e-8abf-ab60f4bacbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:47.602390 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-0d691370-fc3c-453e-8abf-ab60f4bacbf8 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:47.603613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-0d691370-fc3c-453e-8abf-ab60f4bacbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:47.665279 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1445/2871] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:04:47.673327 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab724205-3072-4ba9-9ae2-d440434343f6 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:47.673618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab724205-3072-4ba9-9ae2-d440434343f6 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:47.673889 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab724205-3072-4ba9-9ae2-d440434343f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:47.695610 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-ab724205-3072-4ba9-9ae2-d440434343f6 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:47.696842 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-ab724205-3072-4ba9-9ae2-d440434343f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:47.707294 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1427/2872] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:04:47.711596 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d691370-fc3c-453e-8abf-ab60f4bacbf8 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:47.721772 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d691370-fc3c-453e-8abf-ab60f4bacbf8 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:47.727478 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce7105-6b7e-402d-a900-5fbd2263ab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:47.728090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce7105-6b7e-402d-a900-5fbd2263ab50 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:47.728373 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce7105-6b7e-402d-a900-5fbd2263ab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:47.728646 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce7105-6b7e-402d-a900-5fbd2263ab50 admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:47.729378 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce7105-6b7e-402d-a900-5fbd2263ab50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:04:47.729639 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce7105-6b7e-402d-a900-5fbd2263ab50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:47.731233 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce7105-6b7e-402d-a900-5fbd2263ab50 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:47.743895 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1446/2873] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:04:47.750501 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab724205-3072-4ba9-9ae2-d440434343f6 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:47.760224 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab724205-3072-4ba9-9ae2-d440434343f6 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:47.765726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd82842-9b83-4751-981c-ed949279eb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:47.766341 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd82842-9b83-4751-981c-ed949279eb84 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:47.766988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd82842-9b83-4751-981c-ed949279eb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:47.766988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd82842-9b83-4751-981c-ed949279eb84 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:47.767527 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd82842-9b83-4751-981c-ed949279eb84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:47.769469 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd82842-9b83-4751-981c-ed949279eb84 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:47.799191 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1428/2874] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:04:47 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:04:47.803103 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce7105-6b7e-402d-a900-5fbd2263ab50 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:47.814161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce7105-6b7e-402d-a900-5fbd2263ab50 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:47.875858 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581871f-8f37-441a-bb1c-a19979b5b8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:47.876532 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581871f-8f37-441a-bb1c-a19979b5b8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:47.876825 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581871f-8f37-441a-bb1c-a19979b5b8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:47.877148 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581871f-8f37-441a-bb1c-a19979b5b8d9 admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:47.877790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581871f-8f37-441a-bb1c-a19979b5b8d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:47.879790 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581871f-8f37-441a-bb1c-a19979b5b8d9 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:47.904440 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1447/2875] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:04:47 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:04:47.908417 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd82842-9b83-4751-981c-ed949279eb84 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:47.918789 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd82842-9b83-4751-981c-ed949279eb84 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:47.923895 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e4926-6bec-4d66-96fb-c4fedab4c140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:47.924637 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e4926-6bec-4d66-96fb-c4fedab4c140 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:47.924766 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e4926-6bec-4d66-96fb-c4fedab4c140 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:47.925054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e4926-6bec-4d66-96fb-c4fedab4c140 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:47.925702 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e4926-6bec-4d66-96fb-c4fedab4c140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:47.927447 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e4926-6bec-4d66-96fb-c4fedab4c140 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:47.938594 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1429/2876] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:04:47.942410 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581871f-8f37-441a-bb1c-a19979b5b8d9 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:47.952941 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581871f-8f37-441a-bb1c-a19979b5b8d9 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:47.957661 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff3793-f928-4a55-9596-055af4376853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:47.958265 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff3793-f928-4a55-9596-055af4376853 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:47.958547 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff3793-f928-4a55-9596-055af4376853 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:47.958823 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff3793-f928-4a55-9596-055af4376853 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:47.959465 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff3793-f928-4a55-9596-055af4376853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:47.961123 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff3793-f928-4a55-9596-055af4376853 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:47.972148 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1448/2877] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:04:47.976102 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e4926-6bec-4d66-96fb-c4fedab4c140 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:47.986567 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e4926-6bec-4d66-96fb-c4fedab4c140 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:47.991231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311a904-8969-46f8-8f70-66fb4c5ec043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:47.991881 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311a904-8969-46f8-8f70-66fb4c5ec043 admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:47.992163 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311a904-8969-46f8-8f70-66fb4c5ec043 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:47.992439 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311a904-8969-46f8-8f70-66fb4c5ec043 admin admin] PATH_INFO: `/v3/projects/ffa3ebe58a404df7b809e2e573dae21b/users/d2b1526a80c64aa99030b533d470b728/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:48.007747 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311a904-8969-46f8-8f70-66fb4c5ec043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa3ebe58a404df7b809e2e573dae21b, user_id=d2b1526a80c64aa99030b533d470b728, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:48.010453 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311a904-8969-46f8-8f70-66fb4c5ec043 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:48.024783 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1430/2878] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:04:47 2022] PUT /identity/v3/projects/ffa3ebe58a404df7b809e2e573dae21b/users/d2b1526a80c64aa99030b533d470b728/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:04:48.035191 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6a833-accd-457d-874d-432b8fb0a4d7 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:48.035490 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6a833-accd-457d-874d-432b8fb0a4d7 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:48.035764 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6a833-accd-457d-874d-432b8fb0a4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:48.064898 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-26d6a833-accd-457d-874d-432b8fb0a4d7 None None] MFA Rules not processed for user `d2b1526a80c64aa99030b533d470b728`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:48.066172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-26d6a833-accd-457d-874d-432b8fb0a4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:48.116668 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:48.135413 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1449/2879] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 09:04:48.147079 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311a904-8969-46f8-8f70-66fb4c5ec043 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:04:48.149207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-f311a904-8969-46f8-8f70-66fb4c5ec043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:48.205604 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311a904-8969-46f8-8f70-66fb4c5ec043 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:04:48.209334 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4192e7f-4ac3-4a74-bcf3-dec8ad99bc12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:04:48.209997 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4192e7f-4ac3-4a74-bcf3-dec8ad99bc12 service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:48.210284 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4192e7f-4ac3-4a74-bcf3-dec8ad99bc12 service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:48.210561 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4192e7f-4ac3-4a74-bcf3-dec8ad99bc12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:48.219370 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4192e7f-4ac3-4a74-bcf3-dec8ad99bc12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:04:48.221087 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4192e7f-4ac3-4a74-bcf3-dec8ad99bc12 service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:04:48.229933 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1431/2880] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:04:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:04:49.592482 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868a57e-9511-4423-9cd9-8145fd7fe909 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:04:49.593130 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868a57e-9511-4423-9cd9-8145fd7fe909 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:04:49.593130 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868a57e-9511-4423-9cd9-8145fd7fe909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:04:49.612481 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-6868a57e-9511-4423-9cd9-8145fd7fe909 None None] MFA Rules not processed for user `d2b1526a80c64aa99030b533d470b728`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:04:49.613722 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-6868a57e-9511-4423-9cd9-8145fd7fe909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:04:49.620619 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1450/2881] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:04:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:04:58.225960 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=57,keystone:DELETE=2,keystone:INSERT=2 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:59.606822 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=7 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:05:05.422982 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4192e7f-4ac3-4a74-bcf3-dec8ad99bc12 service cinder] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:05.424450 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-d4192e7f-4ac3-4a74-bcf3-dec8ad99bc12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:05.502646 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4192e7f-4ac3-4a74-bcf3-dec8ad99bc12 service cinder] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:05.509532 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a533a94-0bbe-4bdd-9192-de4ec9a25185 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95abbd88e549427abbf5699efed0451a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:05.510437 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a533a94-0bbe-4bdd-9192-de4ec9a25185 service placement] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:05.510729 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a533a94-0bbe-4bdd-9192-de4ec9a25185 service placement] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:05.511019 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a533a94-0bbe-4bdd-9192-de4ec9a25185 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:05.512909 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7a533a94-0bbe-4bdd-9192-de4ec9a25185 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:05.525531 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a533a94-0bbe-4bdd-9192-de4ec9a25185 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:05.527116 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a533a94-0bbe-4bdd-9192-de4ec9a25185 service placement] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:05.539051 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1432/2882] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:05:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:05:06.845157 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e7df2-b92a-48a3-97e3-8fb0141b3092 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:06.845638 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e7df2-b92a-48a3-97e3-8fb0141b3092 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:06.845753 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e7df2-b92a-48a3-97e3-8fb0141b3092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:06.865317 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-fd4e7df2-b92a-48a3-97e3-8fb0141b3092 None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:05:06.866513 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-fd4e7df2-b92a-48a3-97e3-8fb0141b3092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:06.922008 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1451/2883] 10.222.0.76 () {58 vars in 1009 bytes} [Fri Aug 26 09:05:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:05:06.968090 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a533a94-0bbe-4bdd-9192-de4ec9a25185 service placement] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:06.970301 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-7a533a94-0bbe-4bdd-9192-de4ec9a25185 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:07.040280 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a533a94-0bbe-4bdd-9192-de4ec9a25185 service placement] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:07.045916 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05235b-8642-456b-b57c-193423cd333c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:07.046648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05235b-8642-456b-b57c-193423cd333c service swift] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:07.046939 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05235b-8642-456b-b57c-193423cd333c service swift] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:07.047217 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05235b-8642-456b-b57c-193423cd333c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:07.055319 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05235b-8642-456b-b57c-193423cd333c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:07.056958 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05235b-8642-456b-b57c-193423cd333c service swift] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:07.065207 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1433/2884] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 09:05:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 09:05:07.616569 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e8c78-35d4-4a46-9444-348df0c6788f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:07.616859 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e8c78-35d4-4a46-9444-348df0c6788f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:07.617172 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e8c78-35d4-4a46-9444-348df0c6788f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:07.636607 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-825e8c78-35d4-4a46-9444-348df0c6788f None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:05:07.638400 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-825e8c78-35d4-4a46-9444-348df0c6788f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:07.645928 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1452/2885] 10.222.0.76 () {58 vars in 967 bytes} [Fri Aug 26 09:05:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:05:07.660328 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05235b-8642-456b-b57c-193423cd333c service swift] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:07.671231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05235b-8642-456b-b57c-193423cd333c service swift] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:07.676672 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a9850-5aef-4bc0-9451-1a7ee39e184f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:07.677313 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a9850-5aef-4bc0-9451-1a7ee39e184f service swift] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:07.677590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a9850-5aef-4bc0-9451-1a7ee39e184f service swift] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:07.677862 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a9850-5aef-4bc0-9451-1a7ee39e184f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:07.687212 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a9850-5aef-4bc0-9451-1a7ee39e184f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:07.688801 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a9850-5aef-4bc0-9451-1a7ee39e184f service swift] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:07.699005 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1434/2886] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 09:05:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 09:05:07.927002 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c305ae-cadf-4495-beb3-62e0a592ad8f None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:07.927491 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c305ae-cadf-4495-beb3-62e0a592ad8f None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:07.927592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c305ae-cadf-4495-beb3-62e0a592ad8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:07.948101 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-17c305ae-cadf-4495-beb3-62e0a592ad8f None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:05:07.949380 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-17c305ae-cadf-4495-beb3-62e0a592ad8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:07.957075 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1453/2887] 10.222.0.76 () {58 vars in 1009 bytes} [Fri Aug 26 09:05:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:05:07.969953 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a9850-5aef-4bc0-9451-1a7ee39e184f service swift] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:07.980668 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a9850-5aef-4bc0-9451-1a7ee39e184f service swift] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:07.985643 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33761b-3bd0-425b-adac-7ae5a2c6b393 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:07.986231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33761b-3bd0-425b-adac-7ae5a2c6b393 service swift] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:07.986510 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33761b-3bd0-425b-adac-7ae5a2c6b393 service swift] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:07.986806 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33761b-3bd0-425b-adac-7ae5a2c6b393 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:07.994749 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33761b-3bd0-425b-adac-7ae5a2c6b393 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:07.996413 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33761b-3bd0-425b-adac-7ae5a2c6b393 service swift] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:08.004771 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1435/2888] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 09:05:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 09:05:08.322462 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed11c4-6944-4774-bf71-022566baf78d None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:08.322797 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed11c4-6944-4774-bf71-022566baf78d None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:08.323077 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed11c4-6944-4774-bf71-022566baf78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:08.347978 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-37ed11c4-6944-4774-bf71-022566baf78d None None] MFA Rules not processed for user `c50a6fa776a849cfbb0173ce24616906`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:05:08.349263 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-37ed11c4-6944-4774-bf71-022566baf78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:08.357359 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1454/2889] 10.222.0.76 () {58 vars in 967 bytes} [Fri Aug 26 09:05:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:05:08.369418 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33761b-3bd0-425b-adac-7ae5a2c6b393 service swift] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:08.381094 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33761b-3bd0-425b-adac-7ae5a2c6b393 service swift] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:08.386186 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2912c7-0311-4510-8bda-ce3c73f8a809 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f544d78f417844f68f3bd37863d24885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:08.386783 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2912c7-0311-4510-8bda-ce3c73f8a809 service swift] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:08.387061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2912c7-0311-4510-8bda-ce3c73f8a809 service swift] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:08.387332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2912c7-0311-4510-8bda-ce3c73f8a809 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:08.395314 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2912c7-0311-4510-8bda-ce3c73f8a809 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:08.396865 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2912c7-0311-4510-8bda-ce3c73f8a809 service swift] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:08.405296 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1436/2890] 10.222.0.76 () {60 vars in 1384 bytes} [Fri Aug 26 09:05:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 09:05:10.488290 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed11c4-6944-4774-bf71-022566baf78d None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:10.550807 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed11c4-6944-4774-bf71-022566baf78d None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:10.555322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d95812-5a2e-4ccb-af07-75c2277bc35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:10.555942 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d95812-5a2e-4ccb-af07-75c2277bc35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:10.556223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d95812-5a2e-4ccb-af07-75c2277bc35d admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:10.556528 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d95812-5a2e-4ccb-af07-75c2277bc35d admin admin] PATH_INFO: `/v3/users/d2b1526a80c64aa99030b533d470b728` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:10.557682 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d95812-5a2e-4ccb-af07-75c2277bc35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b1526a80c64aa99030b533d470b728)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:10.559571 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d95812-5a2e-4ccb-af07-75c2277bc35d admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:10.609264 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-06d95812-5a2e-4ccb-af07-75c2277bc35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b1526a80c64aa99030b533d470b728'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:10.616585 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-06d95812-5a2e-4ccb-af07-75c2277bc35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b1526a80c64aa99030b533d470b728'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:10.617257 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-06d95812-5a2e-4ccb-af07-75c2277bc35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b1526a80c64aa99030b533d470b728'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:10.624231 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-06d95812-5a2e-4ccb-af07-75c2277bc35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b1526a80c64aa99030b533d470b728'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:10.636040 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-06d95812-5a2e-4ccb-af07-75c2277bc35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b1526a80c64aa99030b533d470b728'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:10.642383 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1455/2891] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:05:10 2022] DELETE /identity/v3/users/d2b1526a80c64aa99030b533d470b728 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:05:10.646823 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310eed9-66b2-4c65-98dd-805e3c0f2966 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:10.647307 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310eed9-66b2-4c65-98dd-805e3c0f2966 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:10.647437 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310eed9-66b2-4c65-98dd-805e3c0f2966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:10.666382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-3310eed9-66b2-4c65-98dd-805e3c0f2966 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:05:10.667592 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3310eed9-66b2-4c65-98dd-805e3c0f2966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:10.701140 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=100 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:05:10.726947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1437/2892] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:05:10.736498 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d95812-5a2e-4ccb-af07-75c2277bc35d admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:10.737989 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-06d95812-5a2e-4ccb-af07-75c2277bc35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:10.744474 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:05:10.797205 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d95812-5a2e-4ccb-af07-75c2277bc35d admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:10.800832 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89405009-78f9-4b97-ab39-4372863edc94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:10.801473 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89405009-78f9-4b97-ab39-4372863edc94 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:10.801758 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89405009-78f9-4b97-ab39-4372863edc94 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:10.802036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89405009-78f9-4b97-ab39-4372863edc94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:10.811723 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89405009-78f9-4b97-ab39-4372863edc94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:10.813198 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89405009-78f9-4b97-ab39-4372863edc94 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:10.823243 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1456/2893] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:05:10.991201 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310eed9-66b2-4c65-98dd-805e3c0f2966 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:10.992638 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-3310eed9-66b2-4c65-98dd-805e3c0f2966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:11.005070 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310eed9-66b2-4c65-98dd-805e3c0f2966 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:11.010430 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a792bb-a109-480b-a9bd-cb4d0fe91351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:11.011070 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a792bb-a109-480b-a9bd-cb4d0fe91351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:11.011354 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a792bb-a109-480b-a9bd-cb4d0fe91351 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:11.011631 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a792bb-a109-480b-a9bd-cb4d0fe91351 admin admin] PATH_INFO: `/v3/projects/ffa3ebe58a404df7b809e2e573dae21b` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:11.012931 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a792bb-a109-480b-a9bd-cb4d0fe91351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa3ebe58a404df7b809e2e573dae21b)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:11.016324 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a792bb-a109-480b-a9bd-cb4d0fe91351 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:11.064872 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-80a792bb-a109-480b-a9bd-cb4d0fe91351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa3ebe58a404df7b809e2e573dae21b', 'request_id': 'req-80a792bb-a109-480b-a9bd-cb4d0fe91351'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:11.071498 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-80a792bb-a109-480b-a9bd-cb4d0fe91351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa3ebe58a404df7b809e2e573dae21b', 'request_id': 'req-80a792bb-a109-480b-a9bd-cb4d0fe91351'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:11.079040 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-80a792bb-a109-480b-a9bd-cb4d0fe91351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa3ebe58a404df7b809e2e573dae21b', 'request_id': 'req-80a792bb-a109-480b-a9bd-cb4d0fe91351'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:11.089461 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-80a792bb-a109-480b-a9bd-cb4d0fe91351 admin admin] The token cache is being invalidate because project ffa3ebe58a404df7b809e2e573dae21b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:05:11.089755 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-80a792bb-a109-480b-a9bd-cb4d0fe91351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:11.090386 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-80a792bb-a109-480b-a9bd-cb4d0fe91351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:11.091858 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1438/2894] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:05:10 2022] DELETE /identity/v3/projects/ffa3ebe58a404df7b809e2e573dae21b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:05:11.097069 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465b812-28cd-43f0-9343-304b00854357 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:11.097433 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465b812-28cd-43f0-9343-304b00854357 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:11.097785 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465b812-28cd-43f0-9343-304b00854357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:11.121774 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-c465b812-28cd-43f0-9343-304b00854357 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:05:11.124120 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-c465b812-28cd-43f0-9343-304b00854357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:11.193100 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1457/2895] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:05:11.201931 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383740c6-6aa0-4181-ae31-f248b57aceb0 None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:11.202486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383740c6-6aa0-4181-ae31-f248b57aceb0 None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:11.202770 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383740c6-6aa0-4181-ae31-f248b57aceb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:11.222818 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-383740c6-6aa0-4181-ae31-f248b57aceb0 None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:05:11.224034 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-383740c6-6aa0-4181-ae31-f248b57aceb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:11.232382 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1439/2896] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:05:11.236704 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465b812-28cd-43f0-9343-304b00854357 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:11.246537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465b812-28cd-43f0-9343-304b00854357 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:11.251850 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3385ea-4513-4242-8113-a098414ae51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:11.252449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3385ea-4513-4242-8113-a098414ae51c admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:11.252735 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3385ea-4513-4242-8113-a098414ae51c admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:11.253043 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3385ea-4513-4242-8113-a098414ae51c admin admin] PATH_INFO: `/v3/domains` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:11.253696 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3385ea-4513-4242-8113-a098414ae51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 09:05:11.254003 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3385ea-4513-4242-8113-a098414ae51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:11.255616 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3385ea-4513-4242-8113-a098414ae51c admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:11.267078 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1458/2897] 10.222.0.76 () {58 vars in 1153 bytes} [Fri Aug 26 09:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 09:05:11.271305 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383740c6-6aa0-4181-ae31-f248b57aceb0 None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:11.280726 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383740c6-6aa0-4181-ae31-f248b57aceb0 None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:11.285461 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c3763-a7e3-48fb-b7ee-d3424a94ebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:11.286061 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c3763-a7e3-48fb-b7ee-d3424a94ebb0 admin admin] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:11.286342 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c3763-a7e3-48fb-b7ee-d3424a94ebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:11.286615 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c3763-a7e3-48fb-b7ee-d3424a94ebb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:11.287234 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c3763-a7e3-48fb-b7ee-d3424a94ebb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:11.289145 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c3763-a7e3-48fb-b7ee-d3424a94ebb0 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:11.316712 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1440/2898] 10.222.0.76 () {60 vars in 1153 bytes} [Fri Aug 26 09:05:11 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:05:11.320750 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3385ea-4513-4242-8113-a098414ae51c admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:11.330781 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3385ea-4513-4242-8113-a098414ae51c admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:11.391410 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a1407-bd0d-4e40-a508-a85b93fd25ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:11.392017 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1407-bd0d-4e40-a508-a85b93fd25ec admin admin] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:11.392304 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1407-bd0d-4e40-a508-a85b93fd25ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:11.392580 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1407-bd0d-4e40-a508-a85b93fd25ec admin admin] PATH_INFO: `/v3/users` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:11.393263 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a1407-bd0d-4e40-a508-a85b93fd25ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:11.395161 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a1407-bd0d-4e40-a508-a85b93fd25ec admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:11.416462 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1459/2899] 10.222.0.76 () {60 vars in 1144 bytes} [Fri Aug 26 09:05:11 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 09:05:11.421266 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c3763-a7e3-48fb-b7ee-d3424a94ebb0 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:11.431539 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c3763-a7e3-48fb-b7ee-d3424a94ebb0 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:11.436587 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d9910-abd2-46ee-af5d-72538ecea857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:11.437261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d9910-abd2-46ee-af5d-72538ecea857 admin admin] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:11.437551 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d9910-abd2-46ee-af5d-72538ecea857 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:11.437832 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d9910-abd2-46ee-af5d-72538ecea857 admin admin] PATH_INFO: `/v3/roles` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:11.438504 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d9910-abd2-46ee-af5d-72538ecea857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:11.440103 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d9910-abd2-46ee-af5d-72538ecea857 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:11.450249 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1441/2900] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:05:11.454242 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a1407-bd0d-4e40-a508-a85b93fd25ec admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:11.464449 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a1407-bd0d-4e40-a508-a85b93fd25ec admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:11.470067 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae2c04-854b-40dc-b155-f7fceecf8c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:11.470663 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae2c04-854b-40dc-b155-f7fceecf8c31 admin admin] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:11.470978 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae2c04-854b-40dc-b155-f7fceecf8c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:11.471414 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae2c04-854b-40dc-b155-f7fceecf8c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:11.472132 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae2c04-854b-40dc-b155-f7fceecf8c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:11.474194 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae2c04-854b-40dc-b155-f7fceecf8c31 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:11.485952 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1460/2901] 10.222.0.76 () {58 vars in 1122 bytes} [Fri Aug 26 09:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 09:05:11.490536 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d9910-abd2-46ee-af5d-72538ecea857 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:11.501183 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d9910-abd2-46ee-af5d-72538ecea857 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:11.505836 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1077f3-5b98-4b2a-bbe1-580ab839e1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:11.506486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1077f3-5b98-4b2a-bbe1-580ab839e1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:11.506787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1077f3-5b98-4b2a-bbe1-580ab839e1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:11.507054 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1077f3-5b98-4b2a-bbe1-580ab839e1ec admin admin] PATH_INFO: `/v3/projects/5a8f90088dad491ead069e20bc5095d1/users/f868d030cef54e3091a03213f7cf49a0/roles/6a5e7cb9300845e4b60b696aa66f4219` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:11.523204 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1077f3-5b98-4b2a-bbe1-580ab839e1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8f90088dad491ead069e20bc5095d1, user_id=f868d030cef54e3091a03213f7cf49a0, role_id=6a5e7cb9300845e4b60b696aa66f4219)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:11.525919 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1077f3-5b98-4b2a-bbe1-580ab839e1ec admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:11.539486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1442/2902] 10.222.0.76 () {60 vars in 1483 bytes} [Fri Aug 26 09:05:11 2022] PUT /identity/v3/projects/5a8f90088dad491ead069e20bc5095d1/users/f868d030cef54e3091a03213f7cf49a0/roles/6a5e7cb9300845e4b60b696aa66f4219 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:05:11.550437 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1158516-a5c7-47c6-aa30-0cb0c3c0f1c5 None None] REQUEST_METHOD: `POST` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:11.550950 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1158516-a5c7-47c6-aa30-0cb0c3c0f1c5 None None] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:11.551052 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1158516-a5c7-47c6-aa30-0cb0c3c0f1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:11.576057 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:05:11.580710 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.auth.core [None req-f1158516-a5c7-47c6-aa30-0cb0c3c0f1c5 None None] MFA Rules not processed for user `f868d030cef54e3091a03213f7cf49a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:05:11.582727 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-f1158516-a5c7-47c6-aa30-0cb0c3c0f1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:11.648448 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1461/2903] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:05:11 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:05:11.660567 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1077f3-5b98-4b2a-bbe1-580ab839e1ec admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:11.662362 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-cc1077f3-5b98-4b2a-bbe1-580ab839e1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:11.718359 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1077f3-5b98-4b2a-bbe1-580ab839e1ec admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:11.722312 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3d3eb-5542-4862-a9bc-a2b551fb159d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3147e5695240afa9eaf42d2343b7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:11.722918 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3d3eb-5542-4862-a9bc-a2b551fb159d service cinder] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:11.723203 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3d3eb-5542-4862-a9bc-a2b551fb159d service cinder] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:11.723486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3d3eb-5542-4862-a9bc-a2b551fb159d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:11.731721 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3d3eb-5542-4862-a9bc-a2b551fb159d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:11.733660 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3d3eb-5542-4862-a9bc-a2b551fb159d service cinder] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:11.742467 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1443/2904] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:05:11 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:05:16.893356 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1158516-a5c7-47c6-aa30-0cb0c3c0f1c5 None None] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:16.962637 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1158516-a5c7-47c6-aa30-0cb0c3c0f1c5 None None] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:16.967150 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f87f7-9db9-4214-8f90-a74cb98177d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:16.967779 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f87f7-9db9-4214-8f90-a74cb98177d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:16.968195 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f87f7-9db9-4214-8f90-a74cb98177d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:16.968484 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f87f7-9db9-4214-8f90-a74cb98177d7 admin admin] PATH_INFO: `/v3/users/f868d030cef54e3091a03213f7cf49a0` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:16.969634 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f87f7-9db9-4214-8f90-a74cb98177d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f868d030cef54e3091a03213f7cf49a0)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:16.971819 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f87f7-9db9-4214-8f90-a74cb98177d7 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:17.017355 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-334f87f7-9db9-4214-8f90-a74cb98177d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f868d030cef54e3091a03213f7cf49a0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:17.025109 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-334f87f7-9db9-4214-8f90-a74cb98177d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f868d030cef54e3091a03213f7cf49a0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:17.025729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-334f87f7-9db9-4214-8f90-a74cb98177d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f868d030cef54e3091a03213f7cf49a0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:17.032861 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-334f87f7-9db9-4214-8f90-a74cb98177d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f868d030cef54e3091a03213f7cf49a0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:17.045246 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-334f87f7-9db9-4214-8f90-a74cb98177d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f868d030cef54e3091a03213f7cf49a0'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:17.051129 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1462/2905] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:05:16 2022] DELETE /identity/v3/users/f868d030cef54e3091a03213f7cf49a0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:05:17.055620 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa91f4-ea24-4802-a29c-656773a6060d None None] REQUEST_METHOD: `POST` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:17.056133 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa91f4-ea24-4802-a29c-656773a6060d None None] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:17.056261 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa91f4-ea24-4802-a29c-656773a6060d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:17.064001 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:05:17.078851 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.auth.core [None req-fafa91f4-ea24-4802-a29c-656773a6060d None None] MFA Rules not processed for user `d9cceada370c47109408165adf5fe287`. Rule list: `[]` (Enabled: `True`). {{(pid=87892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 09:05:17.080088 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-fafa91f4-ea24-4802-a29c-656773a6060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:17.137972 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1444/2906] 10.222.0.76 () {58 vars in 958 bytes} [Fri Aug 26 09:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 09:05:17.147967 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f87f7-9db9-4214-8f90-a74cb98177d7 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:17.149408 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-334f87f7-9db9-4214-8f90-a74cb98177d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:17.178048 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:05:17.212250 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f87f7-9db9-4214-8f90-a74cb98177d7 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:17.216729 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4804a4-97df-4a64-87e4-0e7148bc5147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:17.217361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4804a4-97df-4a64-87e4-0e7148bc5147 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:17.217640 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4804a4-97df-4a64-87e4-0e7148bc5147 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:17.217908 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4804a4-97df-4a64-87e4-0e7148bc5147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:17.228361 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4804a4-97df-4a64-87e4-0e7148bc5147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:17.229806 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4804a4-97df-4a64-87e4-0e7148bc5147 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:17.239236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1463/2907] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:05:17.498648 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa91f4-ea24-4802-a29c-656773a6060d None None] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:05:17.500111 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-fafa91f4-ea24-4802-a29c-656773a6060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:05:17.514376 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa91f4-ea24-4802-a29c-656773a6060d None None] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:05:17.519355 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f4132-2cdd-45a6-9e54-fd01a94d914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:05:17.520031 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f4132-2cdd-45a6-9e54-fd01a94d914d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:05:17.520320 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f4132-2cdd-45a6-9e54-fd01a94d914d admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:05:17.520596 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f4132-2cdd-45a6-9e54-fd01a94d914d admin admin] PATH_INFO: `/v3/projects/5a8f90088dad491ead069e20bc5095d1` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:05:17.521787 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f4132-2cdd-45a6-9e54-fd01a94d914d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a8f90088dad491ead069e20bc5095d1)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:05:17.523695 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f4132-2cdd-45a6-9e54-fd01a94d914d admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:05:17.573888 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b93f4132-2cdd-45a6-9e54-fd01a94d914d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a8f90088dad491ead069e20bc5095d1', 'request_id': 'req-b93f4132-2cdd-45a6-9e54-fd01a94d914d'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:17.581262 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b93f4132-2cdd-45a6-9e54-fd01a94d914d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a8f90088dad491ead069e20bc5095d1', 'request_id': 'req-b93f4132-2cdd-45a6-9e54-fd01a94d914d'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:17.590044 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b93f4132-2cdd-45a6-9e54-fd01a94d914d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a8f90088dad491ead069e20bc5095d1', 'request_id': 'req-b93f4132-2cdd-45a6-9e54-fd01a94d914d'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:17.601033 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b93f4132-2cdd-45a6-9e54-fd01a94d914d admin admin] The token cache is being invalidate because project 5a8f90088dad491ead069e20bc5095d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:05:17.601325 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b93f4132-2cdd-45a6-9e54-fd01a94d914d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:17.601947 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-b93f4132-2cdd-45a6-9e54-fd01a94d914d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:05:17.603411 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1445/2908] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:05:17 2022] DELETE /identity/v3/projects/5a8f90088dad491ead069e20bc5095d1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:05:27.235142 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=16 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:05:27.597913 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:06:29.833681 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4804a4-97df-4a64-87e4-0e7148bc5147 service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:06:29.835036 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-4a4804a4-97df-4a64-87e4-0e7148bc5147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:06:29.847256 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4804a4-97df-4a64-87e4-0e7148bc5147 service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:06:29.894494 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28285200-d0f7-498f-9481-366c99176351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:06:29.895090 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28285200-d0f7-498f-9481-366c99176351 service neutron] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:06:29.895370 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28285200-d0f7-498f-9481-366c99176351 service neutron] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:06:29.895643 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28285200-d0f7-498f-9481-366c99176351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:06:29.897401 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-28285200-d0f7-498f-9481-366c99176351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:06:29.958613 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28285200-d0f7-498f-9481-366c99176351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:06:29.960051 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28285200-d0f7-498f-9481-366c99176351 service neutron] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:06:29.969794 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1464/2909] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:06:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:06:34.694530 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f4132-2cdd-45a6-9e54-fd01a94d914d admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:06:34.696716 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-b93f4132-2cdd-45a6-9e54-fd01a94d914d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:06:34.726932 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f4132-2cdd-45a6-9e54-fd01a94d914d admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:06:34.731606 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a55c7-c8fd-4d05-bc00-7b9710e963ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a867070e974a918a906148bbfd1fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:06:34.732231 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a55c7-c8fd-4d05-bc00-7b9710e963ec service neutron] REQUEST_METHOD: `GET` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:06:34.732492 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a55c7-c8fd-4d05-bc00-7b9710e963ec service neutron] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:06:34.732785 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a55c7-c8fd-4d05-bc00-7b9710e963ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:06:34.734657 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-f22a55c7-c8fd-4d05-bc00-7b9710e963ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:06:34.811658 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a55c7-c8fd-4d05-bc00-7b9710e963ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:06:34.813141 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a55c7-c8fd-4d05-bc00-7b9710e963ec service neutron] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:06:34.823571 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1446/2910] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:06:39.965610 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=48 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:06:41.627931 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28285200-d0f7-498f-9481-366c99176351 service neutron] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:06:41.629537 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-28285200-d0f7-498f-9481-366c99176351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:06:41.645403 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28285200-d0f7-498f-9481-366c99176351 service neutron] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:06:41.650223 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abd6f9-d1f6-4ebe-9f94-01b6b66012d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:06:41.650884 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abd6f9-d1f6-4ebe-9f94-01b6b66012d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:06:41.651185 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abd6f9-d1f6-4ebe-9f94-01b6b66012d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:06:41.651461 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abd6f9-d1f6-4ebe-9f94-01b6b66012d2 admin admin] PATH_INFO: `/v3/users/5f57995725994e96b89ef3c242efbe46` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:06:41.652614 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abd6f9-d1f6-4ebe-9f94-01b6b66012d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f57995725994e96b89ef3c242efbe46)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:06:41.654622 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abd6f9-d1f6-4ebe-9f94-01b6b66012d2 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:06:41.703176 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b1abd6f9-d1f6-4ebe-9f94-01b6b66012d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f57995725994e96b89ef3c242efbe46'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:41.713322 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b1abd6f9-d1f6-4ebe-9f94-01b6b66012d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f57995725994e96b89ef3c242efbe46'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:41.714025 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b1abd6f9-d1f6-4ebe-9f94-01b6b66012d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f57995725994e96b89ef3c242efbe46'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:41.722457 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b1abd6f9-d1f6-4ebe-9f94-01b6b66012d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f57995725994e96b89ef3c242efbe46'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:41.736949 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-b1abd6f9-d1f6-4ebe-9f94-01b6b66012d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f57995725994e96b89ef3c242efbe46'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:41.743282 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1465/2911] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:06:41 2022] DELETE /identity/v3/users/5f57995725994e96b89ef3c242efbe46 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:06:41.924950 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a55c7-c8fd-4d05-bc00-7b9710e963ec service neutron] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:06:41.935273 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a55c7-c8fd-4d05-bc00-7b9710e963ec service neutron] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:06:41.995444 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27899871-c7ad-4f9f-8577-3d9762ed2c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:06:41.995988 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27899871-c7ad-4f9f-8577-3d9762ed2c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:06:41.996274 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27899871-c7ad-4f9f-8577-3d9762ed2c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:06:41.996541 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27899871-c7ad-4f9f-8577-3d9762ed2c20 admin admin] PATH_INFO: `/v3/projects/b8609013640e4cc388196b1cdb48de1b` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:06:41.997715 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27899871-c7ad-4f9f-8577-3d9762ed2c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8609013640e4cc388196b1cdb48de1b)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:06:41.999617 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27899871-c7ad-4f9f-8577-3d9762ed2c20 admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:06:42.047173 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-27899871-c7ad-4f9f-8577-3d9762ed2c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8609013640e4cc388196b1cdb48de1b', 'request_id': 'req-27899871-c7ad-4f9f-8577-3d9762ed2c20'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:42.054093 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-27899871-c7ad-4f9f-8577-3d9762ed2c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8609013640e4cc388196b1cdb48de1b', 'request_id': 'req-27899871-c7ad-4f9f-8577-3d9762ed2c20'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:42.061550 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-27899871-c7ad-4f9f-8577-3d9762ed2c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8609013640e4cc388196b1cdb48de1b', 'request_id': 'req-27899871-c7ad-4f9f-8577-3d9762ed2c20'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:42.072279 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-27899871-c7ad-4f9f-8577-3d9762ed2c20 admin admin] The token cache is being invalidate because project b8609013640e4cc388196b1cdb48de1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:06:42.072590 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-27899871-c7ad-4f9f-8577-3d9762ed2c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:42.073820 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-27899871-c7ad-4f9f-8577-3d9762ed2c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:42.075618 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1447/2912] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:06:41 2022] DELETE /identity/v3/projects/b8609013640e4cc388196b1cdb48de1b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:06:42.080283 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abd6f9-d1f6-4ebe-9f94-01b6b66012d2 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:06:42.081757 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-b1abd6f9-d1f6-4ebe-9f94-01b6b66012d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:06:42.096236 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abd6f9-d1f6-4ebe-9f94-01b6b66012d2 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:06:42.155592 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1a1d4-ee7f-4761-8fdf-541cb5d0ec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:06:42.156244 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a1d4-ee7f-4761-8fdf-541cb5d0ec62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:06:42.156533 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a1d4-ee7f-4761-8fdf-541cb5d0ec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:06:42.156813 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a1d4-ee7f-4761-8fdf-541cb5d0ec62 admin admin] PATH_INFO: `/v3/users/52917b06b1a74763bf43c2bcfdffa8cd` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:06:42.158015 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1a1d4-ee7f-4761-8fdf-541cb5d0ec62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52917b06b1a74763bf43c2bcfdffa8cd)` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:06:42.159948 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1a1d4-ee7f-4761-8fdf-541cb5d0ec62 admin admin] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:06:42.208917 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d6d1a1d4-ee7f-4761-8fdf-541cb5d0ec62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52917b06b1a74763bf43c2bcfdffa8cd'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:42.216501 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d6d1a1d4-ee7f-4761-8fdf-541cb5d0ec62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52917b06b1a74763bf43c2bcfdffa8cd'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:42.217186 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d6d1a1d4-ee7f-4761-8fdf-541cb5d0ec62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52917b06b1a74763bf43c2bcfdffa8cd'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:42.225450 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d6d1a1d4-ee7f-4761-8fdf-541cb5d0ec62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52917b06b1a74763bf43c2bcfdffa8cd'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:42.233321 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:06:42.238987 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.notifications [None req-d6d1a1d4-ee7f-4761-8fdf-541cb5d0ec62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52917b06b1a74763bf43c2bcfdffa8cd'} {{(pid=87893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:42.246761 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1466/2913] 10.222.0.76 () {58 vars in 1224 bytes} [Fri Aug 26 09:06:42 2022] DELETE /identity/v3/users/52917b06b1a74763bf43c2bcfdffa8cd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:06:42.426366 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27899871-c7ad-4f9f-8577-3d9762ed2c20 admin admin] Authenticating user token {{(pid=87892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:06:42.427816 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.fernet_utils [None req-27899871-c7ad-4f9f-8577-3d9762ed2c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:06:42.441552 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27899871-c7ad-4f9f-8577-3d9762ed2c20 admin admin] Validating token access rules against request {{(pid=87892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:06:42.466420 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:06:42.505780 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be8503-7678-48b0-b0d2-58e6b48e0e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9cceada370c47109408165adf5fe287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '643957365e294b92aa340cb2a3f5aab3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:06:42.506332 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be8503-7678-48b0-b0d2-58e6b48e0e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:06:42.506616 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be8503-7678-48b0-b0d2-58e6b48e0e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:06:42.506894 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be8503-7678-48b0-b0d2-58e6b48e0e0c admin admin] PATH_INFO: `/v3/projects/805cd7d269f44df982854186c8019cee` {{(pid=87892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:06:42.508024 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be8503-7678-48b0-b0d2-58e6b48e0e0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=805cd7d269f44df982854186c8019cee)` {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:06:42.509982 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be8503-7678-48b0-b0d2-58e6b48e0e0c admin admin] RBAC: Authorization granted {{(pid=87892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:06:42.556509 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d0be8503-7678-48b0-b0d2-58e6b48e0e0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805cd7d269f44df982854186c8019cee', 'request_id': 'req-d0be8503-7678-48b0-b0d2-58e6b48e0e0c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:42.563697 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d0be8503-7678-48b0-b0d2-58e6b48e0e0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805cd7d269f44df982854186c8019cee', 'request_id': 'req-d0be8503-7678-48b0-b0d2-58e6b48e0e0c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:42.571486 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d0be8503-7678-48b0-b0d2-58e6b48e0e0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805cd7d269f44df982854186c8019cee', 'request_id': 'req-d0be8503-7678-48b0-b0d2-58e6b48e0e0c'} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:42.583196 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d0be8503-7678-48b0-b0d2-58e6b48e0e0c admin admin] The token cache is being invalidate because project 805cd7d269f44df982854186c8019cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 09:06:42.583487 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d0be8503-7678-48b0-b0d2-58e6b48e0e0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:42.584291 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG keystone.notifications [None req-d0be8503-7678-48b0-b0d2-58e6b48e0e0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 09:06:42.586072 dv-cinder-852364-5-smb devstack@keystone.service[87892]: [pid: 87892|app: 0|req: 1448/2914] 10.222.0.76 () {58 vars in 1233 bytes} [Fri Aug 26 09:06:42 2022] DELETE /identity/v3/projects/805cd7d269f44df982854186c8019cee => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 09:06:52.244375 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:06:52.579832 dv-cinder-852364-5-smb devstack@keystone.service[87892]: DEBUG dbcounter [-] [87892] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:10:10.466193 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1a1d4-ee7f-4761-8fdf-541cb5d0ec62 admin admin] Authenticating user token {{(pid=87893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 09:10:10.467578 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-d6d1a1d4-ee7f-4761-8fdf-541cb5d0ec62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:10:10.605778 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1a1d4-ee7f-4761-8fdf-541cb5d0ec62 admin admin] Validating token access rules against request {{(pid=87893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 09:10:10.663602 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb1fc-0078-4d0d-b2f8-baf6e8604153 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95abbd88e549427abbf5699efed0451a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aafba89a1d47cd86cef1eb0a11e507', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 09:10:10.664215 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb1fc-0078-4d0d-b2f8-baf6e8604153 service placement] REQUEST_METHOD: `GET` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 09:10:10.664503 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb1fc-0078-4d0d-b2f8-baf6e8604153 service placement] SCRIPT_NAME: `/identity` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 09:10:10.664782 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb1fc-0078-4d0d-b2f8-baf6e8604153 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 09:10:10.666545 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.fernet_utils [None req-fe3eb1fc-0078-4d0d-b2f8-baf6e8604153 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 09:10:10.677771 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3eb1fc-0078-4d0d-b2f8-baf6e8604153 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 09:10:10.679353 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3eb1fc-0078-4d0d-b2f8-baf6e8604153 service placement] RBAC: Authorization granted {{(pid=87893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 09:10:10.689403 dv-cinder-852364-5-smb devstack@keystone.service[87893]: [pid: 87893|app: 0|req: 1467/2915] 10.222.0.76 () {60 vars in 1365 bytes} [Fri Aug 26 09:10:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 09:10:20.685044 dv-cinder-852364-5-smb devstack@keystone.service[87893]: DEBUG dbcounter [-] [87893] Writing DB stats keystone:SELECT=89 {{(pid=87893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}